Differential and dictionary mixed compression method and device for time series data of Internet of Vehicles
By using an adaptive temporal structure analytical model and dictionary hybrid coding technology, the problem of low data compression efficiency in vehicle networking is solved. It enables adaptive adjustment of differential depth and coding structure according to changes in vehicle conditions, thereby improving compression efficiency and transmission efficiency.
Patent Information
- Application Number
- CN202511850527.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-09
- Publication Date
- 2026-03-20
AI Technical Summary
Existing vehicle-to-everything (V2X) data compression methods cannot adapt to the differences in temporal structure under different vehicle conditions and scenarios, resulting in a decrease in compression efficiency.
An adaptive temporal structure analytical model is adopted to obtain differential perturbation factors. By combining first-order differential coding and second-order differential coding with dynamic dictionary indexing, the differential depth and coding structure are adaptively adjusted to achieve hybrid compression of differential and dictionary data of vehicle network time series data.
It improves the compression and transmission efficiency of vehicle network data, and can adaptively adjust according to the differences in continuity, volatility and abrupt changes in different vehicle conditions, thereby reducing the overall data volume.
Smart Images

Figure CN121710936A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of vehicle network data processing, and in particular to a method and apparatus for differential and dictionary hybrid compression of vehicle network time-series data. Background Technology
[0002] Nowadays, vehicle-to-everything (V2X) data is continuously generated and uploaded through communication links during vehicle operation in a high-frequency, long-term, and all-weather manner. Therefore, in order to reduce transmission load and storage pressure, a better approach is to compress the V2X data before uploading it to the cloud.
[0003] However, while existing solutions typically perform differential encoding on vehicle-to-everything (V2X) data before compression to reduce numerical range, each differential encoding uses the same fixed differential method. This fails to adaptively analyze the differences in continuity, volatility, and abrupt changes in the differential sequence based on variations in temporal structure caused by different vehicle conditions, reporting scenarios, and data types. When faced with situations such as long-term constant-speed cruising, entering frequently stopping and starting urban areas, triggering vehicle system state transitions, or reporting abnormal operating conditions, the aforementioned methods cannot adapt to the temporal structure differences caused by these different scenarios due to significant differences in continuity, local volatility, and sudden abrupt changes in the V2X reported data at different stages. This results in a significant decrease in subsequent compression efficiency.
[0004] Therefore, there is an urgent need for a method and apparatus for differential and dictionary hybrid compression of vehicle network time-series data. Summary of the Invention
[0005] This application provides a method and apparatus for differential and dictionary hybrid compression of vehicle network time-series data, which solves the problem that existing methods cannot adapt to the differences in the time-series structure of vehicle network data under different abnormal scenarios, thus leading to a significant reduction in subsequent compression efficiency.
[0006] The first aspect of this application provides a method for differential and dictionary hybrid compression of time-series data in the Internet of Vehicles (IoV). The method includes: acquiring the original data corresponding to the target vehicle in the IoV; performing first-order differential encoding on the original data to obtain a first-order differential sequence; obtaining the differential perturbation factors corresponding to the first-order differential sequence through an adaptive time-series structure analysis model, and calculating the redundancy corresponding to the first-order differential sequence based on the differential perturbation factors; determining whether the redundancy is greater than a preset redundancy threshold; if it is confirmed that the redundancy is greater than the preset redundancy threshold, performing second-order differential encoding on the first-order differential sequence based on the differential perturbation factors to obtain a second-order differential sequence; using a dynamic dictionary to replace the target string in the second-order differential sequence with a dictionary index; compressing and encapsulating the second-order differential sequence and the dictionary index, and uploading them to the IoV cloud.
[0007] Optionally, the raw data corresponding to the target vehicle in the Internet of Vehicles can be obtained, specifically including: obtaining raw data through time-series acquisition operations of the vehicle communication link, and identifying the data type corresponding to the raw data. The raw data includes timestamp data, mileage data, and vehicle speed data, and the data types include numeric and string types.
[0008] Optionally, the original data is subjected to first-order difference encoding to obtain a first-order difference sequence, specifically including: performing adjacent time-time numerical difference processing on the numerical data in the original data, calculating the difference between the current value and the previous time-time value of the numerical data through adjacent sampling points, and constructing a first-order difference sequence to represent the magnitude of numerical change; performing string preservation processing on the string data in the original data, and writing the string data as a zero-difference identifier into the first-order difference sequence.
[0009] Optionally, the differential perturbation factors in the first-order difference sequence are obtained through an adaptive time-series structure analytical model. Specifically, this includes: performing local correlation measurement, sliding window fluctuation detection, and abrupt deviation judgment operations on the first-order difference sequence using the adaptive time-series structure analytical model, and constructing a differential change relationship pattern between adjacent difference values based on the operation results. The differential change relationship pattern includes a continuity disruption pattern to characterize the degree of difference continuity disruption, a fluctuation enhancement pattern to characterize the degree of local fluctuation enhancement, and a jump amplification pattern to characterize the instantaneous deviation amplitude of the difference. Based on the differential change relationship pattern, the corresponding differential perturbation factors are extracted from the first-order difference sequence. The differential perturbation factors include continuity disruption factors, fluctuation enhancement factors, and jump amplification factors.
[0010] Optionally, the redundancy of the first-order difference sequence is calculated based on the difference perturbation factor, specifically including: calculating the continuity loss value to characterize the degree of repeatability reduction of the difference sequence based on the continuity disruption factor; calculating the fluctuation diffusion value to characterize the local discrete diffusion level of the difference sequence based on the fluctuation enhancement factor; calculating the jump deviation value to characterize the instantaneous abnormal deviation intensity of the difference sequence based on the jump amplification factor; and calculating the redundancy based on the continuity loss value, fluctuation diffusion value, and jump deviation value.
[0011] Optionally, second-order difference encoding is performed on the first-order difference sequence based on the difference perturbation factor to obtain a second-order difference sequence. Specifically, this includes: constructing a three-dimensional perturbation vector based on continuity loss, fluctuation diffusion, and jump deviation; performing perturbation distribution mapping on the three-dimensional perturbation vector based on the feature projection operator, and obtaining the perturbation projection value corresponding to each vector; calculating the distance between the perturbation projection value and multiple perturbation cluster centers in a preset perturbation clustering space, and obtaining the target perturbation cluster center corresponding to the minimum distance value; determining the corresponding second-order difference encoding mode based on the target perturbation cluster center, where the second-order difference encoding mode includes a linear second-order difference mode that enhances continuity, a smooth second-order difference mode that suppresses local discrepancies, and a robust second-order difference mode that maintains jump sensitivity; and performing second-order difference encoding on the first-order difference sequence based on the second-order difference encoding mode to obtain a second-order difference sequence.
[0012] Optionally, the target string in the second-order difference sequence can be replaced by a dictionary index using a dynamic dictionary. Specifically, this includes: obtaining the status string and fault code string in the second-order difference sequence as the target string; performing dictionary matching on the target string in conjunction with the real-time update rules of the dynamic dictionary; and replacing the target string with the dictionary index.
[0013] A second aspect of this application provides a differential and dictionary hybrid compression device for vehicle network time-series data. The device includes an acquisition module and a processing module, wherein... The acquisition module is used to acquire the original data corresponding to the target vehicle in the Internet of Vehicles; to perform first-order differential encoding on the original data to obtain a first-order differential sequence; to obtain the differential perturbation factors corresponding to the first-order differential sequence through an adaptive time-series structure analysis model, and to calculate the redundancy corresponding to the first-order differential sequence based on the differential perturbation factors.
[0014] The processing module is used to determine whether the redundancy is greater than the preset redundancy threshold. If it is confirmed that the redundancy is greater than the preset redundancy threshold, the first-order difference sequence is subjected to second-order difference encoding based on the difference perturbation factor to obtain the second-order difference sequence. The target string in the second-order difference sequence is replaced by the dictionary index through the dynamic dictionary. The second-order difference sequence and the dictionary index are compressed and encapsulated, and then uploaded to the vehicle network cloud.
[0015] A third aspect of this application provides an electronic device including a processor, a memory, a user interface, and a network interface. The memory is used to store instructions, the user interface and the network interface are used to communicate with other devices, and the processor is used to execute the instructions stored in the memory to cause the electronic device to perform the method as described above.
[0016] A fourth aspect of this application provides a computer-readable storage medium storing a computer program, which is executed by a processor using the method described in any of the foregoing descriptions.
[0017] One or more technical solutions provided in the embodiments of this application have at least the following technical effects or advantages: 1. Obtain the raw data corresponding to the target vehicle in the vehicle network; perform first-order differential encoding on the raw data to obtain a first-order differential sequence; obtain the differential perturbation factors corresponding to the first-order differential sequence through a preset model, and calculate the redundancy corresponding to the first-order differential sequence based on the differential perturbation factors; when it is confirmed that the redundancy is greater than the preset redundancy threshold, perform second-order differential encoding on the first-order differential sequence based on the differential perturbation factors to obtain a second-order differential sequence; use the dictionary index to replace the target string in the second-order differential sequence through a dynamic dictionary; compress and encapsulate the second-order differential sequence and the dictionary index, and upload them to the vehicle network cloud, so that the differential depth and encoding structure can be adaptively adjusted according to the differences in continuity, volatility and jumps presented in different vehicle condition stages during the vehicle network reporting process, reducing the overall data volume and improving compression efficiency and transmission efficiency while ensuring reproducibility.
[0018] 2. An adaptive temporal structure analysis model is used to perform local correlation measurement, sliding window fluctuation detection, and abrupt deviation judgment operations on the first-order difference sequence, and a difference change relationship pattern between adjacent difference values is constructed based on the operation results. Based on the difference change relationship pattern, corresponding difference perturbation factors are extracted from the first-order difference sequence. The difference perturbation factors include continuity disruption factors, fluctuation enhancement factors, and jump amplification factors. This allows the structured revelation of the degree of continuity degradation, local fluctuation intensity, and instantaneous jump amplitude of the first-order difference sequence at different time stages. This enables subsequent redundancy calculation and difference depth selection to be adaptive to real vehicle condition changes, and supports refined identification of the structural features of the difference sequence and adjustable coding decision-making.
[0019] 3. Construct a three-dimensional perturbation vector based on continuity loss, fluctuation diffusion, and jump deviation values; perform perturbation distribution mapping on the three-dimensional perturbation vector based on the feature projection operator, and obtain the perturbation projection value corresponding to each vector; calculate the distance between the perturbation projection value and multiple perturbation cluster centers in the preset perturbation cluster space, and obtain the target perturbation cluster center corresponding to the minimum distance value; determine the corresponding second-order difference coding mode based on the target perturbation cluster center, so as to adaptively select the most matching second-order difference coding method according to the actual perturbation structure of the first-order difference sequence in terms of continuity, local discreteness, and anomalous jump, so that the difference sequences under different perturbation forms can obtain a deep compression effect consistent with their structural characteristics, and improve the adaptability and compression efficiency of the overall difference coding. Attached Figure Description
[0020] Figure 1This is a flowchart illustrating a method for differential and dictionary hybrid compression of vehicle network time-series data provided in an embodiment of this application; Figure 2 This is a schematic diagram illustrating the relationship between differential compression of vehicle network time-series data and dictionary index mapping, provided in an embodiment of this application. Figure 3 This is a schematic diagram of a differential and dictionary hybrid compression device for vehicle network time-series data provided in an embodiment of this application; Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.
[0021] Explanation of reference numerals in the attached figures: 31, acquisition module; 32, processing module; 401, processor; 402, communication bus; 403, user interface; 404, network interface; 405, memory. Detailed Implementation
[0022] To enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments.
[0023] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in this application refers to and includes any or all possible combinations of one or more of the listed items.
[0024] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.
[0025] To enable those skilled in the art to better understand the technical solution of the present invention, the present invention will be further described in detail below with reference to the accompanying drawings.
[0026] Please refer to Figure 1 The diagram illustrates a flowchart of a differential and dictionary hybrid compression method for vehicle network time-series data provided in this application embodiment. The flowchart mainly includes the following steps: S101 to S107.
[0027] Step S101: Obtain the raw data corresponding to the target vehicle in the vehicle network.
[0028] Specifically, when acquiring the raw data corresponding to the target vehicle in the Internet of Vehicles, the vehicle terminal reports the timestamp data, mileage data, speed data and vehicle status information generated during vehicle operation in real time based on the communication link between the vehicle and the cloud, so that the above raw data can enter the subsequent encoding and processing process after collection.
[0029] In one possible implementation, step S101 further includes: acquiring raw data through a timing acquisition operation of the vehicle communication link, and identifying the data type corresponding to the raw data. The raw data includes timestamp data, mileage data, and vehicle speed data, and the data types include numeric and string types. Specifically, by deploying a communication-enabled vehicle-mounted terminal on the target vehicle, timestamp data, mileage data, and vehicle speed data are continuously collected from the vehicle bus or local sensing unit according to a preset reporting cycle and triggering conditions. The collected data is encapsulated into time-series data frames conforming to a preset message format and sent to the data processing side via a cellular network, a dedicated vehicle-to-everything (V2X) network, or a wireless local area network. On the data processing side, the received data frames are parsed. Based on the identifiers, length information, and encoding rules of each field in the message format definition, the timestamp field, mileage field, and vehicle speed field are separated from the data frame. According to the preset data type mapping relationship of the fields, the timestamp field, mileage field, and vehicle speed field are marked as numerical data, while the status field and fault code field, which represent the vehicle's operating status, are marked as string data. This completes the identification of the data type of the original data, laying the foundation for subsequent differential coding and dynamic dictionary compression to perform differentiated compression processing on numerical data and string data, respectively.
[0030] Step S102: Perform first-order difference encoding on the original data to obtain a first-order difference sequence.
[0031] Specifically, when performing first-order difference encoding on the original data to obtain a first-order difference sequence, for data identified as numerical, the numerical difference between adjacent data points is calculated to construct a first-order difference sequence representing the magnitude of change in data changes at consecutive times. In this process, string data is written into the first-order difference sequence in its original string form, so that the change characteristics of numerical data can be compressed and expressed, while the recognizability of string data is preserved in subsequent processing stages.
[0032] In one possible implementation, step S101 further includes: performing adjacent time-time numerical difference processing on the numerical data in the original data, calculating the difference between the current value and the previous time-time value of the numerical data through adjacent sampling points, and constructing a first-order difference sequence to represent the magnitude of numerical change; performing string preservation processing on the string data in the original data, and writing the string data as a zero-difference identifier into the first-order difference sequence.
[0033] Specifically, taking timestamp data as an example, since the vehicle reporting times are usually continuous and the timing is stable, after arranging the received timestamp data in chronological order, the first timestamp is used as the initial reference value T0 and directly written into the first-order difference sequence. For the second timestamp, the first-order difference result is obtained by calculating the difference between it and the initial reference value T0. For example, if the current timestamp is 1681234567990 and the previous timestamp is 1681234567890, the difference result is 100, and this difference result is written into the first-order difference sequence. The same method is used for the third and subsequent timestamps. The difference between adjacent timestamps is calculated. For example, the difference between the third and second timestamps is 100, and the difference between the fourth and third timestamps is also 100, thus forming a first-order difference sequence of timestamps with stable difference characteristics. This significantly reduces the numerical span of the timestamp data while maintaining the reproducibility of the sequence, providing greater compression space for subsequent difference compression. Taking mileage data as a further example, since vehicle mileage has the characteristic of monotonically increasing or slowly changing in a physical sense, there is a high degree of consistency between adjacent mileage points. Therefore, adjacent time-time difference processing can also be performed on mileage data. The first mileage data is used as the initial reference value M0 and directly written into the first-order difference sequence. For the second mileage data, the difference is obtained by calculating its difference from the initial reference value M0. For example, if the first mileage value is 78964 and the second mileage value is 78976, the difference result is 12. For the third mileage data, the difference result is obtained by comparing it with the previous mileage value, which is 12. For the fourth mileage data, the difference result is obtained by comparing it with the third mileage value, which is 9. This allows the construction of a first-order difference sequence of driving mileage with obvious continuity characteristics, resulting in a smaller numerical variation in driving mileage data after differencing.
[0034] When processing string data, since string data does not have the continuous characteristics of numerical difference, its content itself constitutes a semantic unit. Therefore, in the first-order difference stage, its original string form is directly maintained and written into the first-order difference sequence with zero difference identifier, so that the string data can be correctly identified and processed in the subsequent dictionary matching and index replacement steps.
[0035] Step S103: Obtain the corresponding difference perturbation factors in the first-order difference sequence through the adaptive time-series structure analytical model, and calculate the redundancy of the first-order difference sequence based on the difference perturbation factors.
[0036] Specifically, by performing temporal structure analysis on the first-order difference sequence to identify key features reflecting the instability of difference changes, differential perturbation factors are constructed to characterize the sequence perturbation state based on the continuous changes of adjacent difference values, the fluctuation amplitude of local difference values, and the degree of jump of difference values relative to the reference interval. Based on the differential perturbation factors, the repeatability, discreteness, and abnormal offset characteristics of the first-order difference sequence are comprehensively quantified to generate the first-order differential redundancy that can reflect the compressible space of the sequence, providing a basis for determining whether to perform second-order differential coding.
[0037] In one possible implementation, step S103 further includes: performing local correlation measurement, sliding window fluctuation detection, and abrupt deviation determination operations on the first-order difference sequence using an adaptive time-series structure analytical model, and constructing a difference change relationship pattern between adjacent difference values based on the operation results. The difference change relationship pattern includes a continuity disruption pattern to characterize the degree of difference continuity disruption, a fluctuation enhancement pattern to characterize the degree of local fluctuation enhancement, and a jump amplification pattern to characterize the instantaneous deviation amplitude of the difference. Based on the difference change relationship pattern, corresponding difference perturbation factors are extracted from the first-order difference sequence. The difference perturbation factors include continuity disruption factors, fluctuation enhancement factors, and jump amplification factors.
[0038] Specifically, in the processing stage of the adaptive temporal structure analytical model, the first-order difference sequence is denoted as sequence. ,in This represents the index of the differenced sample on the time axis, with a value range of [value missing]. , This is the length of the first-order difference sequence. The length is determined by setting a value of 0 on this sequence. Sliding windows constitute a window set. ,in For the first The set of indices corresponding to each window The range of values is , The sliding window length is determined by the sequence length and the window length. It is a preset positive integer.
[0039] In the local correlation measurement operation, to measure the continuity relationship between adjacent difference values, for each window... Calculate the local mean using the difference values within the range. And construct local autocorrelation coefficients based on the differences:
[0040] in, Indicates the first The first-order difference local correlation coefficient within a window is used to measure the degree of linear correlation between adjacent difference values. Theoretically, its value range is within a certain range. between; Display window The numerator represents the mean of all differences within the window; the numerator represents the degree of co-change between the differences within the window and the differences at the previous time step; the denominator normalizes the numerical range to make the correlation coefficients of different windows comparable; when When the difference is close to 1, it indicates that the difference value changes continuously and with a consistent trend within that window. A significant decrease indicates a disruption of continuity. Based on this local correlation coefficient, a continuity disruption index can be constructed at the window level; for example, the continuity disruption degree can be set as:
[0041]
[0042] in, Indicates the first The degree of continuity disruption within a window, when At higher Smaller size indicates good continuity. During descent An increase indicates enhanced continuity failure. Continuity failure modes can be identified by observing different windows. Characterized by distribution, the continuous disruptive factors can be analyzed across all windows. The maximum, mean, or weighted mean aggregation is performed to characterize the degree of continuity weakening at the overall sequence level.
[0043] In the sliding window fluctuation detection operation, in order to characterize the enhancement of fluctuations in local difference values, each sliding window... The intensity of local fluctuations can be calculated using the difference values within the range. Measures based on variance or mean square deviation can be used. Local fluctuation can be defined as:
[0044] in, Indicates the first Local volatility within a window is used to measure the average deviation of the difference value from the local mean. This indicates the number of samples contained within the window, usually equal to... Or slightly less affected by boundary conditions ;when A larger value indicates that the difference values fluctuate wildly within the window. A smaller value indicates that the difference values within that window are relatively stable. To map the volatility of different windows to a unified volatility enhancement metric, a reference volatility threshold can be set during the calibration phase. and magnification factor And through monotonic nonlinear functions to Perform a normalization mapping, for example, to construct the wave diffusion value:
[0045]
[0046] in, Indicates the first The fluctuation diffusion value of each window, with a value range of [value range missing]. between; A positive parameter used to control volatility To the fluctuation diffusion value Sensitivity to change, When the magnitude is large, even small fluctuations will be amplified and reflected in the data. superior; For reference fluctuation levels, they can be obtained statistically from the first-order difference series under historical stable operating conditions; when Significantly higher hour, A value close to 1 indicates a significant increase in volatility. Below or near hour, A value close to 0 indicates that volatility has not significantly increased. Volatility enhancement patterns can be analyzed... The distribution over time can be used to characterize the fluctuations, while the factors that enhance volatility can be analyzed through the distribution over each window. Aggregation is performed to obtain, for example, the maximum volatility diffusion value, the average volatility diffusion value, or a weighted combination, to reflect the volatility enhancement characteristics of the first-order difference sequence at the global level.
[0047] In the mutation deviation determination operation, in order to identify instantaneous anomalous jumps in the difference sequence relative to the reference difference partition, reference difference statistical parameters are established for the first-order difference sequence. These parameters can be calculated by taking the reference mean and reference dispersion within the historical stable period or the steady-state interval of the current sequence. For example, the reference mean can be expressed as:
[0048] Reference Dispersion for:
[0049] in, Indicates the mean of the reference difference. Indicates the reference difference divergence. Represents the set of indices for the reference interval. This indicates the number of samples within the reference interval. The reference interval can be selected during a stable phase of vehicle operation, or it can be adaptively determined within the current sequence based on segments with good continuity and low fluctuation. For any difference sample... We can construct its jump deviation relative to the reference statistical properties, for example, defining the single-point jump deviation as:
[0050]
[0051] in, Indicates the first The jump deviation of a difference sample is used to measure the relative magnitude of the difference value from the reference mean; To prevent extremely small positive values where the denominator is zero; when A larger value indicates a significant jump at that point. To characterize the jump zoom pattern at the window level, it can be done in each window. Internal Aggregation, such as taking the maximum or average value, yields the window-level jump magnification, which can be written as:
[0052]
[0053] in, Indicates the first The zoom level of each window changes when... When the value approaches or exceeds a preset threshold, it indicates that a significant abrupt zoom-in pattern exists within that window. The abrupt zoom-in factor can be adjusted by modifying the settings of each window. The aggregation yields a sequence that characterizes the significance of jump anomalies at the overall level of first-order difference sequences.
[0054] After completing the local correlation measurement, sliding window fluctuation detection, and abrupt deviation determination, a differential change relationship pattern is constructed at the window level, and the continuity disruption degree at the window level is then considered. , fluctuation diffusion value and jump amplification This is mapped to sequence-level continuity-breaking factors, fluctuation-enhancing factors, and jump-amplifying factors. Continuity-breaking factors can be identified through all windows. Obtained by taking the maximum value or weighted average, it is used to represent the most severe or overall average continuity weakening in the first-difference sequence; the volatility enhancement factor can be obtained by applying the values of all windows. The statistical measure is used to represent the degree of overall volatility enhancement in the sequence; the jump amplification factor can be obtained by applying it to all windows. The maximum value or high quantile is used to represent the significance of anomalous jumps in the sequence. Based on the parameter calibration experience in this field, the three types of factors can be normalized to the same numerical range, thus providing a unified input feature for subsequent redundancy calculations.
[0055] When calculating the redundancy of a first-order difference sequence based on differential perturbation factors, a comprehensive measure of first-order difference redundancy is constructed by taking continuity disruption factors, fluctuation enhancement factors, and jump amplification factors as inputs. When the continuity disruption factor is low, the fluctuation enhancement factor is weak, and the jump amplification factor is insignificant, the redundancy is assessed as high, indicating that the first-order difference sequence still has considerable compression potential. When any one or more of the three factors significantly increase, the redundancy is assessed as low or in the middle range, indicating that the first-order difference sequence has structural perturbations that are unfavorable to compression and needs to be further optimized through adaptive second-order difference coding, thereby providing a quantitative basis for the selection of subsequent coding methods.
[0056] In one possible implementation, step S103 further includes: calculating a continuity loss value based on continuity disruption factors to characterize the degree of repeatability reduction of the difference sequence; calculating a fluctuation diffusion value based on fluctuation enhancement factors to characterize the level of local discrete diffusion of the difference sequence; calculating a jump deviation value based on jump amplification factors to characterize the intensity of instantaneous abnormal deviation of the difference sequence; and calculating redundancy based on the continuity loss value, fluctuation diffusion value, and jump deviation value.
[0057] Specifically, regarding continuity, assuming that the continuity disruption sequence for each sliding window has been obtained through window-level analysis, denoted as ,in For window index, the value range is , The number of sliding windows, Used to characterize the The degree to which the continuity of adjacent difference values within a window is disrupted; a larger value indicates a worse continuity. Based on this, the factors disrupting continuity can be summarized into an overall continuity loss value, for example, defined as the weighted average of the continuity disruption degrees across all windows:
[0058]
[0059] in, This is the continuity loss value, used to characterize the overall degree of degradation in continuity of the entire first-order difference sequence; In order to be with the first The weight coefficients corresponding to each window range from [value range missing]. The inner part is used to reflect the importance of different windows in the continuity assessment; each weight satisfies Thus ensuring This is a global metric based on weighted average. This form allows for assigning higher weights to specific time periods (such as high-load intervals or intervals before and after a failure) according to actual needs, making the continuity loss value more focused on critical operating conditions.
[0060] Regarding volatility, assuming that the volatility diffusion sequence for each sliding window has been obtained through window-level volatility analysis, denoted as […]. ,in Used to characterize the The difference values within a window represent the discrete diffusion level within a local range; a larger value indicates more severe local fluctuations. To obtain the global fluctuation diffusion value, a similar weighted aggregation method can be used:
[0061]
[0062] Among them, This is the fluctuation diffusion value, used to comprehensively reflect the local fluctuation intensity of the first-order difference sequence across all windows; In order to be with the first The fluctuation weight coefficient corresponding to each window ranges from [value range missing]. Within, each weight satisfies In actual settings, windows corresponding to normal operating conditions can be assigned lower weights, while windows corresponding to complex operating conditions, turning, acceleration, deceleration, etc., can be assigned higher weights, making the fluctuation diffusion value more sensitive to changes in these ranges.
[0063] Regarding the jump, assuming that the jump amplification sequence has been calculated for each window based on the reference difference interval, denoted as ,in Used to characterize the The magnitude of the instantaneous abrupt deviation of the difference value within a window relative to the reference difference interval; a larger value indicates a more significant jump behavior within that window. To characterize jump features at a global level, these window-level jump measures can be aggregated into jump deviation values, for example, using a weighted average:
[0064]
[0065] in, This is the jump deviation value, used to characterize the intensity of abnormal jumps in the entire first-order difference sequence; In order to be with the first The jump weight coefficient corresponding to each window ranges from [value range missing]. Inside, satisfy In scenarios that are particularly sensitive to sudden changes, some windows can be assigned a higher change weight, thereby... It further highlights the impact of abnormal moments.
[0066] To ensure that continuous loss, fluctuation diffusion, and abrupt deviation values can all be included in redundancy calculations, they can be further normalized or mapped to fall within a unified numerical range. For example, an upper limit reference value can be set for each type of indicator based on historical statistical results or engineering experience. , , And construct the corresponding normalized perturbation intensity index:
[0067]
[0068]
[0069] in, , , These represent the normalized continuity loss intensity, fluctuation diffusion intensity, and jump deviation intensity, respectively, with their numerical ranges limited to [values not specified in the original text]. Within this context, when the original indicator exceeds the corresponding upper limit reference value, it is truncated to 1 to avoid the unreasonable amplification of the overall redundancy by extreme values. The upper limit reference value can be obtained by selecting the empirical maximum value or high quantile from a large number of historical samples, or it can be obtained through offline calibration.
[0070] In constructing redundancy, since the redundancy of differential compression should be inversely related to the perturbation intensity (i.e., the better the continuity, the weaker the fluctuation, and the fewer the jumps, the higher the redundancy), the normalized perturbation intensity can first be converted into the corresponding "residual orderliness" index. For example, the continuity orderliness, fluctuation orderliness, and jump orderliness can be defined as follows:
[0071]
[0072]
[0073] in, It is used to indicate the degree of order of the remainder of the difference sequence in the continuity dimension. The closer the value is to 1, the better the continuity. Used to represent the stationarity of a sequence in the fluctuation dimension; the closer the value is to 1, the weaker the local fluctuation. These values represent the stability of a sequence under the jump dimension; the closer the value is to 1, the fewer anomalous jumps there are. The range of values for all three is [missing information]. Furthermore, it exhibits a monotonically inverse relationship with the corresponding disturbance index.
[0074] After considering the above-mentioned orderliness, the first-order differential redundancy can be calculated using a weighted method as follows:
[0075] in, The redundancy corresponding to the first-order difference sequence is used to comprehensively reflect the overall compression potential of the sequence in three dimensions: difference continuity, local stationarity, and jump stability. , , These are the weighting coefficients for continuity, orderliness, and jump orderliness in redundancy calculation, with values ranging from... Inside, usually meets This ensures that the redundancy itself remains within a preset value range. By adjusting these three weights, a higher weight can be assigned to a certain type of feature for different vehicle-to-everything (V2X) application scenarios. For example, in high-speed cruising scenarios, more emphasis is placed on continuity and fluctuation stability, while in urban congestion scenarios with frequently changing operating conditions, more attention is paid to the ability to describe jumps.
[0076] Through the above algorithm, the continuity-breaking factors, fluctuation-enhancing factors, and jump-amplifying factors are gradually mapped to continuity loss values, fluctuation diffusion values, and jump deviation values. Then, the normalized perturbation intensity and the corresponding orderliness index are constructed. Finally, the first-order differential redundancy is obtained to guide the subsequent second-order differential coding decision. This makes the redundancy not only reflect the numerical range and repeatability of the sequence, but also comprehensively reflect the overall characteristics of the differential sequence in terms of structural stability and abnormal changes.
[0077] Step S104: Determine whether the redundancy is greater than the preset redundancy threshold.
[0078] Specifically, the preset redundancy threshold can be achieved by statistically analyzing the differential structure of historical vehicle network reported data, empirically calibrating it by the compression effect of samples under different operating conditions, or dynamically setting it through an online adaptive adjustment strategy. The specific method for determining the preset redundancy threshold can be flexibly adjusted according to different vehicle models, different reporting frequencies, or different business scenarios. This application embodiment does not limit the setting method of this threshold.
[0079] Step S105: If it is confirmed that the redundancy is greater than the preset redundancy threshold, then perform second-order differential encoding on the first-order differential sequence based on the differential perturbation factor to obtain the second-order differential sequence.
[0080] Specifically, when the redundancy of a first-order difference sequence exceeds a preset redundancy threshold, it indicates that the sequence still has significant compression potential in terms of continuity, volatility, or jump characteristics. At this point, by utilizing the degree of continuity weakening, volatility enhancement, and jump amplification reflected in the difference perturbation factors, multi-dimensional feature mapping and difference reconstruction are performed on the first-order difference sequence at the overall temporal structure level, thereby forming a second-order difference sequence that can further reduce numerical span and local volatility. Through the above encoding method, deeper difference contraction of numerical data can be achieved while maintaining reversibility, effectively reducing the overall redundancy of the sequence.
[0081] When the redundancy is less than or equal to the preset redundancy threshold, the numerical data is processed by adjacent time-to-time numerical difference in the same way as the first-order difference to form a second-order difference result limited to the local range of change. This allows the numerical data to still be processed by the same difference method as the first-order difference even if the first-order difference fails to trigger adaptive second-order difference coding.
[0082] In one possible implementation, step S105 further includes: constructing a three-dimensional perturbation vector based on continuity loss value, fluctuation diffusion value, and jump deviation value; performing perturbation distribution mapping on the three-dimensional perturbation vector based on feature projection operator, and obtaining the perturbation projection value corresponding to each vector; calculating the distance values between the perturbation projection value and multiple perturbation cluster centers in a preset perturbation clustering space, and obtaining the target perturbation cluster center corresponding to the minimum distance value; determining the corresponding second-order difference coding mode based on the target perturbation cluster center, wherein the second-order difference coding mode includes a linear second-order difference mode that enhances continuity, a smooth second-order difference mode that suppresses local discrepancies, and a robust second-order difference mode that maintains jump sensitivity; and performing second-order difference coding on the first-order difference sequence based on the second-order difference coding mode to obtain a second-order difference sequence.
[0083] Specifically, when constructing a three-dimensional perturbation vector based on the continuity loss value, fluctuation diffusion value, and jump deviation value, these three indicators used to characterize the perturbation strength of the first-order difference sequence can be organized into a column vector form, denoted as:
[0084] in, It is a three-dimensional perturbation vector used to represent the comprehensive perturbation state of a first-order difference sequence in three dimensions: continuity, volatility, and jump in a unified vector space. The continuity loss value is a real number used to characterize the degree of decrease in the overall continuity of the difference sequence. Its value can be obtained by weighted combination of the continuity destruction degree of each sliding window. is the fluctuation diffusion value, which is a real number used to characterize the discrete diffusion level of the difference sequence at the local scale. Its value comes from the weighted aggregation of fluctuation indices of each window. The jump deviation value is a real number used to characterize the instantaneous abnormal deviation intensity between the difference sequence and the reference difference partition. Its value is obtained by weighting and summing the jump amplification of each window. By combining the three scalar indices into a three-dimensional vector, the difference perturbation state can be handled with a unified geometric object in subsequent feature projection and cluster space analysis.
[0085] When performing perturbation distribution mapping on a 3D perturbation vector based on the feature projection operator, the feature projection operator can be represented as a linear projection matrix. Through matrix transformation, the 3D perturbation vector is mapped to the feature space, denoted as:
[0086] in, is the perturbation projection value vector, and is a column vector used to represent the projection coordinates of the 3D perturbation vector in the feature space; For feature projection operators, used to define the mapping relationship from the original perturbation space to the feature space; The characteristic projection matrix can be... The real matrix, whose elements can be obtained through offline training, principal component analysis or expert experience, is used to emphasize the direction of perturbation combinations that are more sensitive in second-order difference coding decisions; The aforementioned three-dimensional perturbation vector. Through this projection operation, the original perturbation index can be transformed into a distribution on a specific feature axis, allowing different types of perturbation patterns to form discriminative clustering regions in the feature space, thereby facilitating subsequent clustering and encoding pattern selection.
[0087] When calculating the distances between the perturbation projection value and multiple perturbation cluster centers within a pre-defined perturbation clustering space, the perturbation cluster center vector can first be defined in the feature space, denoted as:
[0088] in, For the first Cluster center vectors corresponding to perturbation patterns The range of values is These can be used to represent continuous-dominant disturbances, wave-dominant disturbances, and jump-dominant disturbances, respectively. , , The components of the cluster center on the three coordinate axes of the feature space can be numerically obtained by performing unsupervised clustering on a large number of historical perturbation samples (e.g., The perturbation projection vector obtained through the mean algorithm or manual calibration can be used. For a given first-order difference sequence, the perturbation projection vector obtained by feature projection is denoted as... The distance between it and each cluster center can be measured using Euclidean distance:
[0089]
[0090] in, Perturbation projection vector With the Cluster centers The distance value between them is a non-negative real number, used to characterize the degree of proximity between the current disturbance state and the central pattern of this disturbance type; , , These represent the components of the perturbation projection vector in the three coordinate directions of the feature space, corresponding to the expression intensity of different perturbation combinations after feature projection. By analyzing all... of By comparing the results, we can obtain the index of the target cluster center with the smallest distance:
[0091]
[0092] in, The index serves as the cluster center for the target perturbation, indicating the closest perturbation pattern category in the feature space for the current first-order difference sequence. This index, combined with a predefined "perturbation pattern – encoding pattern" mapping, can be used to automatically identify the second-order difference encoding pattern type.
[0093] When determining the corresponding second-order differential coding pattern based on the target perturbation cluster center, it can be It corresponds one-to-one with a specific encoding pattern, for example when When dealing with cluster centers dominated by continuity, a linear second-order difference model that enhances continuity is selected; when When dealing with fluctuation-dominated cluster centers, a smooth second-order difference mode that suppresses local discrepancies is selected; when When dealing with cluster centers dominated by jumps, a robust second-order difference pattern that maintains jump sensitivity is selected. In the specific encoding process, the first-order difference sequence can be denoted as... ,in This represents the index of the differenced samples. For linear second-order difference patterns, standard second-order difference operations can be performed on numerical difference data.
[0094]
[0095] in, This is a linear second-order difference result, used to further compress the dynamic range of the difference values in scenarios with strong continuity, effectively weakening slowly changing trend components. For smoothed second-order difference patterns, local smoothing can first be performed on the first-order difference sequence to construct a smoothed difference sequence:
[0096]
[0097] Then perform a linear second-order difference on the smoothed sequence:
[0098] in, The smoothed first-order difference value. The smoothing weighting coefficient has a value range of [value range missing]. Between, used to perform a weighted balance between the original difference value and the mean of the nearest differences, when When the difference is large, the detailed features of the original difference are preserved. When the size is small, the smoothing effect is enhanced, which helps to reduce local high-frequency noise; The second-order differencing result, calculated on a smoothed basis, is applicable to sequences with prominent volatility enhancement factors. For robust second-order differencing models, the first-order differencing sequence can be truncated using a threshold, thus constructing a robust differencing sequence:
[0099]
[0100] Again Perform linear second-order difference:
[0101] in, The first-order difference value after robust processing is obtained through the function. Limit excessively large positive or negative jumps. Within the range; The jump threshold parameter is a positive real number used to control the degree to which robust processing suppresses anomalous jumps. When the value is large, outlier suppression is weaker. When the value is small, it has a stronger suppression effect on outliers; For robust second-order difference results, it is suitable for use in scenarios where jump amplification factors are significant, maintaining sensitivity to moderate jumps while providing some suppression of extreme anomalies.
[0102] After completing the above encoding mode selection and specific second-order difference operation, the numerical data in the first-order difference sequence is mapped to a second-order difference sequence that adaptively matches the perturbation mode, while the string data can be recorded at its corresponding position in a zero-difference or label-preserving manner. Thus, under different perturbation modes, a better compression effect can be obtained through feature projection and clustering-driven adaptive encoding strategies, and a structured encoding output can be provided for subsequent dynamic dictionary replacement and cloud decoding restoration.
[0103] Step S106: Replace the target string in the second-order difference sequence with dictionary indexes using a dynamic dictionary.
[0104] Specifically, when using a dynamic dictionary to replace the target string in the second-order difference sequence with a dictionary index, the second-order difference sequence is parsed item by item to identify the status string and fault code string that appear in it. After the target string is identified, the dictionary index corresponding to the string is determined according to the current dictionary item set of the dynamic dictionary. This transforms the expression of the target string in the compressed sequence from the original text form to a shorter index form, thereby reducing the storage length of the string field and improving the overall compression efficiency.
[0105] In one possible implementation, step S106 further includes: obtaining the status string and fault code string in the second-order difference sequence as the target string; performing dictionary matching on the target string in combination with the real-time update rules of the dynamic dictionary, and replacing the target string with the dictionary index.
[0106] Specifically, when traversing the second-order difference sequence, during the parsing of each coding unit, the status strings and fault code strings appearing in the form of fields are identified and treated as target strings. For the set of commonly used status strings that have been pre-set in the system initialization stage or during operation, such as "driving" and "stopping", they are written into a dynamic dictionary according to predefined rules. A unique dictionary index value is assigned to each different string. For example, an enumerated dictionary structure of the form {0: "driving", 1: "stopping"} is constructed so that only the index needs to be recorded in the subsequent coding stage to complete the representation of the string semantics.
[0107] When performing dictionary matching, when a target string is parsed from the second-order difference sequence, the dynamic dictionary is first searched to see if there is a dictionary entry that is completely consistent with the content of the target string. If a match is found, the index value corresponding to the dictionary entry is obtained, and the strings such as "driving" and "stopping" that originally appeared in text form are replaced with the corresponding index. For example, "driving" is replaced with index 0, and "stopping" is replaced with index 1. Only the index value is stored in the compressed output, thereby significantly shortening the length of the string in the encoded result. If no match is found, a new index is assigned to the newly appearing target string according to the real-time update rules of the dynamic dictionary. Contents such as "new status" and "new fault code" are appended to the dynamic dictionary, and the new index is written to the current encoding position to ensure that the original string can be correctly recovered from the dynamic dictionary during subsequent decoding.
[0108] In the above process, the encoding results related to numerical changes in the second-order difference sequence are still retained according to the differential encoding method, while only the status string and fault code string are indexed and replaced. This allows numerical information to reduce numerical redundancy through differential compression, and string information to reduce symbol redundancy through dynamic dictionary. The two work together in the same sequence to improve the overall compression efficiency of vehicle network time series data without compromising the restoration accuracy.
[0109] Step S107: Compress and encapsulate the second-order difference sequence and dictionary index, and upload them to the vehicle network cloud.
[0110] Specifically, after completing the second-order differential encoding and dictionary index replacement of the target string, the second-order differential results corresponding to the numerical data and the dictionary indices corresponding to the string data are arranged in chronological order. Each record carries necessary restoration auxiliary information, such as initial reference values for restoring the original timestamp and mileage, an identifier field indicating the differential order and encoding mode, and a dynamic dictionary version number or dictionary snapshot identifier indicating the currently used dictionary. The above content is encapsulated into one or more compressed data packets conforming to a preset protocol format, so that each packet contains both the numerical field of the second-order differential sequence and the symbol field of the dictionary index sequence, thus forming a complete differential and dictionary hybrid compression result. After encapsulation, the encapsulated compressed data is uploaded to the data access service of the vehicle network cloud through the cellular network or dedicated vehicle network communication link accessed by the vehicle terminal, so that the compressed data can be centrally parsed and restored on the cloud side.
[0111] In the subsequent decompression process, the vehicle-to-everything (V2X) cloud first performs protocol parsing on the received compressed data packets. Based on the packet header and control fields, it identifies the currently used differential coding mode, differential order, and corresponding dynamic dictionary version. It then separates the second-order difference sequence and dictionary index sequence from the packet body, and extracts auxiliary information such as the initial reference values for each record. In the numerical data restoration stage, the cloud, based on the initial timestamp and initial mileage carried in the packet, accumulates and restores the second-order difference results in the reverse order of the encoding stage. First, it performs a second-order inverse difference operation on the second-order difference sequence to restore it to a first-order difference sequence, and then performs a second-order inverse difference operation on the first-order difference sequence. The difference sequence is summed once to restore the original numerical sequence, thereby reconstructing continuous timestamp data and mileage data. In the string data restoration stage, the cloud reconstructs the dictionary content at the corresponding time based on the current version of the dynamic dictionary or a dictionary snapshot carried in the message. Each index value in the dictionary index sequence is mapped back to its corresponding status string or fault code string; for example, index 0 is restored to "driving" and index 1 to "stopped." The restored strings are then inserted into the record positions corresponding to the numerical data in chronological order, ensuring that the restored data frame again contains complete fields such as timestamp, mileage, speed, and status. Please refer to [reference needed]. Figure 2 The present application provides a schematic diagram illustrating the relationship between differential compression of vehicle network time-series data and dictionary index mapping. Figure 2 This diagram illustrates the overall process of raw vehicle-to-everything (V2X) time-series data undergoing differential processing, dictionary index replacement, and decompression. The diagram first shows the original data structure, including fields such as timestamp, mileage, and status. It then shows the compressed data structure formed after differential encoding, where numeric fields are converted into differential values related to the previous record, and string fields are replaced with corresponding dictionary indices, significantly reducing the storage footprint of each record. The diagram also shows the storage savings achieved by comparing the original and compressed data sizes. Furthermore, the diagram illustrates the differential restoration process, where the original timestamp and mileage are restored by successively accumulating differential values, and the original string status is restored using dictionary indices, ensuring that the decompressed data maintains the same structure as before reporting. This diagram comprehensively demonstrates the complete chain of the proposed method from raw data to differential compression and decompression, showcasing the advantages of the hybrid compression scheme in reducing data volume while maintaining reversibility.
[0112] Please refer to Figure 3 This illustration shows a schematic diagram of a differential and dictionary hybrid compression device for vehicle network time-series data provided in an embodiment of this application. The device includes an acquisition module 31 and a processing module 32, wherein... The acquisition module 31 is used to acquire the original data corresponding to the target vehicle in the Internet of Vehicles; to perform first-order differential encoding on the original data to obtain a first-order differential sequence; to obtain the differential perturbation factors corresponding to the first-order differential sequence through an adaptive time-series structure analysis model, and to calculate the redundancy corresponding to the first-order differential sequence based on the differential perturbation factors.
[0113] Processing module 32 is used to determine whether the redundancy is greater than the preset redundancy threshold. If it is confirmed that the redundancy is greater than the preset redundancy threshold, second-order differential encoding is performed on the first-order differential sequence based on the differential perturbation factor to obtain the second-order differential sequence. The target string in the second-order differential sequence is replaced by the dictionary index through the dynamic dictionary. The second-order differential sequence and the dictionary index are compressed and encapsulated, and uploaded to the vehicle network cloud.
[0114] In one possible implementation, the acquisition module 31 is used to acquire the original data corresponding to the target vehicle in the vehicle network, specifically including: acquiring the original data through the time-series acquisition operation of the vehicle communication link, and identifying the data type corresponding to the original data. The original data includes timestamp data, mileage data and vehicle speed data, and the data types include numeric and string types.
[0115] In one possible implementation, the acquisition module 31 is used to perform first-order difference encoding on the original data to obtain a first-order difference sequence, specifically including: performing adjacent time-time numerical difference processing on the numerical data in the original data, calculating the difference between the current value and the previous time-time value of the numerical data through adjacent sampling points, and constructing a first-order difference sequence to represent the magnitude of numerical change; performing string preservation processing on the string data in the original data, and writing the string data as a zero-difference identifier into the first-order difference sequence.
[0116] In one possible implementation, the acquisition module 31 is used to acquire the corresponding difference perturbation factors in the first-order difference sequence through an adaptive time-series structure analytical model. Specifically, this includes: performing local correlation measurement, sliding window fluctuation detection, and abrupt deviation judgment operations on the first-order difference sequence through the adaptive time-series structure analytical model, and constructing a difference change relationship pattern between adjacent difference values based on the operation results. The difference change relationship pattern includes a continuity disruption pattern to characterize the degree of difference continuity disruption, a fluctuation enhancement pattern to characterize the degree of local fluctuation enhancement, and a jump amplification pattern to characterize the instantaneous deviation amplitude of the difference. Based on the difference change relationship pattern, the corresponding difference perturbation factors are extracted from the first-order difference sequence. The difference perturbation factors include continuity disruption factors, fluctuation enhancement factors, and jump amplification factors.
[0117] In one possible implementation, the acquisition module 31 is used to calculate the redundancy corresponding to the first-order difference sequence based on the difference perturbation factor, specifically including: calculating the continuity loss value based on the continuity disruption factor to characterize the degree of repeatability reduction of the difference sequence; calculating the fluctuation diffusion value based on the fluctuation enhancement factor to characterize the local discrete diffusion level of the difference sequence; calculating the jump deviation value based on the jump amplification factor to characterize the instantaneous abnormal deviation intensity of the difference sequence; and calculating the redundancy based on the continuity loss value, the fluctuation diffusion value, and the jump deviation value.
[0118] In one possible implementation, the processing module 32 is used to perform second-order difference encoding on the first-order difference sequence based on the difference perturbation factor to obtain a second-order difference sequence. Specifically, this includes: constructing a three-dimensional perturbation vector based on continuity loss value, fluctuation diffusion value, and jump deviation value; performing perturbation distribution mapping on the three-dimensional perturbation vector based on the feature projection operator, and obtaining the perturbation projection value corresponding to each vector; calculating the distance values between the perturbation projection value and multiple perturbation cluster centers in a preset perturbation clustering space, and obtaining the target perturbation cluster center corresponding to the minimum distance value; determining the corresponding second-order difference encoding mode based on the target perturbation cluster center, wherein the second-order difference encoding mode includes a linear second-order difference mode that enhances continuity, a smooth second-order difference mode that suppresses local discrepancies, and a robust second-order difference mode that maintains jump sensitivity; and performing second-order difference encoding on the first-order difference sequence based on the second-order difference encoding mode to obtain a second-order difference sequence.
[0119] In one possible implementation, the processing module 32 is used to replace the target string in the second-order difference sequence with a dictionary index using a dynamic dictionary. Specifically, this includes: obtaining the status string and fault code string in the second-order difference sequence as the target string; performing dictionary matching on the target string in combination with the real-time update rules of the dynamic dictionary; and replacing the target string with the dictionary index.
[0120] It should be noted that the above embodiments of the apparatus are only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.
[0121] This application also provides an electronic device. (See reference...) Figure 4 , Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device may include: at least one processor 401, at least one communication bus 402, a user interface 403, at least one network interface 404, and a memory 405.
[0122] The communication bus 402 is used to enable communication between these components.
[0123] The user interface 403 may include a display screen and a camera. Optionally, the user interface 403 may also include a standard wired interface and a wireless interface.
[0124] The network interface 404 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface).
[0125] The processor 401 may include one or more processing cores. The processor 401 connects to various parts of the server using various interfaces and lines, and performs various server functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in memory 405, and by calling data stored in memory 405. Optionally, the processor 401 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor 401 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content required for display; and the modem handles wireless communication. It is understood that the modem may also be implemented as a separate chip without being integrated into the processor 401.
[0126] The memory 405 may include random access memory (RAM) or read-only memory. Optionally, the memory 405 may include a non-transitory computer-readable storage medium. The memory 405 may be used to store instructions, programs, code, code sets, or instruction sets. The memory 405 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the above-described method embodiments, etc.; the data storage area may store data involved in the above-described method embodiments, etc. Optionally, the memory 405 may also be at least one storage device located remotely from the aforementioned processor 401. (Refer to...) Figure 4 The memory 405, which serves as a computer storage medium, may include an operating system, a network communication module, a user interface module, and a differential and dictionary hybrid compression application for vehicle network timing data.
[0127] exist Figure 4 In the illustrated electronic device, the user interface 403 is primarily used to provide an input interface for the user and acquire user input data; while the processor 401 can be used to call the differential and dictionary hybrid compression application stored in the memory 405 for vehicle network timing data. When executed by one or more processors 401, the electronic device performs one or more of the methods described in the above embodiments. It should be noted that, for the foregoing method embodiments, for the sake of simplicity, they are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, because according to this application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0128] This application also provides a computer-readable storage medium storing instructions. When executed by one or more processors, these instructions cause an electronic device to perform one or more of the methods described in the above embodiments.
[0129] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.
[0130] In the various embodiments provided in this application, it should be understood that the disclosed apparatus can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some service interface; the indirect coupling or communication connection between apparatuses or units may be electrical or other forms.
[0131] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0132] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0133] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned memory includes various media capable of storing program code, such as USB flash drives, portable hard drives, magnetic disks, or optical disks.
[0134] The above description is merely an exemplary embodiment disclosed in this application and should not be construed as limiting the scope of this application. Any equivalent changes and modifications made in accordance with the teachings of this application shall still fall within the scope of this application.
[0135] This application is intended to cover any variations, uses, or adaptations disclosed herein that follow the general principles disclosed herein and include common knowledge or customary technical means in the art that are not described in this application.
Claims
1. A method for differential and dictionary-based hybrid compression of time-series data in the Internet of Vehicles (IoV), characterized in that, The method includes: Obtain the raw data corresponding to the target vehicle in the Internet of Vehicles (IoV); The original data is subjected to first-order differential encoding to obtain a first-order differential sequence; The differential perturbation factors in the first-order difference sequence are obtained through an adaptive time-series structure analytical model, and the redundancy of the first-order difference sequence is calculated based on the differential perturbation factors. Determine whether the redundancy is greater than a preset redundancy threshold; If it is confirmed that the redundancy is greater than the preset redundancy threshold, then second-order differential encoding is performed on the first-order differential sequence based on the differential perturbation factor to obtain a second-order differential sequence. The target string in the second-order difference sequence is replaced by a dictionary index using a dynamic dictionary; The second-order difference sequence and the dictionary index are compressed and encapsulated, and then uploaded to the vehicle network cloud.
2. The method according to claim 1, characterized in that, The acquisition of the raw data corresponding to the target vehicle in the Internet of Vehicles specifically includes: The raw data is acquired through timing acquisition operations of the vehicle communication link, and the data type corresponding to the raw data is identified. The raw data includes timestamp data, mileage data, and vehicle speed data, and the data types include numeric and string types.
3. The method according to claim 2, characterized in that, The original data is subjected to first-order difference encoding to obtain a first-order difference sequence, specifically including: The numerical data in the original data is subjected to adjacent time-time numerical difference processing. The difference between the current value and the previous value of the numerical data is calculated by using adjacent sampling points, and the first-order difference sequence is constructed to represent the magnitude of numerical change. Perform string preservation processing on the string-type data in the original data, and write the string-type data as a zero-difference identifier into the first-order difference sequence.
4. The method according to claim 1, characterized in that, The step of obtaining the difference perturbation factors in the first-order difference sequence through an adaptive time-series structure analytical model specifically includes: The first-order difference sequence is subjected to local correlation measurement, sliding window fluctuation detection and abrupt deviation judgment operations through an adaptive time-series structure analytical model. Based on the operation results, a difference change relationship pattern between adjacent difference values is constructed. The difference change relationship pattern includes a continuity disruption pattern to characterize the degree of difference continuity disruption, a fluctuation enhancement pattern to characterize the degree of local fluctuation enhancement, and a jump amplification pattern to characterize the instantaneous deviation amplitude of the difference. Based on the differential change relationship pattern, the corresponding differential perturbation factors are extracted from the first-order differential sequence. The differential perturbation factors include continuity disruption factors, fluctuation enhancement factors, and jump amplification factors.
5. The method according to claim 4, characterized in that, The calculation of the redundancy corresponding to the first-order difference sequence based on the differential perturbation factor specifically includes: Based on the aforementioned continuity-damping factors, a continuity loss value is calculated to characterize the degree of decrease in repeatability of the difference sequence; Based on the aforementioned fluctuation enhancement factor, a fluctuation diffusion value is calculated to characterize the local discrete diffusion level of the difference sequence; The jump deviation value used to characterize the instantaneous abnormal deviation intensity of the differential sequence is calculated based on the jump amplification factor. The redundancy is calculated based on the continuity loss value, the fluctuation diffusion value, and the jump deviation value.
6. The method according to claim 5, characterized in that, The step of performing second-order difference encoding on the first-order difference sequence based on the difference perturbation factor to obtain a second-order difference sequence specifically includes: A three-dimensional perturbation vector is constructed based on the continuity loss value, the fluctuation diffusion value, and the jump deviation value; Based on the feature projection operator, a perturbation distribution mapping is performed on the three-dimensional perturbation vector, and the perturbation projection value corresponding to each vector is obtained; Within a preset perturbation clustering space, calculate the distance between the perturbation projection value and multiple perturbation clustering centers, and obtain the target perturbation clustering center corresponding to the smallest distance value; Based on the target perturbation cluster center, the corresponding second-order difference coding mode is determined. The second-order difference coding mode includes a linear second-order difference mode that enhances continuity, a smooth second-order difference mode that suppresses local discrepancies, and a robust second-order difference mode that maintains jump sensitivity. The first-order difference sequence is subjected to second-order difference encoding based on the second-order difference encoding mode to obtain a second-order difference sequence.
7. The method according to claim 1, characterized in that, The step of replacing the target string in the second-order difference sequence using a dictionary index via a dynamic dictionary specifically includes: Obtain the status string and fault code string from the second-order difference sequence as the target string; The target string is matched using the real-time update rules of the dynamic dictionary, and the target string is replaced with the dictionary index.
8. A differential and dictionary hybrid compression device for vehicle network time-series data, characterized in that, The device includes an acquisition module and a processing module, wherein, The acquisition module is used to acquire the original data corresponding to the target vehicle in the Internet of Vehicles; perform first-order differential encoding on the original data to obtain a first-order differential sequence; obtain the differential perturbation factor corresponding to the first-order differential sequence through an adaptive time-series structure analysis model, and calculate the redundancy corresponding to the first-order differential sequence based on the differential perturbation factor. The processing module is used to determine whether the redundancy is greater than a preset redundancy threshold; if it is confirmed that the redundancy is greater than the preset redundancy threshold, then it performs second-order differential encoding on the first-order differential sequence based on the differential perturbation factor to obtain a second-order differential sequence; it uses a dictionary index to replace the target string in the second-order differential sequence through a dynamic dictionary; it compresses and encapsulates the second-order differential sequence and the dictionary index, and uploads them to the vehicle network cloud.
9. An electronic device, characterized in that, The device includes a processor, a communication bus, a user interface, a network interface, and a memory. The memory is used to store instructions. The user interface and the network interface are used to communicate with other devices. The processor is used to execute the instructions stored in the memory to cause the electronic device to perform the method as described in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed, perform the method as described in any one of claims 1 to 7.
Citation Information
Cited By
Commercial vehicle fleet cooperative communication data intelligent compression method
CN122205515A
