A data synchronization method and system for a communication software

Abstract

The present invention relates to the technical field of data synchronization, and specifically to a data synchronization method and system for a communication software, including the following steps: statistically analyzing the network bandwidth utilization rate, user synchronization request frequency, and synchronization request size of the communication software, calculating the transmission demand of each data partition, comparing the current load of the differential partition with the network transmission capacity, adjusting the transmission range and partition boundary of the data partition, and generating a dynamic partition transmission range value. In the present invention, by comprehensively calculating the network bandwidth utilization rate, user request frequency, and request size, the partition transmission range and boundary are dynamically adjusted, network resource allocation is optimized, the impact of high-load partitions on the overall transmission capacity is reduced, data items within the partition are classified and processed based on the update frequency and access mode, combined with conflict frequency statistics and sorting, high-conflict data items are preferentially resolved, the synchronization delay amount is evaluated and threshold judged, key data is preferentially transmitted, and the timeliness and consistency of highly sensitive data are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of data synchronization, and particularly to a data synchronization method and system for a communication software. Background Art

[0002] Data synchronization technology involves maintaining the consistency and accuracy of data between multiple computing devices or storage locations. It is commonly used in various environments such as servers, personal computers, and mobile devices to ensure that data can be updated in real-time or periodically at multiple locations. Data synchronization technology supports multiple synchronization modes, including real-time synchronization, scheduled synchronization, and manually triggered synchronization, to adapt to different application scenarios and network conditions. It also involves the handling of issues such as conflict management, data integrity verification, and optimization of data transmission efficiency. The main applications include cloud storage services, distributed database management, enterprise data backup solutions, and data management and backup for mobile devices.

[0003] Among them, the data synchronization method for communication software refers to the technical means of synchronizing communication data (such as messages, contact information, session history, etc.) between multiple devices or systems. Its main purpose is to ensure that users can obtain a consistent communication experience when using communication software on different devices. For example, messages sent by users on mobile phones can be displayed in real-time on computers or tablets, and vice versa, which not only improves the convenience of user operations but also ensures the timeliness and accuracy of information. In addition, when users change devices, historical communication data can be quickly restored, reducing the risk of data loss.

[0004] In the prior art, in terms of data partition adjustment, there is a lack of the ability to dynamically allocate resources based on the real-time network status, which easily leads to high-load partitions occupying too much bandwidth resources and affecting the synchronization efficiency of other partitions. The conflict management method is mostly predefined rules, and it is difficult to accurately identify potential conflict risks for high-frequency updated data, resulting in data items with a high conflict frequency not being given priority processing, prolonging the synchronization delay time. In terms of path management, there is a lack of a dynamic monitoring mechanism for multi-path performance, and usually relies on single-path transmission. When the path performance fluctuates or is interrupted, it is easy to cause data synchronization interruption or reduced efficiency. In the execution of real-time tasks, the lag of the path switching mechanism may lead to a long interruption time of the synchronization task, especially in scenarios with high-frequency synchronization or complex network conditions, making it difficult to meet the higher requirements for data consistency and transmission continuity. Summary of the Invention

[0005] The purpose of the present invention is to solve the deficiencies existing in the prior art and propose a data synchronization method for a communication software.

[0006] To achieve the above purpose, the present invention adopts the following technical solution: A data synchronization method for a communication software, comprising the following steps:

[0007] S1: Statistically analyze the network bandwidth utilization rate, user synchronization request frequency, and synchronization request size of the communication software, calculate the transmission requirements of each data partition, compare the current load of different partitions with the network transmission capacity, adjust the transmission range and partition boundaries of the data partition, and generate a dynamic partition transmission range value;

[0008] S2: Based on the dynamic partition transmission range value, classify the update frequency and access patterns of data items within the partition, sort the data items according to the conflict frequency, and generate a partition conflict frequency sorting result;

[0009] S3: According to the partition conflict frequency sorting result, calculate the synchronization delay amount caused by each data item group, determine whether the synchronization delay amount exceeds the set threshold, perform priority classification according to the judgment result, set the transmission priority of different data items, and set the processing order of the synchronization queue according to the priority to generate a synchronization priority allocation result;

[0010] S4: Based on the synchronization priority allocation result, monitor the transmission stability, bandwidth, and delay amount of each data synchronization path, compare the transmission performance indicators of each path, and allocate data to the optimal path according to the priority transmission order to generate a path transmission allocation plan;

[0011] S5: According to the path transmission allocation plan, monitor the real-time status of the transmission path. If a path interruption or performance degradation is detected, immediately switch to the backup path, and at the same time confirm that the synchronization task continues to execute to generate a path dynamic switching result.

[0012] As a further solution of the present invention, the steps for obtaining the dynamic partition transmission range value are as follows:

[0013] S111: Collect the network traffic data of the communication software, record the network bandwidth usage value, user synchronization request frequency, and synchronization request size, aggregate the data according to the time series, and generate a communication software network data set;

[0014] S112: Using the communication software network data set, combine the transmission capacity and partition boundary information of the data partition, statistically analyze the transmission requirements of the data partition, and generate a data partition load deviation ratio by comparing the current load of the partition with its network transmission capacity;

[0015] S113: Based on the data partition load deviation ratio, compare the transmission requirements and current transmission capacity of each partition, and use the formula:

[0016] ;

[0017] Calculate the average bandwidth usage deviation value of the partition , dynamically adjust the partition range and partition boundary, and output the dynamic partition transmission range value. Represents the total bandwidth Represents the actual transmission demand Represents the number of partitions

[0018] As a further solution of the present invention, the steps for obtaining the sorting result of the partition conflict frequency are as follows:

[0019] S211: According to the dynamic partition transmission range value, parse and extract the data items in the partition, record the update frequency and access behavior characteristics of each data item, count the access times, access source distribution and time interval characteristics of each data item, and generate the update frequency and access mode classification results of the data items in the partition;

[0020] S212: Based on the update frequency and access mode classification results of the data items in the partition, use the formula:

[0021] ;

[0022] Calculate the conflict frequency , and output the synchronization conflict occurrence frequency of each type of data item. Among them, Is the number of synchronization request conflicts Is the total number of synchronization requests;

[0023] S213: Use the synchronization conflict occurrence frequency of each type of data item to sort the data items from high to low according to the conflict frequency, make a corresponding association between the sorting result and the dynamic partition transmission range value, and combine the data item conflict frequency characteristics within each partition range to generate the partition conflict frequency sorting result.

[0024] As a further solution of the present invention, the steps for judging whether the synchronization delay amount exceeds the set threshold are as follows:

[0025] S311: According to the sorting result of the partition conflict frequency, collect the access logs of each data item group, parse the start time and completion time of the synchronization request, calculate the duration of each synchronization request, and perform cumulative processing on all synchronization durations within the same data item group to generate the total synchronization duration of each data item group;

[0026] S312: Based on the total synchronization duration of each data item group, count the number of synchronization requests for each group of data items, and use the formula:

[0027] ;

[0028] Calculate the average synchronization delay amount of the th data item group , and generate the average synchronization delay data of each data item group. Among them, Represents the The total synchronization duration of all synchronization requests within a data item group represents the number of synchronization requests for the th data item group, and

[0029] represents a correction amount inversely proportional to the number of requests; S313: Based on the average synchronization delay amount of each data item group, make a judgment in combination with a set threshold. By comparing the delay amount with the set threshold, classify and label the delay amount. Those exceeding the threshold are labeled as exceeded, otherwise labeled as not exceeded, and generate a delay judgment result.

[0030] As a further solution of the present invention, the steps for obtaining the synchronization priority allocation result are as follows:

[0031] S321: According to the delay judgment result, classify the delay status of each data item group. The data item groups labeled as exceeded are sorted in descending order of the delay amount, and the data item groups labeled as not exceeded are sorted in descending order of the number of synchronization requests, generating a list of data item groups after classification and sorting;

[0032] S322: According to the list of data item groups after classification and sorting, allocate transmission priorities to each data item group. The data item groups labeled as exceeded are sequentially allocated high priorities according to the principle of high priority for large delay amounts, and the data item groups labeled as not exceeded are sequentially allocated medium and low priorities according to the principle of high priority for large numbers of synchronization requests, generating a transmission priority setting result;

[0033] S323: Combining the transmission priority setting result, add the data item groups to the synchronization queue in order of priority, arrange the synchronization queue in the order from high priority to low priority, and queue the data item groups with the same priority in the order in the sorted list, generating a synchronization priority allocation result.

[0034] As a further solution of the present invention, the steps for obtaining the path transmission allocation scheme are as follows:

[0035] S411: Based on the synchronization priority allocation result, sequentially read the transmission priority and the corresponding transmission path of each data item, count the transmission stability fluctuation range, bandwidth utilization rate, and delay amount of each path, analyze the change trend of each parameter within the monitoring time period, and generate preliminary transmission performance data for each transmission path;

[0036] S412: According to the preliminary transmission performance data of each path, calculate the comprehensive performance of the path, using the formula:

[0037] ;

[0038] Calculate the comprehensive performance index of the path , sort according to the transmission priority information to obtain the sorted result of the path performance metrics, where is the average bandwidth utilization rate of the path, is the path packet loss rate, and are the maximum delay and minimum delay of the path respectively;

[0039] S413: Based on the sorted result of the path performance metrics, allocate data to the path with the optimal performance in the order of decreasing priority, and check one by one whether the path capacity of the allocation result meets the data requirements. For paths that exceed the capacity limit, reselect the sub-optimal path to allocate data, and generate a path transmission allocation plan.

[0040] As a further solution of the present invention, the steps for obtaining the path dynamic switching result are:

[0041] S511: According to the path transmission allocation plan, collect the real-time status monitoring data of all paths one by one, statistically calculate the data traffic fluctuation range and the change trend of the delay of each path according to time periods, calculate the packet loss rate cumulatively for each time period, and record the status change of each path in combination with the real-time monitoring data to generate a path real-time status monitoring result;

[0042] S512: Based on the path real-time status monitoring result, analyze the performance change trend of each path, compare one by one the deviation degree of the delay fluctuation range in the current time period from the historical average value, check whether the change of the packet loss rate exceeds the limit threshold, mark the paths with performance degradation, and identify the paths where the transmission task is interrupted. Correlate the marking result with the task status in the path transmission allocation plan to generate a path real-time status determination result;

[0043] S513: According to the path real-time status determination result, for the paths marked with performance degradation and interruption, select the path with the optimal current status from the standby paths to take over, reallocate the corresponding transmission data to the new path, record the status information before and after switching the path, and confirm the normal operation status of all synchronization tasks after the path switch to generate a path dynamic switching result.

[0044] A data synchronization system for a communication software, comprising:

[0045] The network traffic analysis module collects the network traffic data of the communication software, records the network bandwidth usage value, the user synchronization request frequency and the synchronization request size, combines the transmission capabilities of the data partitions and the partition boundary information, statistically calculates the transmission demand of the data partitions, calculates the partition average bandwidth usage deviation value, and outputs the dynamic partition transmission range value;

[0046] The partition conflict analysis module parses and extracts data items within a partition according to the dynamic partition transmission range value, calculates the conflict frequency, sorts the data items from high to low according to the conflict frequency, makes a corresponding association with the dynamic partition transmission range value, and generates a partition conflict frequency sorting result;

[0047] The synchronization priority allocation module parses the start time and completion time of the synchronization request according to the partition conflict frequency sorting result, calculates the average synchronization delay amount of the data item group, classifies and marks the delay amount in combination with a preset threshold, sorts the delay status of each data item group, synchronously assigns transmission priorities to each data item group, adds the data item groups to the synchronization queue in order of priority, and generates a synchronization priority allocation result;

[0048] The path performance allocation module, based on the synchronization priority allocation result, reads the transmission priority of each data item and the corresponding transmission path one by one, analyzes the change trend of each parameter during the monitoring time period, calculates the comprehensive performance index of the path, and allocates data to the path with the best performance in order from high to low priority, generating a path transmission allocation scheme;

[0049] The dynamic path switching module, according to the path transmission allocation scheme, monitors the status changes of each path in real time for data records, analyzes the performance change trend of each path, marks the paths with performance degradation, and identifies the paths where the transmission tasks are interrupted, reallocates the corresponding transmission data to new paths, and confirms the normal operation status of all synchronization tasks after path switching, generating a path dynamic switching result.

[0050] Compared with the prior art, the advantages and positive effects of the present invention are as follows:

[0051] In the present invention, by comprehensively calculating the network bandwidth utilization rate, user request frequency, and request size, the partition transmission range and boundary are dynamically adjusted, optimizing the network resource allocation, reducing the impact of high-load partitions on the overall transmission capacity. The data items within the partition are classified and processed based on the update frequency and access mode. Combining conflict frequency statistics and sorting, high-conflict data items are preferentially resolved, reducing synchronization delay. The synchronization delay amount is evaluated and threshold judged, and critical data is preferentially transmitted, improving the timeliness and consistency of highly sensitive data. The dynamic monitoring and optimal selection of multi-path transmission performance enhance the stability and transmission efficiency of data synchronization. The real-time monitoring and fast switching mechanism of path status ensure the continuity and reliability of synchronization tasks. The overall solution significantly improves the efficiency and adaptability of data synchronization through dynamic regulation and intelligent optimization. Brief Description of the Drawings

[0052] Figure 1 is the main step flowchart of the present invention;

[0053] Figure 2Flowchart for obtaining the dynamic partition transfer range value of the present invention;

[0054] Figure 3 Flowchart for obtaining the sorting result of partition conflict frequencies of the present invention;

[0055] Figure 4 Flowchart for determining whether the synchronization delay amount exceeds a set threshold of the present invention;

[0056] Figure 5 Flowchart for obtaining the synchronization priority allocation result of the present invention;

[0057] Figure 6 Flowchart for obtaining the path transfer allocation scheme of the present invention;

[0058] Figure 7 Flowchart for obtaining the dynamic path switching result of the present invention. Detailed implementation manners

[0059] In order to make the objectives, technical solutions and advantages of the present invention more clear and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0060] In the description of the present invention, it should be understood that the orientation or positional relationship indicated by the terms "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. are based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as limiting the present invention. In addition, in the description of the present invention, the meaning of "a plurality of" is two or more, unless otherwise specifically defined.

[0061] Please refer to Figure 1 , a data synchronization method for a communication software, including the following steps:

[0062] S1: Statistically analyze the network bandwidth utilization rate, user synchronization request frequency, and synchronization request size of the communication software, calculate the transfer demand of each data partition, compare the current load of different partitions with the network transfer capacity, adjust the transfer range and partition boundary of the data partition, and generate a dynamic partition transfer range value;

[0063] S2: Based on the dynamic partition transfer range value, classify the update frequency and access mode of data items within the partition, sort the data items according to the conflict frequency, and generate a sorting result of partition conflict frequencies;

[0064] S3: According to the sorting result of partition conflict frequencies, calculate the amount of synchronization delay caused by each data item group, determine whether the amount of synchronization delay exceeds the set threshold, perform priority classification according to the judgment result, set the transmission priority of the differential data items, and set the processing order of the synchronization queue according to the priority, so as to generate the synchronization priority allocation result;

[0065] S4: Based on the synchronization priority allocation result, monitor the transmission stability, bandwidth, and delay amount of each data synchronization path, compare the transmission performance indicators of each path, and allocate data to the optimal path according to the priority transmission order, so as to generate the path transmission allocation scheme;

[0066] S5: According to the path transmission allocation scheme, monitor the real-time state of the transmission path. When detecting path interruption and performance degradation, immediately switch to the backup path, and at the same time confirm that the synchronization task continues to execute, so as to generate the path dynamic switching result.

[0067] The dynamic partition transmission range value includes the partition boundary adjustment range, the in-partition transmission demand, and the partition transmission load ratio. The sorting result of partition conflict frequencies includes the data item update frequency sorting value, the data item access mode classification value, and the conflict frequency statistical result. The synchronization priority allocation result includes the data item priority classification result, the synchronization queue sorting rule, and the delay amount threshold comparison result. The path transmission allocation scheme includes the path transmission performance indicator value, the data allocation path optimization scheme, and the transmission stability monitoring parameter. The path dynamic switching result includes the backup selection path, the path switching confirmation status record, and the synchronization task execution status record.

[0068] Please refer to Figure 2 , the steps for obtaining the dynamic partition transmission range value are:

[0069] S111: Collect the network traffic data of the communication software, record the network bandwidth usage value, the user synchronization request frequency, and the synchronization request size, aggregate the data according to the time series, and generate the communication software network data set;

[0070] Collect the network traffic data of communication software, parse out the bandwidth usage values, user synchronization request frequencies, and synchronization request sizes of each communication software in different time periods from the network traffic logs, segment the traffic data using timestamps, group and classify the original data according to the time dimension, calculate the total, average, and peak bandwidth usage values of each time period through statistical methods, record the sending interval time of user synchronization requests and the data size involved in each request at the same time, count the synchronization request frequencies, obtain the frequency distribution by calculating the number of requests per unit time, and perform grouped calculations on the synchronization request sizes in combination with data quantile analysis to obtain the distribution characteristics of the 50%, 75%, 90% quantile values, classify according to the communication software type based on the statistical results, and conduct cross-analysis and summary of the network bandwidth usage rate and synchronization request behavior characteristics of each communication software to form the network bandwidth usage rate, synchronization request frequency distribution, and synchronization request size distribution of each communication software.

[0071] S112: Utilize the communication software network data set, combine the transmission capabilities and partition boundary information of data partitions, count the transmission demand of data partitions, and generate a data partition load deviation ratio by comparing the current load of the partition with its network transmission capabilities;

[0072] According to the network bandwidth usage rate, synchronization request frequency distribution, and synchronization request size distribution of communication software, combine the physical boundary information and transmission capacity parameters of data partitions. First, define the transmission capacity of a partition as the maximum bandwidth capacity of each partition multiplied by the transmission efficiency. Obtain the maximum bandwidth capacity by referring to the partition transmission configuration file, and calculate the transmission capacity in combination with the bandwidth reservation rate. Subsequently, compare and analyze the frequency distribution and size distribution of synchronization requests with the partition transmission capacity, calculate the transmission demand of each partition according to the total data transmission demand of all synchronization requests within the partition, and the demand is obtained by accumulating the transmission data sizes of each synchronization request. At the same time, use the partition load formula to measure the deviation between the transmission capacity and demand of each partition, calculate the ratio of the current load to the transmission capacity of each partition respectively, and generate a load deviation ratio to represent the uneven distribution degree of partition transmission demand.

[0073] S113: Based on the data partition load deviation ratio, compare the transmission demand and current transmission capacity of each partition, and use the formula:

[0074] ;

[0075] Calculate the average bandwidth usage deviation value of the partition , dynamically adjust the partition range and partition boundary, and output the dynamic partition transmission range value, represents the total bandwidth, represents the actual transmission demand, represents the number of partitions;

[0076] There are 3 partitions, and their total bandwidth ), and the actual transmission demand ) are as follows:

[0077] Partition 1: Total bandwidth Mbps, actual demand Mbps

[0078] Partition 2: Total bandwidth Mbps, actual demand Mbps

[0079] Partition 3: Total bandwidth Mbps, actual demand Mbps

[0080] Calculate the squared deviation value of each partition:

[0081]

[0082]

[0083] ;

[0084] Find the sum of squared deviations:

[0085] ;

[0086] Calculate the bandwidth usage deviation of the partition :

[0087] ;

[0088] The results show that the average bandwidth usage deviation of the three partitions is 1000 Mbps, indicating a large deviation between the actual transmission demand of the partitions and their total bandwidth. In particular, Partition 1 contributes a large part to the overall deviation. The value reflects the mismatch between the current bandwidth resource allocation and the actual transmission demand. It is necessary to dynamically adjust the transmission range and partition boundaries of each partition to balance the bandwidth allocation and improve the transmission efficiency. According to the calculation results, it is possible to first analyze whether the demand of Partition 1 needs to be reallocated with higher bandwidth resources, and at the same time adjust the parts with smaller load deviations in Partitions 2 and 3 to optimize the overall transmission performance.

[0089] Please refer to Figure 3 , the steps to obtain the sorting result of the partition conflict frequency are as follows:

[0090] S211: Parse and extract the data items in the partition according to the dynamic partition transfer range value, record the update frequency and access behavior characteristics of each data item, count the access times, access source distribution and time interval characteristics of each data item, and generate the update frequency and access mode classification results of the data items in the partition;

[0091] Call the dynamic partition transfer range value, extract all data items in the partition item by item, parse the access log records of each data item, sort the data by timestamp and then count the update frequency. The update frequency is quantified by calculating the access times in each time period. The access behavior characteristics are classified according to the identification of the access source and the time interval distribution. First, extract the unique identification of the access source, such as the user ID or device identification, group the accesses from the same source, and calculate the access proportion in different time periods. At the same time, extract the timestamps of each access operation, calculate the time interval between adjacent accesses, and count the distribution characteristics of the time interval. Combine the access source and time interval distribution to establish the basis for classifying the access mode of each data item. Finally, generate the update frequency and access mode classification results of the data items in the partition by summarizing the access times, time interval distribution and source proportion of each data item.

[0092] S212: Based on the update frequency and access mode classification results of the data items in the partition, use the formula:

[0093] ;

[0094] Calculate the conflict frequency , and output the synchronization conflict occurrence frequency of each type of data item. Among them, is the number of synchronization request conflicts, is the total number of synchronization requests;

[0095] The following parameters are statistically obtained in a partition:

[0096] Data item 1: Number of synchronization request conflicts , total number of synchronization requests ;

[0097] Data item 2: Number of synchronization request conflicts , total number of synchronization requests ;

[0098] Data item 3: Number of synchronization request conflicts , total number of synchronization requests .

[0099] Calculate the conflict frequency: For data item 1:

[0100] ;

[0101] For data item 2:

[0102] ;

[0103] For data item 3:

[0104] ;

[0105] The result shows that the conflict frequency of data item 1 is the highest, reaching 30%, followed by data item 2 at 25%, and data item 3 is the lowest at 16.7%. This indicates that the synchronization conflict risk of data item 1 is higher, and it is necessary to prioritize optimizing the transmission distribution of this data item in the partition boundary adjustment to improve the overall synchronization efficiency.

[0106] S213: Using the synchronization conflict occurrence frequency of each type of data item, sort the data items in descending order of conflict frequency, associate the sorting result with the dynamic partition transmission range value, and combine the data item conflict frequency characteristics within each partition range to generate a partition conflict frequency sorting result;

[0107] Using the synchronization conflict occurrence frequency obtained from the aforementioned statistics, sort each data item in descending order of conflict frequency, classify each type of data item partition. First, associate the dynamic partition transmission range value with the data item set, extract the data item list within each partition range, and then for the data item list of each partition, sort according to the calculation result of the aforementioned conflict frequency. Generate a conflict frequency list with partitions as the unit, and at the same time, organize the sorted result according to the dynamic partition transmission range value, associate the conflict frequency of each data item with the partition range, and form a partition conflict frequency table sorted by conflict frequency. The conflict frequency information of each partition in the table is listed in sequence according to the sorting of the data items, and finally generate a partition conflict frequency sorting result sorted by conflict frequency.

[0108] Please refer to Figure 4 , the judgment steps for whether the synchronization delay amount exceeds the set threshold are as follows:

[0109] S311: According to the partition conflict frequency sorting result, collect the access logs of each data item group, parse the start time and completion time of the synchronization request, calculate the duration of each synchronization request, and accumulate all the synchronization durations within the same data item group to generate the total synchronization duration of each data item group;

[0110] Call the sorted result of partition conflict frequency, extract the access logs of each data item group from it, parse and sort the logs according to the timestamp, extract the start time and completion time for each synchronization request, use the difference between the start time and the completion time as the duration of each synchronization request, record the start and completion times of all synchronization requests for each data item group at the same time, add up these synchronization durations one by one to calculate the total synchronization duration, count the number of synchronization requests for each data item group, and record the operation time and execution order of each request to ensure that all synchronization requests in the data item group are calculated. Check and correct the records with abnormal operations or missing timestamps to ensure the integrity and accuracy of the synchronization duration. Finally, obtain the total synchronization duration and the number of synchronization requests for each data item group, providing the basic data for the subsequent calculation of the average synchronization delay.

[0111] S312: Based on the total synchronization duration of each data item group, count the number of synchronization requests for each group of data items, using the formula:

[0112] ;

[0113] Calculate the th average synchronization delay of the data item group , generate the average synchronization delay data for each data item group, where represents the total synchronization duration of all synchronization requests within the th data item group, represents the number of synchronization requests for the th data item group, represents the correction factor inversely proportional to the number of requests;

[0114] Data item group 1: Total synchronization duration seconds, number of synchronization requests ;

[0115] Data item group 2: Total synchronization duration seconds, number of synchronization requests .

[0116] For the calculation of data item group 1:

[0117] Calculate the correction term:

[0118] ;

[0119] Calculate the numerator part:

[0120] ;

[0121] Calculate the average synchronization delay:

[0122] ;

[0123] Calculation for data item group 2:

[0124] Calculate the correction term:

[0125] ;

[0126] Calculate the numerator part:

[0127] ;

[0128] Calculate the average synchronization delay:

[0129] ;

[0130] The results show that:

[0131] The average synchronization delay of data item group 1 is 63 seconds;

[0132] The average synchronization delay of data item group 2 is 66 seconds.

[0133] It shows that due to the smaller number of synchronization requests in data item group 2, its delay is slightly higher than that of data item group 1 under the action of the correction term. It can be clearly seen that there are differences in the time consumption of different data item groups in the synchronization operation, which provides an important basis for subsequent judgment on whether the synchronization delay exceeds the threshold and priority classification.

[0134] S313: Based on the average synchronization delay of each data item group, make a judgment in combination with the set threshold. By comparing the delay with the set threshold, classify and mark the delay. Those exceeding the threshold are marked as "exceeded", otherwise marked as "not exceeded", and generate a delay judgment result;

[0135] Combined with the average synchronization delay of each data item group, read its value one by one and compare it with the set delay threshold. For each data item group, if the average synchronization delay is greater than the threshold, mark it as "exceeded", otherwise mark it as "not exceeded". At the same time, record the delay status information of each data item group to form a clear classification basis. During the judgment process, the operation of comparing with the threshold needs to ensure the accuracy of numerical calculation. By gradually checking the comparison results of the delay and the threshold, ensure that the delay judgment covers all data item groups, and finally generate a delay judgment result including classification marks, ensuring that the data item groups are distinguished according to the status of the synchronization delay, providing a clear basis for subsequent priority allocation.

[0136] Please refer to Figure 5 , the steps to obtain the synchronization priority allocation result are as follows:

[0137] S321: Classify the latency status of each data item group according to the latency judgment result. For the data item groups marked as exceeding, sort them in descending order of the latency amount. For the data item groups marked as not exceeding, sort them in descending order of the number of synchronization requests, and generate a list of classified and sorted data item groups.

[0138] Invoke the latency judgment result, extract the latency status information of each data item group one by one. According to the latency amount recorded in the data item groups marked as "exceeding", sort these data item groups in descending order of the latency amount, compare and adjust the position of the latency amount of each data item group one by one to ensure the correctness of the sorting result. At the same time, record the sorting position index of each data item group, and correspond these indexes with the latency amounts one by one. For the data item groups marked as "not exceeding", extract their synchronization request numbers, and sort these data item groups in descending order according to the number of synchronization requests. Similarly, compare the synchronization request numbers one by one and adjust the sorting position to generate a classified and sorted list including two types of data item groups: "exceeding" and "not exceeding". In the list, clarify the classification status, sorting position and corresponding key parameter values of each data item group, providing a complete data basis for subsequent priority allocation.

[0139] S322: According to the list of classified and sorted data item groups, assign transmission priorities to each data item group. Assign high priorities to the data item groups marked as exceeding in turn according to the principle of higher latency with higher priority. Assign medium and low priorities to the data item groups marked as not exceeding in turn according to the principle of more synchronization requests with higher priority, and generate the result of transmission priority setting.

[0140] Use the classified and sorted list to read the data item groups marked as "exceeding" one by one. Starting from the group with the largest latency amount, assign high priority numbers in turn, and increase the numbers one by one from small to large to ensure that the data item group with a larger latency amount has a smaller priority number. Subsequently, read the data item groups marked as "not exceeding", and assign medium and low priority numbers in turn starting from the group with the largest number of synchronization requests, and also assign them in the order of increasing numbers to ensure that the data item group with a larger number of synchronization requests has a smaller priority number. During the priority assignment process, record the priority number and the corresponding classification status of each data item group, check the priority setting results of all data item groups to ensure that the priority numbers are not repeated and cover all data item groups, and finally generate a complete result of transmission priority setting, providing a clear basis for the synchronization order of the queue.

[0141] S323: Combine the result of transmission priority setting, add the data item groups to the synchronization queue in order of priority, arrange the synchronization queue in the order from high priority to low priority, and queue the data item groups with the same priority in the order in the sorted list to generate the result of synchronization priority assignment.

[0142] Call the transmission priority setting result, and add the data item groups to the synchronization queue one by one in ascending order of the priority number. For the data item groups with the same priority number, arrange them in the order in the classification sort list. Prioritize the data item groups marked as "exceeded" and place them at the front of the queue first, and complete the arrangement of the data item groups in the high-priority category in the queue in turn. After completing the arrangement of the high-priority category, continue to arrange the data item groups marked as "not exceeded" in ascending order of the priority number, place the data item groups with more synchronization requests in the middle or front of the queue, and check the order of the data item groups in the same priority category to ensure that the arrangement conforms to the relative order shown in the classification sort result, and finally form a synchronization queue containing all data item groups, and clarify the arrangement order of the high-, medium-, and low-priority data item groups in the queue, providing a complete queue structure for the finally generated synchronization priority allocation result.

[0143] Please refer to Figure 6 , the steps for obtaining the path transmission allocation scheme are as follows:

[0144] S411: Based on the synchronization priority allocation result, read the transmission priority and the corresponding transmission path of each data item one by one, count the fluctuation range of the transmission stability, bandwidth utilization rate, and delay amount of each path, analyze the change trend of each parameter during the monitoring period, and generate the preliminary transmission performance data of each transmission path;

[0145] Call the synchronization priority allocation result, extract the transmission priority of each data item and its corresponding transmission path one by one, record the basic attributes of the path, including the path identifier and the data capacity limit, parse the real-time monitoring data of each path, calculate the cumulative value and change range of the data flow in the path one by one, statistically analyze the utilization rate fluctuation of the bandwidth by time period, classify and sort the traffic changes in the form of a time series, and at the same time measure the transmission delay in the path, record the maximum delay and minimum delay values respectively, and calculate the fluctuation range within the time period of the delay. For the packet loss rate, calculate it by recording the ratio of the number of lost packets to the total number of transmitted packets, calculate the average packet loss rate after accumulating the packet loss situations in all time periods, and synthesize all data to form the preliminary performance data of each path, and use the time series of transmission stability, bandwidth utilization rate, and delay amount as key parameters to complete the collation of the preliminary performance data of the path, providing a basis for subsequent comprehensive performance calculation.

[0146] S412: Calculate the comprehensive performance of the path according to the preliminary transmission performance data of each path, using the formula:

[0147] ;

[0148] Calculate the comprehensive performance index of the path , sort by combining with transmission priority information to obtain the sorted result of path performance metrics, where is the average bandwidth utilization rate of the path, is the packet loss rate of the path, and are the maximum delay and minimum delay of the path respectively;

[0149] Average bandwidth utilization rate (average utilization rate calculated based on the traffic record of the path);

[0150] Packet loss rate (calculated by the ratio of the cumulative number of lost data packets to the total number of transmitted data packets);

[0151] Maximum delay milliseconds, minimum delay milliseconds (obtained based on the path delay measurement value).

[0152] Calculate the combined term of bandwidth utilization rate and packet loss rate:

[0153]

[0154] ;

[0155] Calculate the square root of the delay fluctuation range:

[0156] ;

[0157] Calculate the comprehensive performance metric of the path:

[0158] ;

[0159] The result shows that the comprehensive performance metric of the path is 0.120, indicating that in this formula, the higher the performance value of the path, the better, and the paths with lower performance need to consider optimization or data redistribution. The comprehensive performance metric effectively reflects the impact of the bandwidth utilization rate, packet loss rate, and delay fluctuation range of the path on the transmission performance, provides a clear quantitative basis for path sorting and data allocation, and can guide the optimal selection of transmission paths during the dynamic allocation process.

[0160] S413: Based on the sorted result of path performance metrics, allocate data to the path with the best performance in descending order of priority, check one by one whether the path capacity of the allocation result meets the data requirements, reselect the sub-optimal path to allocate data for the path exceeding the capacity limit, and generate a path transmission allocation plan;

[0161] Combined with the sorting results of the comprehensive performance indicators, starting from the path with the best performance, high-priority data items are allocated to the transmission path with the best performance according to the priority allocation order. For each allocation process, it is confirmed one by one whether the remaining capacity of the path meets the transmission requirements of the current data item. If the current path capacity is insufficient, the remaining data is adjusted to the sub-optimal path for allocation to ensure that all data items can be allocated to a path that meets their requirements. At the same time, record the allocated data items and corresponding priorities of each path, check the actual utilization of the path capacity, and avoid capacity overload or redundant allocation of the path; for the paths that have completed the allocation, check whether the allocation of all data items is consistent with the priority sorting, and finally form a complete path transmission allocation plan including path sorting, data item allocation, and capacity utilization to ensure the orderly and efficient allocation of transmission tasks.

[0162] Please refer to Figure 7 , and the steps for obtaining the path dynamic switching result are as follows:

[0163] S511: According to the path transmission allocation plan, collect the real-time status monitoring data of all paths one by one, statistically calculate the data traffic fluctuation range and the change trend of delay of each path according to the time period, calculate the packet loss rate cumulatively for each time period, and record the status change of each path in combination with the real-time monitoring data to generate the path real-time status monitoring result;

[0164] According to the path transmission allocation plan, extract the real-time status data of all paths one by one, including the delay, packet loss rate, and data traffic change of the path. For the transmission performance parameters collected in real time for each path, conduct statistical records for each time segment, use real-time monitoring to record the delay fluctuation range within each time period, collate the highest value, lowest value, and average value of the delay, and calculate its fluctuation amplitude; conduct cumulative statistics on the packet loss rate for each time period, compare the number of lost data packets with the total number of data packets within each time period to generate the change trend of the packet loss rate; in addition, analyze the data traffic change of the path, record the difference between the peak traffic and the lowest traffic, and collate the data traffic stability of the path. Finally, establish a transmission performance status table for the path, including the delay fluctuation range, packet loss rate change trend, and traffic stability, providing detailed data support for the next path performance determination.

[0165] S512: Based on the path real-time status monitoring result, analyze the performance change trend of each path, compare one by one the deviation degree of the delay fluctuation range in the current time period from the historical average value, check whether the change of the packet loss rate exceeds the limit threshold, mark the paths with performance decline, and identify the paths where the transmission task is interrupted. Correlate the marked results with the task status in the path transmission allocation plan to generate the path real-time status determination result;

[0166] Call the path performance status table, analyze the real-time performance data of all paths, compare the monitoring data in the current time period with the benchmark values and fluctuation ranges of latency and packet loss rate recorded in the historical status, and calculate the deviation of the latency fluctuation in the current time period from the historical benchmark value; Check the change trend of the packet loss rate, identify whether the packet loss rate exceeds the historical average and the preset standard, mark the status of each path that exceeds the limit threshold, and generate a path performance mark in combination with the analysis results of latency and packet loss rate; At the same time, according to the latency fluctuation and packet loss rate status marks, check whether the performance change trend of each path may cause a path interruption. If the latency fluctuation exceeds the limit threshold or the packet loss rate is higher than the set range, immediately mark the path as a performance degradation or possible interruption status, list these marked paths separately and match them with the transmission task table to generate a performance mark table, providing a basis for subsequent path dynamic adjustment.

[0167] S513: According to the path real-time status determination result, for the paths marked as performance degradation and interruption, select the path with the best current status from the standby paths for replacement, reallocate the corresponding transmission data to the new path, record the status information before and after the path switch, confirm the normal operation status of all synchronization tasks after the path switch, and generate a path dynamic switch result;

[0168] Combined with the path real-time status determination result, exclude the paths marked as performance degradation or possible interruption from the transmission tasks, filter the available paths in the standby paths, and select the path with the best transmission stability to replace the original path's transmission task according to the real-time performance data of each standby path in the performance status table; Gradually operate the process of reallocating the transmission tasks, including the allocation adjustment of the transmission task data volume, the performance monitoring after the path switch, and the traffic redistribution of the transmission tasks, and record the path status information before and after the switch in detail; Check the latency, packet loss rate, and traffic changes after the transmission task switch to ensure that the switched path can meet the task requirements, and at the same time update the switched status and performance data in the path allocation record table. After confirming that all tasks are executed normally, form a path dynamic switch plan.

[0169] A data synchronization system for a communication software, including:

[0170] The network traffic analysis module collects the network traffic data of the communication software, records the network bandwidth usage value, the user synchronization request frequency, and the synchronization request size, combines the transmission capabilities of the data partitions and the partition boundary information, calculates the transmission demand of the data partitions, calculates the average bandwidth usage deviation value of the partitions, and outputs the dynamic partition transmission range value;

[0171] The partition conflict analysis module parses and extracts data items within a partition according to the dynamic partition transfer range value, calculates the conflict frequency, sorts the data items in descending order of the conflict frequency, makes a corresponding association with the dynamic partition transfer range value, and generates a partition conflict frequency sorting result;

[0172] The synchronization priority allocation module parses the start time and completion time of the synchronization request according to the partition conflict frequency sorting result, calculates the average synchronization delay amount of the data item group, classifies and marks the delay amount in combination with a preset threshold, sorts the delay status of each data item group, allocates transmission priorities to each data item group synchronously, adds the data item groups to the synchronization queue in order of priority, and generates a synchronization priority allocation result;

[0173] The path performance allocation module, based on the synchronization priority allocation result, reads the transmission priority of each data item and the corresponding transmission path one by one, analyzes the change trend of each parameter during the monitoring time period, calculates the comprehensive performance index of the path, and allocates data to the path with the best performance in descending order of priority, generating a path transmission allocation plan;

[0174] The dynamic path switching module, according to the path transmission allocation plan, monitors the status change of each path in real time for data records, analyzes the performance change trend of each path, marks the paths with performance degradation, and identifies the paths with interrupted transmission tasks, reallocates the corresponding transmission data to a new path, and confirms the normal operation status of all synchronization tasks after the path switch, generating a path dynamic switching result.

[0175] The above is only a preferred embodiment of the present invention, and does not limit the present invention in other forms. Any person skilled in the art may use the technical content disclosed above to make changes or modifications into equivalent embodiments with equivalent changes and apply them to other fields. However, as long as it does not depart from the technical solution content of the present invention, any simple modification, equivalent change and modification made to the above embodiments based on the technical essence of the present invention still fall within the protection scope of the technical solution of the present invention.

Claims

1. A data synchronization method for communication software, characterized in that: The following steps are involved: S1: Count the network bandwidth usage rate of the communication software, the frequency of user synchronization requests, and the size of synchronization requests, calculate the transmission demand of each data partition, compare the current load of the difference partition with the network transmission capacity, adjust the transmission range and partition boundary of the data partition, and generate the dynamic partition transmission range value; S2: Based on the dynamic partition transmission range value, the update frequency and access mode of the data items in the partition are classified, the data items are sorted according to the conflict frequency, and a partition conflict frequency sorting result is generated; S3: Calculate the synchronization delay caused by each data item group according to the partition conflict frequency sorting result, determine whether the synchronization delay exceeds a set threshold, perform priority classification according to the determination result, set the transmission priority of the difference data items, set the processing order of the synchronization queue according to the priority, and generate a synchronization priority allocation result; S4: Based on the synchronization priority allocation result, the transmission stability, bandwidth and delay of each data synchronization path are monitored, the transmission performance indicators of each path are compared, the data is allocated to the optimal path according to the priority transmission order, and a path transmission allocation plan is generated; S5: According to the path transmission allocation scheme, the real-time status of the transmission path is monitored. If path interruption and performance degradation are detected, the backup path is immediately switched, and the synchronization task is confirmed to be continuously executed, and a path dynamic switching result is generated.

2. The data synchronization method of communication software according to claim 1, characterized in that: The steps for obtaining the dynamic partition transmission range value are as follows: S111: Collect network traffic data of the communication software, record the network bandwidth usage value, user synchronization request frequency and synchronization request size, aggregate the data according to the time series, and generate a communication software network data set; S112: using the communication software network data set, combined with the data partition's transmission capacity and partition boundary information, to calculate the data partition's transmission demand, and by comparing the partition's current load with its network transmission capacity, to generate a data partition load deviation ratio; S113: Based on the data partition load deviation ratio, compare the transmission demand of each partition with the current transmission capacity, using the formula: ； Calculate the average bandwidth usage deviation of the partition , dynamically adjust the partition range and partition boundary, and output the dynamic partition transfer range value, Indicates the total bandwidth. Indicates the actual transmission demand, Indicates the number of partitions.

3. The data synchronization method of communication software according to claim 2, characterized in that: The steps for obtaining the partition conflict frequency sorting result are: S211: According to the dynamic partition transmission range value, the data items in the partition are parsed and extracted, the update frequency and access behavior characteristics of each data item are recorded, the number of accesses, the distribution of access sources and the time interval characteristics of each data item are counted, and the update frequency and access mode classification results of the data items in the partition are generated; S212: Based on the update frequency and access mode classification results of the data items in the partition, the formula is used: ； Calculating conflict frequency , output the frequency of synchronization conflicts for each type of data item, where is the number of synchronization request conflicts, The total number of synchronous requests; S213: Using the synchronization conflict occurrence frequency of each type of data item, sort the data items from high to low according to the conflict frequency, associate the sorting results with the dynamic partition transmission range values, and combine the data item conflict frequency characteristics within each partition range to generate a partition conflict frequency sorting result.

4. The data synchronization method of communication software according to claim 3, characterized in that: The steps for determining whether the synchronization delay exceeds the set threshold are as follows: S311: According to the partition conflict frequency sorting result, collect the access log of each data item group, parse the start time and completion time of the synchronization request, calculate the duration of each synchronization request, and accumulate all synchronization durations in the same data item group to generate the total synchronization duration of each data item group; S312: Based on the total synchronization duration of each data item group, the number of synchronization requests for each group of data items is counted using the formula: ； Calculate the The average synchronization delay of the data item group , generates the average synchronization delay data for each data item group, where Representative The total synchronization duration of all synchronization requests in the data item group, Representative The number of synchronization requests for groups of data items, represents a correction amount that is inversely proportional to the number of requests; S313: Based on the average synchronization delay of each data item group, a judgment is made in combination with a set threshold. The delay is classified and marked by comparing the delay with the set threshold. If it exceeds the threshold, it is marked as exceeded, otherwise it is marked as not exceeded, and a delay judgment result is generated.

5. The data synchronization method of communication software according to claim 4, characterized in that: The steps for obtaining the synchronization priority allocation result are: S321: According to the delay judgment result, the delay status of each data item group is classified, the data item groups marked as exceeded are sorted from high to low according to the delay amount, and the data item groups marked as not exceeded are sorted from high to low according to the number of synchronization requests, and a classified and sorted data item group list is generated; S322: according to the classified and sorted data item group list, assigning a transmission priority to each data item group, assigning a high priority to the data item group that exceeds the mark in accordance with the principle of high priority of delay amount, and assigning a medium and low priority to the data item group that does not exceed the mark in accordance with the principle of multiple priorities of synchronization request quantity, and generating a transmission priority setting result; S323: In combination with the transmission priority setting result, the data item groups are added to the synchronization queue in order of priority, the synchronization queue is arranged from high priority to low priority, and the data item groups with the same priority are queued in the order in the sorted list to generate the synchronization priority allocation result.

6. The data synchronization method of communication software according to claim 5, characterized in that: The steps of obtaining the path transmission allocation scheme are as follows: S411: Based on the synchronization priority allocation result, read the transmission priority and corresponding transmission path of each data item one by one, count the transmission stability fluctuation range, bandwidth utilization and delay of each path, analyze the change trend of each parameter in the monitoring time period, and generate preliminary transmission performance data of each path; S412: Calculate the comprehensive performance of each path according to the preliminary transmission performance data of each path, using the formula: ； Comprehensive performance indicators of calculation paths , combined with the transmission priority information, the path performance index ranking result is obtained, where is the average bandwidth utilization of the path, is the path packet loss rate, and are the maximum delay and minimum delay of the path respectively; S413: Based on the path performance index sorting result, data is allocated to the path with the best performance in descending order of priority, and whether the path capacity of the allocation result meets the data demand is confirmed one by one. For the path exceeding the capacity limit, a suboptimal path is reselected to allocate data, and a path transmission allocation plan is generated.

7. The data synchronization method of communication software according to claim 6, characterized in that: The steps for obtaining the path dynamic switching result are: S511: According to the path transmission allocation scheme, real-time status monitoring data of all paths are collected one by one, the data flow fluctuation range and delay change trend of each path are counted according to time periods, the packet loss rate is accumulated and calculated in each time period, and the status change of each path is recorded in combination with the real-time monitoring data to generate a path real-time status monitoring result; S512: Based on the real-time status monitoring result of the path, analyze the performance change trend of each path, compare the deviation degree of the delay fluctuation range in the current time period with the historical average value one by one, check whether the change of the packet loss rate exceeds the limit threshold, mark the path with degraded performance, and identify the path with interrupted transmission task, correspond the marking result with the task status in the path transmission allocation plan, and generate the real-time status determination result of the path; S513: According to the real-time status determination result of the path, for the path marked as performance degradation and interruption, select the path with the best current status from the backup paths to take over, reallocate the corresponding transmission data to the new path, and record the status information before and after switching the path, confirm the normal operation status of all synchronization tasks after the path switching, and generate the path dynamic switching result.

8. A data synchronization system for communication software, characterized in that: The system is used to execute the data synchronization method of the communication software according to any one of claims 1 to 7, comprising: The network traffic analysis module collects network traffic data of the communication software, records the network bandwidth usage value, user synchronization request frequency and synchronization request size, combines the transmission capacity of the data partition and the partition boundary information, calculates the transmission demand of the data partition, calculates the average bandwidth usage deviation value of the partition, and outputs the dynamic partition transmission range value; The partition conflict analysis module parses and extracts the data items in the partition according to the dynamic partition transmission range value, calculates the conflict frequency, sorts the data items from high to low according to the conflict frequency, and associates them with the dynamic partition transmission range value to generate a partition conflict frequency sorting result; The synchronization priority allocation module analyzes the start time and completion time of the synchronization request according to the partition conflict frequency sorting result, calculates the average synchronization delay of the data item group, classifies and marks the delay amount in combination with the preset threshold, and sorts the delay status of each data item group, synchronously assigns a transmission priority to each data item group, adds the data item group to the synchronization queue in sequence according to the priority, and generates a synchronization priority allocation result; The path performance allocation module reads the transmission priority and corresponding transmission path of each data item one by one based on the synchronization priority allocation result, analyzes the change trend of each parameter within the monitoring time period, calculates the comprehensive performance index of the path, allocates the data to the path with the best performance in descending order of priority, and generates a path transmission allocation plan; The dynamic path switching module monitors the data in real time according to the path transmission allocation plan, records the status changes of each path, analyzes the performance change trend of each path, marks the paths with degraded performance, identifies the paths where the transmission tasks are interrupted, reallocates the corresponding transmission data to the new paths, confirms the normal operation status of all synchronization tasks after the path switching, and generates the path dynamic switching results.

Images