Transmission method in data synchronization, electronic device, storage medium and program product

Abstract

The application discloses a transmission method in data synchronization, an electronic device, a storage medium and a program product, relates to the technical field of data synchronization, and comprises the following steps: determining a to-be-synchronized data block according to a data synchronization request, acquiring an access feature of the to-be-synchronized data block, calculating a target level score, determining a target data type according to the target level score, and then matching a corresponding target compression method and a target bandwidth proportion to perform a data synchronization operation. Through dynamic grading and strategy matching based on data features, the problems of low resource utilization and insufficient synchronization efficiency caused by rigid bandwidth allocation and single compression strategy in the traditional synchronization process are overcome, intelligent optimization of the synchronization bandwidth and adaptive adjustment of the compression strategy are realized, and the data transmission efficiency and the system resource utilization are significantly improved.

Description

Technical Field

[0001] This application relates to the field of data synchronization technology, and in particular to a data synchronization transmission method, electronic device, storage medium, and program product. Background Technology

[0002] With the development of cloud computing, big data, and mission-critical applications, high data availability and business continuity have become crucial. Existing data synchronization solutions face the following limitations and challenges in bandwidth utilization: 1. Existing methods typically employ fixed bandwidth allocation or simple priority queues, failing to dynamically adjust based on real-time data characteristics. This "one-size-fits-all" strategy leads to high-value data potentially being delayed due to insufficient bandwidth, while low-value data consumes excessive resources, resulting in low bandwidth utilization. 2. Different data blocks in the synchronized data stream exhibit significantly different characteristics, such as access frequency, input / output patterns, and block size. Existing methods generally employ a single compression algorithm or no compression at all, failing to match differentiated compression strategies based on the "hot," "cold," and "warm" attributes of data blocks (i.e., access frequency and importance), resulting in an inability to achieve an optimal balance between compression efficiency and processing speed. 3. Due to the above two points, in bandwidth-limited scenarios, unnecessary high-volume synchronization, such as uncompressed or inefficiently compressed transmission of cold data, will consume resources for critical synchronization tasks, increasing operational costs and directly leading to a decrease in overall data synchronization efficiency and an extension of recovery time targets. Summary of the Invention

[0003] This application provides a transmission method, electronic device, storage medium, and program product for data synchronization, to at least solve the problems of rigid bandwidth resource allocation and inability to dynamically optimize based on data characteristics during data synchronization in related technologies, resulting in low synchronization efficiency and insufficient bandwidth utilization.

[0004] This application provides a transmission method for data synchronization, comprising: in response to receiving a data synchronization request, determining a data block to be synchronized based on the data synchronization request; acquiring access characteristics of the data block to be synchronized, wherein the access characteristics include at least the input / output mode ratio, block size, and access frequency; calculating a target level score for the data block to be synchronized based on the access characteristics; determining a target data type corresponding to the target level score based on a first mapping relationship between a preset level score range and data type; determining a target compression method corresponding to the target data type based on a second mapping relationship between a preset data type and compression method, and simultaneously determining a target bandwidth ratio corresponding to the target data type based on a third mapping relationship between a preset data type and bandwidth ratio; and synchronizing the data block to be synchronized based on the target compression method and the target bandwidth ratio in response to the data synchronization request.

[0005] This application also provides an electronic device, including: a memory for storing a computer program; and a processor for executing the computer program to implement at least the following steps in a data synchronization method: in response to receiving a data synchronization request, determining a data block to be synchronized according to the data synchronization request; acquiring access characteristics of the data block to be synchronized, wherein the access characteristics include at least the proportion of input / output modes, block size, and access frequency; calculating a target level score of the data block to be synchronized based on the access characteristics; determining a target data type corresponding to the target level score according to a first mapping relationship between a preset level score range and data type; determining a target compression method corresponding to the target data type according to a second mapping relationship between a preset data type and compression method, and simultaneously determining a target bandwidth ratio corresponding to the target data type according to a third mapping relationship between a preset data type and bandwidth ratio; and synchronizing the data block to be synchronized according to the target compression method and the target bandwidth ratio in response to the data synchronization request.

[0006] This application also provides a computer-readable storage medium storing a computer program, wherein when executed by a processor, the computer program implements at least the following steps in a data synchronization method: in response to receiving a data synchronization request, determining a data block to be synchronized according to the data synchronization request; obtaining access characteristics of the data block to be synchronized, wherein the access characteristics include at least the input / output mode ratio, block size, and access frequency; calculating a target level score of the data block to be synchronized based on the access characteristics; determining a target data type corresponding to the target level score according to a first mapping relationship between a preset level score range and data type; determining a target compression method corresponding to the target data type according to a second mapping relationship between a preset data type and compression method, and simultaneously determining a target bandwidth ratio corresponding to the target data type according to a third mapping relationship between a preset data type and bandwidth ratio; and synchronizing the data block to be synchronized according to the target compression method and the target bandwidth ratio in response to the data synchronization request.

[0007] This application also provides a computer program product, including a computer program that, when executed by a processor, implements at least the following steps in a data synchronization method: in response to receiving a data synchronization request, determining a data block to be synchronized based on the data synchronization request; acquiring access characteristics of the data block to be synchronized, wherein the access characteristics include at least the proportion of input / output modes, block size, and access frequency; calculating a target level score for the data block to be synchronized based on the access characteristics; determining a target data type corresponding to the target level score based on a first mapping relationship between a preset level score range and data type; determining a target compression method corresponding to the target data type based on a second mapping relationship between a preset data type and compression method, and simultaneously determining a target bandwidth ratio corresponding to the target data type based on a third mapping relationship between a preset data type and bandwidth ratio; and synchronizing the data block to be synchronized based on the target compression method and the target bandwidth ratio in response to the data synchronization request.

[0008] This application identifies the data block to be synchronized based on the data synchronization request, obtains its access characteristics, calculates the target level score, determines the target data type based on the target level score, and then matches the corresponding target compression method and target bandwidth ratio to perform the data synchronization operation. By dynamically classifying and matching strategies based on data characteristics, it overcomes the problems of low resource utilization and insufficient synchronization efficiency caused by rigid bandwidth allocation and single compression strategies in traditional synchronization processes. It achieves intelligent optimization of synchronization bandwidth and adaptive adjustment of compression strategies, significantly improving data transmission efficiency and system resource utilization. Attached Figure Description

[0009] To more clearly illustrate the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0010] Figure 1 This is a flowchart illustrating the transmission method in data synchronization in the first embodiment; Figure 2 This is a diagram of the internal structure of the electronic device in the second embodiment. Detailed Implementation

[0011] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the protection scope of this application.

[0012] It should be noted that, in the description of this application, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. The terms "first," "second," etc., in this application are used to distinguish similar objects and are not used to describe a specific order or sequence.

[0013] To enable those skilled in the art to better understand the present application, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0014] In the first embodiment, such as Figure 1 As shown, a data synchronization transmission method is provided, comprising: in response to receiving a data synchronization request, determining a data block to be synchronized according to the data synchronization request; acquiring access characteristics of the data block to be synchronized, wherein the access characteristics include at least the input / output mode ratio, block size, and access frequency; calculating a target level score of the data block to be synchronized based on the access characteristics; determining a target data type corresponding to the target level score according to a first mapping relationship between a preset level score range and data type; determining a target compression method corresponding to the target data type according to a second mapping relationship between a preset data type and compression method, and simultaneously determining a target bandwidth ratio corresponding to the target data type according to a third mapping relationship between a preset data type and bandwidth ratio; and synchronizing the data block to be synchronized according to the target compression method and the target bandwidth ratio in response to the data synchronization request.

[0015] Specifically, the above method performs feature analysis and classification on data blocks, dynamically matching the optimal compression method and bandwidth ratio for different types of data blocks, thereby achieving intelligent scheduling and efficient utilization of bandwidth resources during data synchronization and improving overall synchronization efficiency.

[0016] Furthermore, the access characteristics of the data block to be synchronized are obtained, including: monitoring and recording the input and output requests of the data block to be synchronized within a preset historical time period; based on the request address sequence of the input and output requests, counting the number of random input and output requests and the number of sequential input and output requests to determine the proportion of input and output modes; determining the block size based on the payload size of the input and output requests; and determining the access frequency based on the number of times the input and output requests are initiated within the preset historical time period.

[0017] Specifically, the above method monitors historical I / O (input / output) requests and extracts key features (pattern proportion, block size, access frequency), providing an accurate and quantifiable data foundation for subsequent intelligent classification and optimization, thus ensuring the reliability of the basis for optimization decisions.

[0018] Furthermore, based on the request address sequence of the input / output requests, the number of random input / output requests and the number of sequential input / output requests are counted to determine the proportion of input / output modes. This includes: performing continuity analysis on the request address sequence to identify requests with consecutive logical addresses as sequential input / output requests and requests with non-consecutive logical addresses as random input / output requests; counting a first number of sequential input / output requests and a second number of random input / output requests respectively; and calculating the proportion of input / output modes based on the first and second numbers, wherein the proportion of input / output modes is the ratio of the second number to the first number, or the ratio of the second number to the total number of requests, and the total number of requests is the sum of the first and second numbers.

[0019] Specifically, the above method distinguishes between random and sequential I / O based on the continuity analysis of address sequences, making the calculation of pattern proportions closer to actual I / O behavior, improving the accuracy of data classification, and laying a scientific basis for subsequent differentiated management.

[0020] Further, based on access characteristics, the target level score of the data block to be synchronized is calculated, including: multiplying the input / output mode ratio by a first preset weight value to obtain a first target sub-score; multiplying the block size by a second preset weight value to obtain a second target sub-score; multiplying the access frequency by a third preset weight value to obtain a third target sub-score; and adding the first target sub-score, the second target sub-score, and the third target sub-score to obtain the target level score; wherein the sum of the first preset weight value, the second preset weight value, and the third preset weight value is the first preset value.

[0021] Specifically, the above method uses a weighted summation approach to calculate level scores by integrating multi-dimensional features, making the evaluation system more comprehensive and configurable. The weights can be adjusted according to business needs, flexibly adapting to priority determination standards in different scenarios.

[0022] In a specific embodiment, the target level score = α * (random input / output requests / sequential input / output requests or random input / output requests / total input / output requests) + β * (block size) + γ * (access frequency), where α + β + γ = 1.

[0023] Further, based on the first mapping relationship between preset level score ranges and data types, the target data type corresponding to the target level score is determined, including: comparing the target level score with a first preset score range, a second preset score range, and a third preset score range respectively, and obtaining a comparison result, wherein the first preset score range, the second preset score range, and the third preset score range continuously cover the entire valid level score interval, and the three do not overlap; in response to the comparison result that the target level score is within the first preset score range, the target data type corresponding to the target level score is determined to be a first data type, wherein the first data type indicates that the data block to be synchronized is a high-priority data block; in response to the comparison result that the target level score is within the second preset score range, the target data type corresponding to the target level score is determined to be a second data type, wherein the second data type indicates that the data block to be synchronized is a medium-priority data block; in response to the comparison result that the target level score is within the third preset score range, the target data type corresponding to the target level score is determined to be a third data type, wherein the third data type indicates that the data block to be synchronized is a low-priority data block.

[0024] Specifically, the above method clearly divides the data into three priority categories—high, medium, and low—by pre-setting non-overlapping score ranges, thus achieving a clear hierarchical classification of data synchronization tasks and providing clear guidance for the precise execution of subsequent differentiated strategies.

[0025] In a specific embodiment, the entire effective level score range is [0-100], the first preset score range is [0, 40), the second preset score range is [40, 80), and the third preset score range is [80, 100].

[0026] Furthermore, based on the preset second mapping relationship between data types and compression methods, the target compression method corresponding to the target data type is determined, including: in response to the target data type being a first data type, determining the target compression method corresponding to the target data type as a first compression method; in response to the target data type being a second data type, determining the target compression method corresponding to the target data type as a second compression method; in response to the target data type being a third data type, determining the target compression method corresponding to the target data type as a third compression method; wherein, among the first compression method, the second compression method, and the third compression method, the first compression method has the fastest compression speed, the second compression method has the highest weighted average value of compression speed and compression ratio, and the third compression method has the highest compression ratio.

[0027] Specifically, the above method matches compression methods with different performance tendencies (speed priority, balance priority, compression rate priority) to data of different priorities, so as to save bandwidth and storage resources to the maximum extent while ensuring fast synchronization of high-priority data.

[0028] Furthermore, based on a preset third mapping relationship between data types and bandwidth percentages, the target bandwidth percentage corresponding to the target data type is determined, including: in response to the target data type being a first data type, determining the target bandwidth percentage corresponding to the target data type as a first bandwidth percentage; in response to the target data type being a second data type, determining the target bandwidth percentage corresponding to the target data type as a second bandwidth percentage; in response to the target data type being a third data type, determining the target bandwidth percentage corresponding to the target data type as a third bandwidth percentage; wherein, the sum of the first bandwidth percentage, the second bandwidth percentage, and the third bandwidth percentage is a first preset value, and the first bandwidth percentage is greater than the second bandwidth percentage, and the second bandwidth percentage is greater than the third bandwidth percentage.

[0029] Specifically, the above method allocates bandwidth proportionally according to data type, ensuring that high-priority data receives sufficient transmission resources, while reasonably restricting the bandwidth usage of low-priority data, thus achieving optimized allocation of bandwidth resources and a systematic improvement in overall synchronization efficiency.

[0030] In a specific embodiment, the first data type is hot data, the second data type is warm data, and the third data type is cold data. Hot data is compressed using snappy (a high-performance compression algorithm designed to provide fast compression and decompression speeds), warm data is compressed using zstd (a high-performance lossless compression algorithm characterized by high compression ratios and fast compression / decompression speeds), and cold data is compressed using zlib (an efficient open-source data compression library designed to achieve high compression ratios). The first bandwidth allocation is 50%, the second bandwidth allocation is 30%, and the third bandwidth allocation is 20%.

[0031] Furthermore, in response to a data synchronization request, the data block to be synchronized is synchronized according to the target compression method and the target bandwidth ratio, including: compressing the data block to be synchronized according to the first compression method if the target compression method is a first compression method and the target bandwidth ratio is a first bandwidth ratio; obtaining the total bandwidth size, and obtaining a first bandwidth size according to the first bandwidth ratio and the total bandwidth size, and synchronizing the compressed data block to be synchronized through the bandwidth of the first bandwidth size, in response to a data synchronization request; compressing the data block to be synchronized according to the second compression method if the target compression method is a second compression method and the target bandwidth ratio is a second bandwidth ratio; obtaining a second bandwidth size according to the second bandwidth ratio and the total bandwidth size, and synchronizing the compressed data block to be synchronized through the bandwidth of the second bandwidth size, in response to a data synchronization request; and compressing the data block to be synchronized according to the third compression method if the target compression method is a third compression method and the target bandwidth ratio is a third bandwidth ratio; obtaining a third bandwidth size according to the third bandwidth ratio and the total bandwidth size, and synchronizing the compressed data block to be synchronized through the bandwidth of the third bandwidth size, in response to a data synchronization request.

[0032] Specifically, the data blocks to be synchronized are compressed according to the target compression method; the target bandwidth size for transmission is determined based on the ratio of total bandwidth to target bandwidth; and the compressed data blocks to be synchronized are transmitted using the determined target bandwidth. This method clarifies how to execute specific synchronization operations based on the determined target compression method and bandwidth ratio. By mapping abstract strategies to concrete actions—first compressing data according to the matching method, then calculating and consuming actual bandwidth for transmission according to the allocation ratio—a complete closed loop from "decision-making" to "execution" is achieved. This ensures that the hierarchical optimization strategy can be implemented accurately and quantitatively, ultimately reliably improving synchronization efficiency and bandwidth utilization.

[0033] It should be understood that, although Figure 1 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 1 At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0034] In a second embodiment, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it performs the following steps: in response to receiving a data synchronization request, determining a data block to be synchronized based on the data synchronization request; acquiring access characteristics of the data block to be synchronized, wherein the access characteristics include at least the proportion of input / output modes, block size, and access frequency; calculating a target level score for the data block to be synchronized based on the access characteristics; determining a target data type corresponding to the target level score based on a first mapping relationship between a preset level score range and data type; determining a target compression method corresponding to the target data type based on a second mapping relationship between a preset data type and compression method, and simultaneously determining a target bandwidth ratio corresponding to the target data type based on a third mapping relationship between a preset data type and bandwidth ratio; and synchronizing the data block to be synchronized based on the target compression method and the target bandwidth ratio in response to the data synchronization request.

[0035] When the program instructions are read and executed by one or more processors, they can also perform operations corresponding to the steps in the above method embodiments, as described above, and will not be repeated here. Reference Figure 2 This example illustrates the architecture of an electronic device, which may include a processor 210, a video display adapter 211, a disk drive 212, an input / output interface 213, a network interface 214, and a memory 220. The processor 210, video display adapter 211, disk drive 212, input / output interface 213, network interface 214, and memory 220 can communicate with each other via a communication bus 230.

[0036] The processor 210 can be implemented using a general-purpose central processing unit (CPU), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solution provided in this application.

[0037] The memory 220 can be implemented as a read-only memory (ROM), random access memory (RAM), static storage device, dynamic storage device, etc. The memory 220 can store the operating system 221 for controlling the operation of the electronic device 200, and the basic input / output system (BIOS) 222 for controlling the low-level operations of the electronic device 200. Additionally, it can store a web browser 223, data storage management 224, and an icon / font processing system 225. The icon / font processing system 225 can be the application program that specifically implements the aforementioned steps in this embodiment. In summary, when implementing the technical solution provided in this application through software or firmware, the relevant program code is stored in the memory 220 and executed by the processor 210.

[0038] Input / output interface 213 is used to connect input / output modules to realize information input and output. Input / output modules can be configured as components in the device (not shown in the figure) or externally connected to the device to provide corresponding functions. Input devices may include keyboards, mice, touch screens, microphones, various sensors, etc., and output devices may include displays, speakers, vibrators, indicator lights, etc.

[0039] Network interface 214 is used to connect a communication module (not shown in the figure) to enable communication between this device and other devices. The communication module can communicate via wired means (such as USB, Ethernet cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).

[0040] Bus 230 includes a pathway for transmitting information between various components of the device, such as processor 210, video display adapter 211, disk drive 212, input / output interface 213, network interface 214, and memory 220.

[0041] In addition, the electronic device 200 can also obtain information on specific acquisition conditions from a virtual resource object acquisition condition information database (not shown in the figure) for condition judgment.

[0042] It should be noted that although the above-described electronic device 200 only shows a processor 210, a video display adapter 211, a disk drive 212, an input / output interface 213, a network interface 214, a memory 220, and a bus 230, in specific implementations, the electronic device may also include other components necessary for normal operation. Furthermore, those skilled in the art will understand that the above-described device may only include the components necessary for implementing the solution of this application, and does not necessarily include all the components shown in the figures.

[0043] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause an electronic device (which may be a personal computer, cloud server, or network device, etc.) to execute the methods of various embodiments or some parts of the embodiments of this application.

[0044] In a third embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, it performs the following steps: in response to receiving a data synchronization request, determining a data block to be synchronized according to the data synchronization request; obtaining access characteristics of the data block to be synchronized, wherein the access characteristics include at least the proportion of input / output modes, block size, and access frequency; calculating a target level score of the data block to be synchronized based on the access characteristics; determining a target data type corresponding to the target level score according to a first mapping relationship between a preset level score range and data type; determining a target compression method corresponding to the target data type according to a second mapping relationship between a preset data type and compression method, and simultaneously determining a target bandwidth ratio corresponding to the target data type according to a third mapping relationship between a preset data type and bandwidth ratio; and synchronizing the data block to be synchronized according to the target compression method and the target bandwidth ratio in response to the data synchronization request.

[0045] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0046] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0047] The above embodiments are merely illustrative of several implementation methods of this application, and their descriptions are relatively specific and detailed. However, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application.

[0048] In a fourth embodiment, a computer program product is provided, on which a computer program is stored. When the computer program is executed by a processor, it performs the following steps: in response to receiving a data synchronization request, determining a data block to be synchronized according to the data synchronization request; obtaining access characteristics of the data block to be synchronized, wherein the access characteristics include at least the input / output mode ratio, block size, and access frequency; calculating a target level score of the data block to be synchronized based on the access characteristics; determining a target data type corresponding to the target level score according to a first mapping relationship between a preset level score range and data type; determining a target compression method corresponding to the target data type according to a second mapping relationship between a preset data type and compression method, and simultaneously determining a target bandwidth ratio corresponding to the target data type according to a third mapping relationship between a preset data type and bandwidth ratio; and synchronizing the data block to be synchronized according to the target compression method and the target bandwidth ratio in response to the data synchronization request.

[0049] In a fourth embodiment, a computer program product is also provided, including a non-volatile computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it performs the following steps: in response to receiving a data synchronization request, determining a data block to be synchronized according to the data synchronization request; acquiring access characteristics of the data block to be synchronized, wherein the access characteristics include at least the input / output mode ratio, block size, and access frequency; calculating a target level score for the data block to be synchronized based on the access characteristics; determining a target data type corresponding to the target level score based on a first mapping relationship between a preset level score range and data type; determining a target compression method corresponding to the target data type based on a second mapping relationship between a preset data type and compression method, and simultaneously determining a target bandwidth ratio corresponding to the target data type based on a third mapping relationship between a preset data type and bandwidth ratio; and synchronizing the data block to be synchronized according to the target compression method and the target bandwidth ratio in response to the data synchronization request.

[0050] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer program product, and when the computer program is executed, it can include the processes of the embodiments of the methods described above.

[0051] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0052] The above embodiments are merely illustrative of several implementation methods of this application, and their descriptions are relatively specific and detailed. However, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application.

Claims

1. A transmission method in data synchronization, characterized in that, The method includes: In response to receiving a data synchronization request, determine the data block to be synchronized based on the data synchronization request; Obtain the access characteristics of the data block to be synchronized, wherein the access characteristics include at least the proportion of input / output modes, block size, and access frequency; Calculate the target level score of the data block to be synchronized based on the access characteristics; Based on the first mapping relationship between the preset level score range and data type, the target data type corresponding to the target level score is determined; Based on a preset second mapping relationship between data types and compression methods, the target compression method corresponding to the target data type is determined. At the same time, based on a preset third mapping relationship between data types and bandwidth ratio, the target bandwidth ratio corresponding to the target data type is determined. Based on the target compression method and the target bandwidth ratio, the data block to be synchronized is synchronized in response to the data synchronization request.

2. The method according to claim 1, characterized in that, The acquisition of the access characteristics of the data block to be synchronized includes: Monitor and record input and output requests to the data block to be synchronized within a preset historical time period; Based on the request address sequence of the input / output requests, the number of random input / output requests and the number of sequential input / output requests are counted to determine the proportion of the input / output modes; The block size is determined based on the payload size of the input / output request; The access frequency is determined based on the number of times the input / output requests are initiated within the preset historical time period.

3. The method according to claim 2, characterized in that, The step of determining the proportion of the input / output modes by counting the number of random input / output requests and the number of sequential input / output requests based on the request address sequence of the input / output requests includes: A continuity analysis is performed on the request address sequence to identify requests with consecutive logical addresses as sequential input / output requests and requests with discontinuous logical addresses as random input / output requests. Count the first number of sequential input / output requests and the second number of random input / output requests respectively; Based on the first quantity and the second quantity, the input / output mode ratio is calculated, wherein the input / output mode ratio is the ratio of the second quantity to the first quantity, or the ratio of the second quantity to the total number of requests, and the total number of requests is the sum of the first quantity and the second quantity.

4. The method according to claim 1 or 3, characterized in that, The step of calculating the target level score of the data block to be synchronized based on the access characteristics includes: The first target sub-score is obtained by multiplying the input / output mode ratio by the first preset weight value; Multiply the block size by the second preset weight value to obtain the second target sub-score; The access frequency is multiplied by a third preset weight value to obtain a third target sub-score; The target level score is obtained by adding the first target sub-score, the second target sub-score, and the third target sub-score. The sum of the first preset weight value, the second preset weight value, and the third preset weight value is the first preset value.

5. The method according to claim 4, characterized in that, The step of determining the target data type corresponding to the target level score based on a first mapping relationship between a preset level score range and data type includes: The target level score is compared with the first preset score range, the second preset score range, and the third preset score range to obtain the comparison result. The first preset score range, the second preset score range, and the third preset score range continuously cover the entire valid level score range and do not overlap with each other. In response to the comparison result that the target level score is within the first preset score range, the target data type corresponding to the target level score is determined to be a first data type, wherein the first data type indicates that the data block to be synchronized is a high-priority data block; In response to the comparison result that the target level score is within the second preset score range, the target data type corresponding to the target level score is determined to be the second data type, wherein the second data type indicates that the data block to be synchronized is a medium priority data block; In response to the comparison result indicating that the target level score is within the third preset score range, the target data type corresponding to the target level score is determined to be a third data type, wherein the third data type indicates that the data block to be synchronized is a low-priority data block.

6. The method according to claim 5, characterized in that, The step of determining the target compression method corresponding to the target data type based on a preset second mapping relationship between data types and compression methods includes: In response to the target data type being the first data type, the target compression method corresponding to the target data type is determined to be the first compression method; In response to the target data type being the second data type, the target compression method corresponding to the target data type is determined to be the second compression method; In response to the target data type being the third data type, the target compression method corresponding to the target data type is determined to be the third compression method; Among the first compression method, the second compression method, and the third compression method, the first compression method has the fastest compression speed, the second compression method has the highest weighted average value of compression speed and compression ratio, and the third compression method has the highest compression ratio.

7. The method according to claim 5, characterized in that, The step of determining the target bandwidth percentage corresponding to the target data type based on a preset third mapping relationship between data types and bandwidth percentages includes: In response to the target data type being the first data type, the target bandwidth percentage corresponding to the target data type is determined to be the first bandwidth percentage; In response to the target data type being the second data type, the target bandwidth percentage corresponding to the target data type is determined to be the second bandwidth percentage; In response to the target data type being the third data type, the target bandwidth percentage corresponding to the target data type is determined to be the third bandwidth percentage; Wherein, the sum of the first bandwidth ratio, the second bandwidth ratio, and the third bandwidth ratio is the first preset value, and the first bandwidth ratio is greater than the second bandwidth ratio, and the second bandwidth ratio is greater than the third bandwidth ratio.

8. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor, configured to implement the steps of the transmission method in data synchronization as described in any one of claims 1 to 7 when executing the computer program.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, wherein the computer program, when executed by a processor, implements the steps of the transmission method in data synchronization as described in any one of claims 1 to 7.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the transmission method in data synchronization as described in any one of claims 1 to 7.

Images