Data transmission method and device, computer device, readable storage medium and program product

By classifying and processing business data across multiple data centers in the financial industry and selecting the optimal compression strategy, the problem of low bandwidth resource utilization in existing technologies has been solved, achieving more efficient data transmission.

CN118524148BActive Publication Date: 2025-12-05INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410590752.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-05-13
Publication Date
2025-12-05
Estimated Expiration
2044-05-13

AI Technical Summary

Technical Problem

In the financial industry, the existing technology relies on manual experience to configure compression strategies for business data transmission across multiple locations and data centers, resulting in low bandwidth resource utilization.

Method used

By classifying the business data to be transmitted, determining its corresponding classification type, and selecting the optimal target compression strategy from multiple preset compression strategies for data transmission, the influence of subjective factors is avoided.

Benefits of technology

It improves the utilization of bandwidth resources, ensures the efficiency and accuracy of data transmission, and reduces unnecessary data compression operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118524148B_ABST
    Figure CN118524148B_ABST
Patent Text Reader

Abstract

This application relates to a data transmission method, apparatus, computer equipment, computer-readable storage medium, and computer program product, belonging to the field of data transmission technology, and can be used in the financial technology field or other related fields. The method includes: classifying the business data to be transmitted to obtain the corresponding classification type; when the classification type is a newly added type, determining the target compression strategy corresponding to the classification type from a plurality of preset compression strategies, and transmitting the business data under the classification type based on the target compression strategy; when the classification type is an existing type, transmitting the business data under the classification type based on the target compression strategy. This method can improve the utilization rate of bandwidth resources.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of data transmission technology, and in particular to a data transmission method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Technology

[0002] In the financial industry, there is often a need for business data transmission between multiple locations and data centers. As the scale of financial business expands, the demand for bandwidth resources for business data transmission between multiple locations and data centers also increases. Therefore, it is often necessary to compress business data before transmission in order to improve the utilization rate of bandwidth resources.

[0003] In related technologies, compression strategies for business data to be transmitted often rely on human experience. However, the financial industry has many different categories, and the process of configuring compression strategies based on human experience is easily affected by subjective factors. This can result in a large amount of compressed business data, which in turn leads to low utilization of bandwidth resources. Summary of the Invention

[0004] Therefore, it is necessary to provide a data transmission method, apparatus, computer equipment, computer-readable storage medium, and computer program product that can improve the utilization rate of bandwidth resources, in order to address the aforementioned technical problem of low bandwidth resource utilization.

[0005] Firstly, this application provides a data transmission method applied to a data transmission system, the method comprising:

[0006] The service data to be transmitted is classified to obtain the classification type corresponding to the service data;

[0007] When the classification type is a newly added classification type, the target compression strategy corresponding to the classification type is determined from a plurality of preset compression strategies, and the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type.

[0008] If the classification type is an existing classification type, the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type.

[0009] In one embodiment, determining the target compression strategy corresponding to the classification type from a plurality of preset compression strategies, and based on the target compression strategy corresponding to the classification type, includes:

[0010] Based on the business data under the classification type, determine the compression feature values ​​of each compression strategy under the classification type, corresponding to multiple preset compression features;

[0011] Based on the weight of each compression feature corresponding to the classification type, the multiple compression feature values ​​corresponding to each compression strategy are fused to obtain the compression priority of each compression strategy corresponding to the classification type;

[0012] The compression strategy with the highest compression priority among the multiple compression strategies is determined as the target compression strategy corresponding to the classification type.

[0013] In one embodiment, the step of classifying the service data to be transmitted to obtain the classification type corresponding to the service data includes:

[0014] Based on the attribute information of the business data, the business data is subjected to a first classification process to obtain a first classification type corresponding to the business data; the attribute information of the business data includes at least one of the business type and data type of the business data.

[0015] Based on the transmission address corresponding to the service data, the service data is subjected to a second classification process to obtain a second classification type of the service data under the first classification type, which is used as the classification type corresponding to the service data.

[0016] In one embodiment, before fusing multiple compression feature values ​​corresponding to each compression strategy based on the weight of each compression feature corresponding to the classification type to obtain the compression priority of each compression strategy corresponding to the classification type, the method further includes:

[0017] Determine the first classification type corresponding to the classification type;

[0018] Determine the weight of the first classification type corresponding to each compressed feature;

[0019] The weight of the first classification type corresponding to each compressed feature is determined as the weight of the classification type corresponding to each compressed feature.

[0020] In one embodiment, the method further includes:

[0021] For the newly added category type, the compression type of the category type is determined based on any one of the multiple compression strategies;

[0022] If the compression type of the classification type is compressible, then the target compression strategy corresponding to the classification type is determined from the plurality of compression strategies.

[0023] If the compression type of the classification type is incompressible, it is determined that there is no corresponding target compression strategy for the classification type, and the business data under the classification type is transmitted transparently.

[0024] The method further includes:

[0025] For existing classification types, if there is no corresponding target compression strategy for the classification type, the business data under the classification type is transmitted transparently.

[0026] In one embodiment, determining the compression type of the classification type based on any one of the plurality of compression strategies includes:

[0027] Based on the business data under the aforementioned classification type, determine the compression ratio of any compression strategy corresponding to the aforementioned classification type;

[0028] If the compression ratio meets the preset compression ratio condition, the compression type of the classification type is determined to be compressible; if the compression ratio does not meet the compression ratio condition, the compression type of the classification type is determined to be incompressible.

[0029] In one embodiment, the data transmission system includes a switch and a compression / decompression device; the switch stores a mapping table between classification types and compression strategies; the compression / decompression device stores the plurality of compression strategies;

[0030] The step of transmitting business data under the classification type based on the target compression strategy corresponding to the classification type includes:

[0031] Based on the switch and the corresponding relationship table stored in the switch, the compression strategy identifier of the target compression strategy corresponding to the classification type is added to the service data under the classification type, and the service data with the added compression strategy identifier is transmitted to the compression / decompression device through the switch;

[0032] Based on the compression / decompression device and the service data with the added compression policy identifier transmitted by the switch, the target compression policy is determined from the multiple compression policies stored in the compression / decompression device, and the service data with the added compression policy identifier is compressed / decompressed using the compression / decompression device and the target compression policy, and the compressed / decompressed service data is then transmitted.

[0033] In one embodiment, the method further includes:

[0034] If the classification type is a newly added classification type, the corresponding relationship table stored by the switch is updated based on the classification type and the target compression strategy corresponding to the classification type.

[0035] Secondly, this application also provides a data transmission apparatus, comprising:

[0036] The business data classification module is used to classify the business data to be transmitted and obtain the classification type corresponding to the business data.

[0037] The first data transmission module is used to determine the target compression strategy corresponding to the classification type from a set of preset compression strategies when the classification type is a newly added classification type, and to transmit the business data under the classification type based on the target compression strategy corresponding to the classification type.

[0038] The second data transmission module is used to transmit business data under the classification type based on the target compression strategy corresponding to the classification type when the classification type is an existing classification type.

[0039] Thirdly, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0040] The service data to be transmitted is classified to obtain the classification type corresponding to the service data;

[0041] When the classification type is a newly added classification type, the target compression strategy corresponding to the classification type is determined from a plurality of preset compression strategies, and the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type.

[0042] If the classification type is an existing classification type, the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type.

[0043] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, performs the following steps:

[0044] The service data to be transmitted is classified to obtain the classification type corresponding to the service data;

[0045] When the classification type is a newly added classification type, the target compression strategy corresponding to the classification type is determined from a plurality of preset compression strategies, and the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type.

[0046] If the classification type is an existing classification type, the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type.

[0047] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, performs the following steps:

[0048] The service data to be transmitted is classified to obtain the classification type corresponding to the service data;

[0049] When the classification type is a newly added classification type, the target compression strategy corresponding to the classification type is determined from a plurality of preset compression strategies, and the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type.

[0050] If the classification type is an existing classification type, the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type.

[0051] The aforementioned data transmission method, apparatus, computer equipment, computer-readable storage medium, and computer program product first classify the business data to be transmitted to obtain the classification type corresponding to the business data; then, if the classification type is a newly added classification type, a target compression strategy corresponding to the classification type is determined from a plurality of preset compression strategies, and the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type; or, if the classification type is an existing classification type, the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type. In this way, by classifying business data, the classification types of the business data can be obtained. When the classification type of the business data is a newly added type, a corresponding target compression strategy is determined among multiple compression strategies for the newly added type. Thus, data transmission can be performed on the business data under the newly added type based on the target compression strategy corresponding to the new type. When the classification type of the business data is an existing type, data transmission can be performed on the business data under the existing type based on the target compression strategy corresponding to the existing type. Based on the data transmission method described above, corresponding target compression strategies are configured for business data of different classification types, avoiding the influence of subjective factors on the accuracy of compression strategy configuration. This allows for maximum compression of business data, thereby improving the utilization rate of bandwidth resources. Attached Figure Description

[0052] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0053] Figure 1 This is an application environment diagram of a data transmission method in one embodiment;

[0054] Figure 2 This is a flowchart illustrating a data transmission method in one embodiment;

[0055] Figure 3 This is a flowchart illustrating the steps of determining a target compression strategy corresponding to a classification type from a plurality of preset compression strategies, and then using the target compression strategy corresponding to the classification type as a basis in one embodiment.

[0056] Figure 4 This is a flowchart illustrating the steps for determining the weight of each compressed feature corresponding to the classification type in one embodiment.

[0057] Figure 5 This is a flowchart illustrating an intelligent compression method based on data center wide area network services in one embodiment.

[0058] Figure 6 Another embodiment is a flowchart illustrating an intelligent compression method based on data center wide area network services;

[0059] Figure 7 This is a structural block diagram of a data transmission device in one embodiment;

[0060] Figure 8 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0061] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0062] It should also be noted that the data transmission methods, systems, devices, computer equipment, storage media, and computer program products provided in this application can be applied to the financial technology field, for example, to support business data transmission between multiple data centers in the financial industry, improve the utilization of bandwidth resources and data transmission efficiency, thereby improving the data transmission performance between data centers; they can also be used in other related fields, such as in the field of computer technology, to support batch data replication and off-site disaster recovery replication, improve the utilization of bandwidth resources and data transmission efficiency, thereby improving the performance of batch data replication and enhancing off-site disaster recovery capabilities.

[0063] The data transmission method provided in this application embodiment can be applied to, for example... Figure 1 The application scenario shown includes a data transmitter 110, a data receiver 120, and a data transmission system 130 for data transmission. The data transmission system 130 includes a controller 132, a switch 134, and a compression / decompression device 136. The controller 132, the switch 134, and the compression / decompression device 136 communicate with each other via a network.

[0064] The controller 132 can be a server or a terminal; the server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services; the terminal can be, but is not limited to, various personal computers, laptops, smartphones and tablets, etc.

[0065] Here, switch 134 refers to a device used in the data transmission field for transmitting data packets between different devices. See also... Figure 1 Switch 134 includes a switch corresponding to the sending end and a switch corresponding to the receiving end.

[0066] Among them, compression / decompression device 136 refers to a device used in the field of data transmission for compressing or decompressing data packets. (See also...) Figure 1 The compression / decompression device 136 includes a compression / decompression device corresponding to the sending end and a compression / decompression device corresponding to the receiving end.

[0067] Specifically, the controller 132 in the data transmission system 130 first classifies the service data to be transmitted to obtain the classification type corresponding to the service data. Then, if the classification type is a newly added classification type, the controller 132 determines the target compression strategy corresponding to the classification type from a number of preset compression strategies, and transmits the service data under the classification type based on the target compression strategy corresponding to the classification type through the switch 134 and the compression / decompression device 136. Alternatively, if the classification type is an existing classification type, the controller 132 transmits the service data under the classification type based on the target compression strategy corresponding to the classification type through the switch 134 and the compression / decompression device 136.

[0068] In one exemplary embodiment, such as Figure 2 As shown, a data transmission method is provided, which is applied to... Figure 1 The data transmission system described herein, taking a business transmission scenario between multiple data centers in multiple locations of a bank as a specific application scenario, is illustrated. This data transmission system includes a controller, a switch, and compression / decompression devices. The method includes the following steps:

[0069] Step S202: Classify the service data to be transmitted to obtain the classification type corresponding to the service data.

[0070] Among them, business data refers to business data stored in data centers; it is understandable that frequent business data transfers are usually required between multiple locations and data centers for business needs or disaster recovery backup needs.

[0071] Among them, there is at least one type of business data to be transmitted; each type of business data corresponds to a classification type.

[0072] Specifically, the controller classifies at least one type of service data to be transmitted from the data center, which is the sending end, to obtain the classification type corresponding to each type of service data. Through the classification of service data, the controller can divide at least one type of service data into at least one set of service data, and each set of service data corresponds to a classification type.

[0073] In practical applications, the controller can classify at least one set of business data to obtain at least one set of business data; each set of business data corresponds to a classification type, thereby obtaining the classification type corresponding to each set of business data.

[0074] Following step S202, the following steps S204 or S206 are also included:

[0075] Step S204: When the classification type is a newly added classification type, determine the target compression strategy corresponding to the classification type from multiple preset compression strategies, and transmit the business data under the classification type based on the target compression strategy corresponding to the classification type.

[0076] The newly added classification type refers to a classification type that has not appeared in the classification process of previous data transmission processes. For example, if classification type 1, classification type 2 and classification type 3 have appeared in the classification process of previous data transmission processes, and classification type 4 is obtained in this classification process, then classification type 4 is the newly added classification type.

[0077] The target compression strategy for each classification type is the optimal compression strategy for that classification type.

[0078] Specifically, the controller records the classification types that occur during the classification processing in each data transmission process. Therefore, after obtaining the classification types corresponding to each service data to be transmitted, the controller determines whether the classification type obtained from each classification process is a newly added classification type. If it is a newly added classification type, the controller determines the optimal compression strategy corresponding to the newly added classification type from a set of preset compression strategies, and uses it as the target compression strategy for the newly added classification type. Then, based on the switch, compression / decompression devices, and the target compression strategy for the newly added classification type, the controller compresses and transmits the service data under the newly added classification type.

[0079] Step S206: If the classification type is an existing classification type, the business data under the classification type is transmitted based on the target compression strategy corresponding to the classification type.

[0080] Among them, the existing classification type refers to the classification type that has appeared in the classification process of previous data transmission processes; for example, assuming that classification type 1, classification type 2 and classification type 3 have appeared in the classification process of previous data transmission processes, and classification type 1 is obtained in this classification process, then classification type 1 is the existing classification type.

[0081] Among them, the target compression strategy corresponding to the existing classification type is the target compression strategy determined for it during each data transmission process.

[0082] Specifically, the controller determines whether the classification type obtained from each classification process is a newly added classification type; if it is not a newly added classification type, that is, an existing classification type, it directly determines the target compression strategy corresponding to the existing classification type, and then compresses and transmits the service data under the existing classification type based on the switch, compression / decompression equipment and the target compression strategy corresponding to the existing classification type.

[0083] In practical applications, the controller can determine whether the category type corresponding to each business data is a newly added category type after obtaining the category type corresponding to each business data, and determine the corresponding target compression strategy, and then transmit the business data under that category type. Alternatively, the controller can obtain the category types corresponding to all business data, and then determine whether each category type is a newly added category type, determine the corresponding target compression strategy, and then transmit the business data under that category type.

[0084] In the above data transmission method, the controller first classifies the service data to be transmitted to obtain the classification type corresponding to the service data; then, if the classification type is a newly added classification type, the controller determines the target compression strategy corresponding to the classification type from a number of preset compression strategies, and transmits the service data under the classification type based on the target compression strategy corresponding to the classification type; or, if the classification type is an existing classification type, the controller transmits the service data under the classification type based on the target compression strategy corresponding to the classification type. In this way, the controller can classify the business data to obtain its classification type. If the classification type is a newly added type, the controller determines the corresponding target compression strategy among multiple compression strategies. This allows the controller to transmit data under the newly added classification type based on the target compression strategy. Conversely, if the classification type is an existing type, the controller transmits data under that existing type based on the target compression strategy. This data transmission method configures corresponding target compression strategies for different classification types of business data, avoiding the influence of subjective factors on the accuracy of compression strategy configuration. This maximizes the compression of business data and improves bandwidth resource utilization.

[0085] In one exemplary embodiment, such as Figure 3As shown, in step S204 above, the target compression strategy corresponding to the classification type is determined from a plurality of preset compression strategies, and based on the target compression strategy corresponding to the classification type, the specific steps include:

[0086] Step S302: Based on the business data under the classification type, determine the compression feature values ​​of each compression strategy corresponding to multiple preset compression features under the classification type.

[0087] Step S304: Based on the weight of each compressed feature corresponding to the classification type, the multiple compressed feature values ​​corresponding to each compression strategy are fused to obtain the compression priority of each compression strategy corresponding to the classification type.

[0088] Step S306: Among the multiple compression strategies, the compression strategy with a higher compression priority than the other compression strategies is determined as the target compression strategy corresponding to the classification type.

[0089] Among them, compression features are used to characterize the compression performance of the compression strategy, and compression feature values ​​are used to characterize the degree of superiority or inferiority of the compression performance of the compression strategy.

[0090] In this system, each classification type corresponds to a weight for each compressed feature, representing the importance of each compressed feature within that classification type. It's easy to understand that different classification types have different characteristics; therefore, their compression performance requirements differ, and consequently, the weights for each compressed feature vary across different classification types.

[0091] Specifically, for each newly added category type, the controller performs simulated compression on the business data under that category type, corresponding to each compression strategy, to obtain the compressed business data for each compression strategy under that category type. Based on the compressed business data under each compression strategy, the controller obtains the compression feature values ​​for each compression strategy corresponding to the newly added category type and multiple preset compression features.

[0092] In practical applications, if a new category contains multiple business data, the controller can obtain multiple compression feature values ​​corresponding to that new category based on any one of the business data. For example, the controller selects any one business data from the multiple business data and performs simulated compression on that business data corresponding to each compression strategy to obtain the compressed business data corresponding to that compression strategy. Based on the compressed business data corresponding to that compression strategy, the controller obtains multiple compression feature values ​​of that compression strategy under that business data and uses these multiple compression feature values ​​as the multiple compression feature values ​​of that compression strategy under the new category.

[0093] Alternatively, the controller can obtain multiple compression feature values ​​under the newly added classification type based on all business data. For example, the controller performs simulated compression for each business data corresponding to each compression strategy to obtain compressed business data for each business data corresponding to each compression strategy. Based on the compressed business data for each business data corresponding to each compression strategy, the controller obtains multiple compression feature values ​​for each compression strategy under each business data. Then, for each compression feature, based on the distribution of compression feature values ​​corresponding to the compression feature under each business data (e.g., average compression feature value), the controller obtains the compression feature value corresponding to the compression feature under the newly added classification type for each compression strategy.

[0094] Then, the controller determines the weight of each compressed feature corresponding to the newly added classification type, and for each compression strategy, it fuses multiple compressed feature values ​​corresponding to the compression strategy based on the weight of each compressed feature corresponding to the newly added classification type to obtain the compression priority of the compression strategy corresponding to the newly added classification type.

[0095] Finally, the controller determines the compression strategy with the highest compression priority among all compression strategies as the target compression strategy for the newly added category.

[0096] In practical applications, the preset compression features include at least two of the following: latency, bandwidth, compression strategy performance, compression ratio, and service throughput. The compression strategy performance can be characterized by the compression / decompression speed of the compression strategy, such as the amount of data processed per second by the compression strategy.

[0097] In this embodiment, the controller determines the weights of each compression feature for different classification types. Based on the weights of each compression feature corresponding to each new classification type, the controller fuses the compression feature values ​​corresponding to each compression feature for each compression strategy, obtaining the compression priority of each compression strategy for each new classification type. This allows for the measurement of the compression performance of each compression strategy for each new classification type, thereby determining the optimal compression strategy for each new classification type. Based on this process, the optimal target compression strategy can be configured for business data of different classification types, avoiding the influence of subjective factors on the accuracy of compression strategy configuration. This maximizes the compression of business data and improves the utilization of bandwidth resources.

[0098] In an exemplary embodiment, step S202 above, which involves classifying the service data to be transmitted to obtain a classification type corresponding to the service data, specifically includes the following: performing a first classification process on the service data based on the attribute information of the service data to obtain a first classification type corresponding to the service data; and performing a second classification process on the service data based on the transmission address corresponding to the service data to obtain a second classification type under the first classification type, which serves as the classification type corresponding to the service data.

[0099] The attribute information of the business data shall include at least one of the business type and data type; the business type shall include at least interactive business type, batch business type, office business type, etc.; the data type shall include at least voice, image, video, etc.

[0100] The transmission address corresponding to the business data refers to the IP (Internet Protocol Address) or IP network segment of the sending end and / or receiving end of the business data.

[0101] The controller in the data transmission system performs classification processing on service data, including first classification processing and second classification processing. Specifically, the controller first performs first classification processing on each service data according to its attribute information (service type and data type), resulting in multiple first data sets. The service data in each first data set has the same attribute information, and each first data set corresponds to a first classification type, thus obtaining the first classification type corresponding to each service data. Then, for each first data set, the controller performs second classification processing on the service data in that first data set according to the transmission address (IP address or IP network segment of the sending end and / or receiving end), classifying the first data set into multiple second data sets. The service data in each second data set has the same transmission address, and each second data set corresponds to a second classification type, thus obtaining the second classification type of each service data under its corresponding first classification type, and using the second classification type corresponding to each service data as the classification type corresponding to that service data.

[0102] In practical applications, the controller can identify the category type of business data through type labels, so that business data with the same type label belong to the same category type.

[0103] In this embodiment, the controller can classify service data according to its service type, data format, and corresponding transmission address. This allows multiple service data to be divided into multiple categories based on their service type, data format, and corresponding transmission address. This facilitates the determination of the optimal compression strategy for each category and the transmission of service data within that category based on the optimal compression strategy. This enables the compression of service data as much as possible, thereby improving the utilization rate of bandwidth resources.

[0104] In one exemplary embodiment, such as Figure 4 As shown, in step S304 above, before fusing multiple compressed feature values ​​corresponding to each compression strategy based on the weight of each compressed feature corresponding to the classification type to obtain the compression priority of each compression strategy corresponding to the classification type, the following steps are also included: determining the first classification type corresponding to the classification type; determining the weight of each compressed feature corresponding to the first classification type; and determining the weight of each compressed feature corresponding to the first classification type as the weight of each compressed feature corresponding to the classification type.

[0105] Specifically, for each first classification type, the controller presets a weight corresponding to each compression feature for that first classification type. Therefore, when the controller determines the compression priority of each compression strategy corresponding to the classification type for a newly added classification type, it needs to first determine the first classification type to which the newly added classification type (second classification type) belongs, and then determine the weight of the first classification type corresponding to each compression feature, as the weight of the newly added classification type (second classification type) corresponding to each compression feature.

[0106] For example, suppose that the preset compression features include at least latency, bandwidth, compression strategy performance, compression ratio, and service throughput; for interactive service data, since it is sensitive to latency and has high latency requirements, the weight corresponding to latency can be set higher; for batch service data, since its unidirectional data volume is large, the weight corresponding to bandwidth can be set higher.

[0107] In practical applications, for the first category type without special requirements, the weight can be set according to the default value.

[0108] In this embodiment, the controller determines the weights corresponding to each compression feature for each first category, thereby fully considering the data compression and data transmission needs of different first category business data. This enables the controller to accurately configure the optimal compression strategy for each type of business data, avoiding the influence of subjective factors on the accuracy of the compression strategy configuration. As a result, the controller can compress the business data as much as possible, thereby improving the utilization rate of bandwidth resources.

[0109] In an exemplary embodiment, step S204 above, before determining the target compression strategy corresponding to the category type from a plurality of preset compression strategies, specifically includes the following: for the newly added category type, determining the compression type of the category type based on any one of the plurality of compression strategies; if the compression type of the category type is compressible, determining the target compression strategy corresponding to the category type from the plurality of compression strategies; if the compression type of the category type is incompressible, determining that there is no corresponding target compression strategy for the category type, and transparently transmitting the business data under the category type.

[0110] The compression type is used to characterize whether the business data under the classification type is compressible, including compressible and incompressible.

[0111] Specifically, when the classification type is a newly added classification type, the controller randomly selects a compression strategy from multiple compression strategies. Based on the randomly selected compression strategy, it simulates compression of the business data under the newly added classification type. Based on the compression result of the business data under the newly added classification type, it determines whether the newly added classification type is compressible. If the newly added classification type is compressible, it determines the target compression strategy corresponding to the newly added classification type from multiple compression strategies. If the newly added classification type is not compressible, it determines that there is no corresponding target compression strategy for the newly added classification type, and does not perform any compression processing on the business data under the newly added classification type, and directly transmits the data.

[0112] In practical applications, similar to determining the compression priority of each compression strategy corresponding to a category type, if there are multiple business data under a newly added category type, the controller can determine the newly added category type based on any one of the business data under the newly added category type, or the controller can determine the newly added category type based on all the business data under the newly added category type.

[0113] In step S206 above, the business data under the category type is transmitted based on the target compression strategy corresponding to the category type. Specifically, this includes the following: for existing category types, if there is no corresponding target compression strategy for the category type, the business data under the category type is transmitted transparently.

[0114] In this case, the classification type does not have a corresponding target compression strategy, which can also be understood as the target compression strategy corresponding to the classification type being empty.

[0115] Specifically, if a category type is determined to be incompressible based on any compression strategy when it first appears, then there is no corresponding target compression strategy for that category type. Therefore, when the category type is an existing category type, the controller determines whether there is a corresponding target compression strategy for that existing category type. If there is no corresponding target compression strategy for that existing category type, that is, the target compression strategy for that existing category type is empty, then the controller does not perform any compression processing on the business data under that existing category type and directly transmits the data.

[0116] In this embodiment, it is easy to understand that not all data can be compressed. By judging the compression type of the newly added category, the controller can determine whether the business data under the newly added category is compressible, thereby avoiding unnecessary compression of incompressible data. In this way, it can accurately configure the correct optimal compression strategy for each category of business data, avoiding the influence of subjective factors on the accuracy of compression strategy configuration, thereby compressing business data as much as possible and improving the utilization rate of bandwidth resources.

[0117] In an exemplary embodiment, the above steps determine the compression type of the category based on any one of the multiple compression strategies, specifically including the following: based on the business data under the category, determine the compression ratio of any compression strategy corresponding to the category; if the compression ratio meets the preset compression ratio condition, determine the compression type of the category as compressible; if the compression ratio does not meet the compression ratio condition, determine the compression type of the category as incompressible.

[0118] The compression ratio is the ratio between the amount of business data before compression and the amount of business data after compression. In this application, the compression ratio is the result of the ratio of the amount of business data before compression to the amount of business data after compression, and the compression ratio is greater than the first preset compression ratio as the preset compression ratio condition. The first preset compression ratio is at least 1.

[0119] Specifically, for a newly added category type, the controller determines the compression type of the newly added category type through the following process: First, the controller simulates compression of the business data under the newly added category type based on a randomly selected compression strategy to obtain the compressed business data corresponding to the business data under the newly added category type. Based on the business data and the compressed business data, the controller calculates the ratio of the data volume before compression to the data volume after compression to obtain the compression ratio corresponding to the newly added category type for the randomly selected compression strategy. Then, the controller determines whether the compression ratio is greater than a first preset compression ratio. If it is greater than 1, the controller determines that the compression ratio meets the preset compression ratio condition and determines the compression type of the newly added category type as compressible. If it is not greater than 1, the controller determines that the compression ratio does not meet the preset compression ratio condition and determines the compression type of the newly added category type as incompressible.

[0120] It is easy to understand that the compression ratio can also be the result of the amount of business data after compression and the amount of business data before compression. Then, the compression ratio is less than the second preset compression ratio as the preset compression ratio condition; where the second preset compression ratio is at most 1.

[0121] In practical applications, similar to determining the compression priority of each compression strategy corresponding to a category type, if there are multiple business data under a newly added category type, the controller can determine the compression ratio corresponding to the newly added category type based on any one of the business data under the newly added category type. For example, the controller randomly selects a compression strategy from the compression strategies, randomly selects a business data from the business data under the newly added category type, and then performs simulated compression on the randomly selected business data based on the randomly selected compression strategy. The compression ratio of the randomly selected business data is then calculated based on the compressed business data corresponding to the randomly selected business data, and this compression ratio is used as the compression ratio corresponding to the newly added category type.

[0122] Alternatively, the controller can determine the compression ratio corresponding to the newly added category based on all business data under the new category. For example, the controller randomly selects a compression strategy, then performs simulated compression on each piece of business data based on the randomly selected compression strategy, and calculates the compression ratio corresponding to each piece of business data based on the compressed business data (when using the result of the quantity of business data before compression and the quantity of business data after compression as the compression ratio). Then, the minimum compression ratio among the compression ratios corresponding to each piece of business data is taken as the compression ratio corresponding to the category (when using the result of the quantity of business data after compression and the quantity of business data before compression as the compression ratio, the maximum compression ratio is taken as the compression ratio corresponding to the category).

[0123] In this embodiment, the controller simulates compression of business data under the newly added category type using any compression strategy, and can obtain the compression ratio of the newly added category type corresponding to the arbitrary compression strategy, thereby determining whether the business data under the newly added category type is compressible.

[0124] In one exemplary embodiment, see Figure 1 The data transmission system includes switches and compression / decompression devices; the switches store a table of correspondence between classification types and compression strategies; the compression / decompression devices store multiple compression strategies.

[0125] Among them, see Figure 1 The switch includes the switch corresponding to the sending end and the switch corresponding to the receiving end. The compression / decompression device includes the compression / decompression device corresponding to the sending end and the compression / decompression device corresponding to the receiving end.

[0126] See Figure 1 The controller is also used to distribute multiple preset compression strategies to various compression / decompression devices.

[0127] In step S204 above, when the classification type is a newly added classification type, after determining the target compression strategy corresponding to the classification type from multiple preset compression strategies, the following content is also included: when the classification type is a newly added classification type, the corresponding relationship table stored by the switch is updated based on the classification type and the target compression strategy corresponding to the classification type.

[0128] The correspondence table stored in the switch is used to record the correspondence between each category type and its corresponding target compression strategy.

[0129] See Figure 1 Specifically, during the initial classification process, after determining the corresponding target compression strategy for the classification type obtained from this classification process, the controller creates a mapping table to record the correspondence between each classification type and its corresponding target compression strategy, and distributes the mapping table to each switch. Then, for each new classification type added in each data transmission, after determining the target compression strategy corresponding to the new classification type, the controller updates the mapping table stored in each switch according to the new classification type and its corresponding target compression strategy.

[0130] In this embodiment, by updating the correspondence table stored in the switch, the controller can ensure that subsequent compression / decompression processing can be performed on each service data based on the switch and compression / decompression devices, thereby realizing the data transmission of each service data.

[0131] In one exemplary embodiment, such as Figure 4 As shown, the target compression strategy based on the classification type in step S204 or step S206 above, which transmits business data under the classification type, specifically includes the following steps:

[0132] Step S402: Based on the correspondence table between the switch and the switch, add the compression strategy identifier of the target compression strategy corresponding to the category type to the service data under the category type, and transmit the service data with the added compression strategy identifier to the compression / decompression device through the switch.

[0133] Step S404: Based on the service data with added compression policy identifier transmitted by the compression / decompression device and the switch, determine the target compression policy from multiple compression policies stored in the compression / decompression device, and perform compression / decompression processing on the service data with added compression policy identifier through the compression / decompression device and the target compression policy, and then transmit the compressed / decompressed service data.

[0134] See Figure 1 The complete data transmission flow is as follows: the sending end sends the service data to the corresponding switch, the corresponding switch then transmits the service data to the corresponding compression / decompression device, the corresponding compression / decompression device compresses the service data, and transmits the compressed service data through the wide area network to the corresponding switch, the corresponding switch transmits the compressed service data to the corresponding compression / decompression device, the corresponding compression / decompression device decompresses the compressed service data, and transmits the decompressed service data to the receiving end.

[0135] In practical applications, controllers can identify the classification type of business data using type labels.

[0136] Specifically, after determining the target compression strategy corresponding to each classification type obtained from this classification process, the controller officially starts the data transmission of each service data to be transmitted:

[0137] The sending end first sends the service data to the corresponding switch. Based on the stored correspondence table and the type tag carried by the service data, the corresponding switch adds the compression strategy identifier of the target compression strategy corresponding to the category type to which the service data belongs to the service data to the service data. Then, the service data with the added compression strategy identifier is transmitted to the compression / decompression device corresponding to the sending end.

[0138] The compression / decompression device at the sending end determines the target compression policy corresponding to the category of the service data from its stored multiple compression policies based on the compression policy identifier carried by the service data with the added compression policy identifier. It then compresses the service data with the added compression policy identifier based on the target compression policy and transmits the compressed service data to the corresponding switch at the receiving end through the wide area network.

[0139] The switch at the receiving end transmits the compressed service data to the corresponding compression / decompression device at the receiving end. Based on the compression strategy identifier carried by the compressed service data, the compression / decompression device at the receiving end determines the target compression strategy corresponding to the category type of the service data from its stored multiple compression strategies, and decompresses the compressed service data based on the target compression strategy before transmitting the decompressed service data to the receiving end.

[0140] In this embodiment, the data control system stores a correspondence table between classification types and compression strategies through a switch, and stores multiple compression strategies through a compression / decompression device. This enables the determination of the target compression strategy and the compression / decompression processing based on the target compression strategy to be implemented through the switch and the compression / decompression device respectively during the data transmission process, thereby reducing the workload of each device involved in data transmission.

[0141] To more clearly illustrate the data transmission method provided in the embodiments of this application, the following specific embodiment is used to describe the data transmission method in detail. However, it should be understood that the embodiments of this application are not limited thereto. In one exemplary embodiment, such as Figure 5 As shown, this application also provides an intelligent compression method based on data center wide area network services, specifically including the following steps:

[0142] Step S502: Based on the attribute information of the business data to be transmitted, perform a first classification process on the business data to obtain the first classification type corresponding to the business data.

[0143] Specifically, the controller connects to multiple data centers across various financial locations, automatically collecting business data to be transmitted from each data center. Based on the attribute information of the business data, it performs coarse classification on the multiple business data sets, resulting in multiple first business data sets; each first business data set corresponds to a first classification type.

[0144] Step S504: Based on the transmission address corresponding to the service data, perform a second classification process on the service data to obtain a second classification type under the first classification type, which is used as the classification type corresponding to the service data.

[0145] Specifically, the controller further classifies each first service data set based on the transmission address corresponding to the service data to obtain multiple second service data sets, each second service data set corresponding to a second classification type; the second classification type of each service data is the classification type corresponding to that service data.

[0146] Following step S504, the method further includes steps S506 to S514, or step S516:

[0147] Step S506: When the classification type is a newly added classification type, based on the business data under the classification type, determine the compression ratio of any one of the multiple compression strategies corresponding to the classification type.

[0148] Specifically, the controller imports multiple available compression algorithms and uses compression algorithm tags to represent each compression algorithm, obtaining a first relationship table to record the correspondence between each compression algorithm and its corresponding compression algorithm tag. The controller then distributes the multiple compression algorithms and the first relationship table to each compression / decompression device. For each second service data set, a compression algorithm is randomly selected to simulate compression of the second service data set, and it is determined whether the second service data set has compression capability.

[0149] Following step S506, the following steps S508 or S510 to S514 are also included:

[0150] Step S508: If the compression ratio does not meet the compression ratio condition, the compression type of the category is determined to be incompressible, it is determined that there is no corresponding target compression strategy for the category, and the business data under the category is transmitted transparently.

[0151] Specifically, for the second business data set with a compression ratio of 1, it is determined that the business data under this second business data set is incompressible, requires no processing, and can be directly transmitted.

[0152] Step S510: If the compression ratio meets the preset compression ratio conditions, the compression type of the classification type is determined to be compressible. Based on the business data under the classification type, the compression feature values ​​of each compression strategy corresponding to multiple preset compression features under the classification type are determined.

[0153] Specifically, for a second service data set with a compression ratio > 1, the service data under this second service data set is determined to be compressible; the controller simulates compression of the second service data set using different compression algorithms to obtain compression characteristic values ​​such as service throughput, latency, compression algorithm performance, compression ratio, and bandwidth corresponding to different compression algorithms.

[0154] Step S512: Based on the weight of each compressed feature corresponding to the first classification type, the multiple compressed feature values ​​corresponding to each compression strategy are fused to obtain the compression priority of each compression strategy corresponding to the classification type.

[0155] Specifically, the controller controls the transmission and compression requirements based on different first classification types, and sets weights corresponding to each compression feature for each first classification type. For each second service data set, the controller performs weighted fusion of each compression feature value corresponding to different compression algorithms based on the weights corresponding to the first classification type to which the second service data set belongs, to obtain the compression priority of each compression algorithm for the second service data set.

[0156] Step S514: Among multiple compression strategies, the compression strategy with a higher compression priority than the other compression strategies is determined as the target compression strategy corresponding to the classification type. Based on the classification type and the target compression strategy corresponding to the classification type, the corresponding relationship table stored in the switch is updated.

[0157] Specifically, for each second service data set, the compression algorithm with the highest compression priority is determined as the target compression algorithm for that second service data set. Based on the second service data set and its corresponding target compression algorithm, the second relationship table, which records the correspondence between the compression algorithm labels of each second service data set and its corresponding target compression algorithm, is updated, and the second relationship table is distributed to each switch /

[0158] Step S516: If the classification type is an existing classification type, determine the target compression strategy corresponding to the classification type.

[0159] Specifically, for a second set of service data that has already appeared, the controller directly determines the target compression strategy corresponding to that second set of service data.

[0160] Following step S514 or step S516, the steps S518 to S520 are also included.

[0161] Step S518: Based on the correspondence table between the switch and the switch, add the compression strategy identifier of the target compression strategy corresponding to the category type to the service data under the category type, and transmit the service data with the added compression strategy identifier to the compression and decompression device through the switch.

[0162] Specifically, the switch uses the second relationship table issued by the controller to tag the service data to be transmitted with the corresponding compression algorithm label.

[0163] Step S520: Based on the service data with added compression policy identifier transmitted by the compression / decompression device and the switch, determine the target compression policy from multiple compression policies stored in the compression / decompression device, and perform compression / decompression processing on the service data with added compression policy identifier using the compression / decompression device and the target compression policy, and then transmit the compressed / decompressed service data.

[0164] Specifically, the compression / decompression device identifies the compression algorithm tag carried by the service data, and uses the corresponding target compression algorithm to compress / decompress the service data according to the first relationship table issued by the controller.

[0165] like Figure 6 The diagram shown is another flowchart illustrating the intelligent compression method based on data center WAN services provided in this embodiment.

[0166] In this embodiment, firstly, since financial wide area network services rely on manual experience for pre-configured static settings, making it difficult to accurately determine whether service data is compressible, this embodiment uses compression ratio to pre-determine whether service data is compressible. Secondly, since static configuration cannot accurately describe service types to achieve precise matching between service data and compression algorithms, this embodiment comprehensively compares the advantages and disadvantages of different compression algorithms to achieve precise matching of the optimal compression algorithm. Thirdly, addressing the issue that operations and maintenance personnel cannot promptly and effectively assess newly added service scenarios, this embodiment supports real-time policy updates, reducing the workload of operations and maintenance personnel.

[0167] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0168] Based on the same inventive concept, this application also provides a data transmission apparatus for implementing the data transmission method described above. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, specific limitations in one or more data transmission apparatus embodiments provided below can be found in the limitations of the data transmission method described above, and will not be repeated here.

[0169] In one exemplary embodiment, such as Figure 7 As shown, a data transmission device is provided, including: a business data classification module 702, a first data transmission module 704, and a second data transmission module 706, wherein:

[0170] The business data classification module 702 is used to classify the business data to be transmitted and obtain the classification type corresponding to the business data.

[0171] The first data transmission module 704 is used to determine the target compression strategy corresponding to the category type from a set of preset compression strategies when the category type is a newly added category type, and to transmit the business data under the category type based on the target compression strategy corresponding to the category type.

[0172] The second data transmission module 706 is used to transmit business data under an existing classification type based on the target compression strategy corresponding to the classification type.

[0173] In an exemplary embodiment, the first data transmission module 704 is further configured to: determine, based on the business data under the classification type, the compression feature values ​​of each compression strategy corresponding to a plurality of preset compression features under the classification type; perform fusion processing on the plurality of compression feature values ​​corresponding to each compression strategy based on the weight of each compression feature corresponding to the classification type to obtain the compression priority of each compression strategy corresponding to the classification type; and determine the compression strategy whose corresponding compression priority is higher than the compression priority of the other compression strategies as the target compression strategy corresponding to the classification type.

[0174] In an exemplary embodiment, the business data classification module 702 is further configured to perform a first classification process on the business data based on the attribute information of the business data to obtain a first classification type corresponding to the business data; the attribute information of the business data includes at least one of the business type and data type of the business data; and perform a second classification process on the business data based on the transmission address corresponding to the business data to obtain a second classification type of the business data under the first classification type, which serves as the classification type corresponding to the business data.

[0175] In an exemplary embodiment, the first data transmission module 704 is further configured to determine a first classification type corresponding to the classification type; determine the weight of the first classification type corresponding to each compressed feature; and determine the weight of the first classification type corresponding to each compressed feature as the weight of the classification type corresponding to each compressed feature.

[0176] In an exemplary embodiment, the first data transmission module 704 is further configured to determine the compression type of the newly added classification type based on any one of a plurality of compression strategies; if the compression type of the classification type is compressible, determine the target compression strategy corresponding to the classification type from the plurality of compression strategies; if the compression type of the classification type is incompressible, determine that there is no corresponding target compression strategy for the classification type, and transparently transmit the business data under the classification type.

[0177] The second data transmission module 706 is also used to transparently transmit business data under an existing classification type when there is no corresponding target compression strategy for that classification type.

[0178] In an exemplary embodiment, the first data transmission module 704 is further configured to determine the compression ratio of any compression strategy corresponding to the category type based on the business data under the category type; if the compression ratio meets the preset compression ratio condition, the compression type of the category type is determined to be compressible; if the compression ratio does not meet the compression ratio condition, the compression type of the category type is determined to be incompressible.

[0179] In one exemplary embodiment, the data transmission system includes a switch and a compression / decompression device; the switch stores a mapping table between classification types and compression strategies; the compression / decompression device stores multiple compression strategies.

[0180] Both the first data transmission module 704 and the second data transmission module 706 are further configured to, based on the switch and the correspondence table stored in the switch, add the compression strategy identifier of the target compression strategy corresponding to the category type to the service data under the category type, and transmit the service data with the added compression strategy identifier to the compression / decompression device through the switch; based on the compression / decompression device and the service data with the added compression strategy identifier transmitted by the switch, determine the target compression strategy from multiple compression strategies stored in the compression / decompression device, and perform compression / decompression processing on the service data with the added compression strategy identifier through the compression / decompression device and the target compression strategy, and then transmit the compressed / decompressed service data.

[0181] In an exemplary embodiment, the first data transmission module 704 is further configured to update the correspondence table stored by the switch based on the classification type and the target compression strategy corresponding to the classification type when the classification type is a newly added classification type.

[0182] Each module in the aforementioned data transmission device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0183] In one exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 8 As shown, this computer device includes a processor, memory, input / output (I / O) interfaces, and a communication interface. The processor, memory, and I / O interfaces are connected via a system bus, and the communication interface is also connected to the system bus via the I / O interfaces. The processor provides computational and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides the environment for the operating system and computer programs stored in the non-volatile storage media. The database stores data such as various compression strategies, each category type, and its corresponding target compression strategy. The I / O interfaces are used for exchanging information between the processor and external devices. The communication interface is used for communicating with external terminals via a network connection. When the computer program is executed by the processor, it implements a data transmission method.

[0184] Those skilled in the art will understand that Figure 8 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0185] In one exemplary embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.

[0186] In one exemplary embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above-described method embodiments.

[0187] In one exemplary embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above-described method embodiments.

[0188] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0189] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0190] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A data transmission method, characterized by, Applied to a data transmission system, the method comprises: Classifying the service data to be transmitted to obtain a classification type corresponding to the service data; In the case that the classification type is a newly added classification type, determining a target compression strategy corresponding to the classification type from a plurality of preset compression strategies, and performing data transmission on the service data under the classification type based on the target compression strategy corresponding to the classification type; In the case that the classification type is an existing classification type, performing data transmission on the service data under the classification type based on the target compression strategy corresponding to the classification type; Wherein, determining a target compression strategy corresponding to the classification type from a plurality of preset compression strategies, and performing data transmission based on the target compression strategy corresponding to the classification type, comprises: determining, based on the service data under the classification type, a compression characteristic value corresponding to a plurality of preset compression characteristics for each compression strategy under the classification type; performing fusion processing on a plurality of compression characteristic values corresponding to each compression strategy based on the weight of each compression characteristic corresponding to the classification type to obtain a compression priority of each compression strategy corresponding to the classification type; and determining, as the target compression strategy corresponding to the classification type, a compression strategy corresponding to a compression priority higher than that of the remaining compression strategies among the plurality of compression strategies.

2. The method of claim 1, wherein, The classification processing of the service data to be transmitted to obtain a classification type corresponding to the service data comprises: Performing first classification processing on the service data based on attribute information of the service data to obtain a first classification type corresponding to the service data; the attribute information of the service data at least includes at least one of a service type and a data type of the service data; Performing second classification processing on the service data based on a transmission address corresponding to the service data to obtain a second classification type of the service data under the first classification type as the classification type corresponding to the service data.

3. The method of claim 2, wherein, Before the fusion processing on a plurality of compression characteristic values corresponding to each compression strategy based on the weight of each compression characteristic corresponding to the classification type to obtain a compression priority of each compression strategy corresponding to the classification type, the method further comprises: Determining a first classification type corresponding to the classification type; Determining the weight of each compression characteristic corresponding to the first classification type; Determining the weight of each compression characteristic corresponding to the first classification type as the weight of each compression characteristic corresponding to the classification type.

4. The method of claim 1, wherein, The method further comprises: For a newly added classification type, determining a compression type of the classification type based on any one of the plurality of compression strategies; In the case that the compression type of the classification type is compressible, determining a target compression strategy corresponding to the classification type from the plurality of compression strategies; In the case that the compression type of the classification type is incompressible, determining that there is no target compression strategy corresponding to the classification type, and performing transparent transmission on the service data under the classification type; The method further comprises: In a case where the classification type does not exist a corresponding target compression strategy, the service data under the classification type is transparently transmitted.

5. The method of claim 4, wherein, The compression type of the classification type is determined based on any one of the plurality of compression strategies, including: The compression ratio corresponding to the classification type of the any one compression strategy is determined based on the service data under the classification type; In a case where the compression ratio satisfies a preset compression ratio condition, the compression type of the classification type is determined as compressible, and in a case where the compression ratio does not satisfy the compression ratio condition, the compression type of the classification type is determined as incompressible.

6. The method according to any one of claims 1 to 5, characterized in that, The data transmission system includes a switch and a compression / decompression device; the switch stores a corresponding relationship table between classification types and compression strategies; and the compression / decompression device stores the plurality of compression strategies; The service data under the classification type is transmitted based on the target compression strategy corresponding to the classification type, including: Based on the switch and the corresponding relationship table stored in the switch, a compression strategy identifier of the target compression strategy corresponding to the classification type is added to the service data under the classification type, and the service data after adding the compression strategy identifier is transmitted to the compression / decompression device through the switch; Based on the compression / decompression device and the service data after adding the compression strategy identifier transmitted by the switch, the target compression strategy is determined from the plurality of compression strategies stored in the compression / decompression device, and the service data after adding the compression strategy identifier is compressed / decompressed by the compression / decompression device and the target compression strategy, and the service data after compression / decompression is transmitted.

7. The method of claim 6, wherein, The method further includes: In a case where the classification type is a newly added classification type, the corresponding relationship table stored in the switch is updated based on the classification type and the target compression strategy corresponding to the classification type.

8. A data transmission apparatus, characterized by comprising: The apparatus includes: A service data classification module configured to classify the service data to be transmitted to obtain a classification type corresponding to the service data; A first data transmission module configured to, in a case where the classification type is a newly added classification type, determine a target compression strategy corresponding to the classification type from a plurality of preset compression strategies, and transmit the service data under the classification type based on the target compression strategy corresponding to the classification type; A second data transmission module configured to, in a case where the classification type is an existing classification type, transmit the service data under the classification type based on the target compression strategy corresponding to the classification type; and A third data transmission module configured to, in a case where the classification type does not exist a corresponding target compression strategy, transparently transmit the service data under the classification type. The first data transmission module is further configured to: determine, based on the service data of the classification type, a compression characteristic value corresponding to a preset compression characteristic for each compression strategy under the classification type; perform fusion processing on the compression characteristic values corresponding to the multiple compression characteristics of each compression strategy based on the weight corresponding to each compression characteristic of the classification type, to obtain a compression priority corresponding to the classification type for each compression strategy; and determine, as a target compression strategy corresponding to the classification type, a compression strategy corresponding to a compression priority that is higher than the compression priorities corresponding to the remaining compression strategies among the multiple compression strategies. 9.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is configured to perform the method according to any one of claims 1-8 when the computer program is executed by the processor. The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 7.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 7.

11. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 7. The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 7.

Citation Information

Patent Citations

  • Neural network model compression method and device, equipment and medium

    CN114861910A

  • Data transmission method and device, electronic equipment and computer readable storage medium

    CN117319373A