Data transmission method and device, computer equipment, readable storage medium and program product

Abstract

The invention relates to a data transmission method and device, computer equipment, a computer readable storage medium and a computer program product. The method is applied to a network service system, and comprises the following steps: in response to a received data transmission instruction, determining a target data volume corresponding to the data transmission instruction; according to the target data volume, a communication data file corresponding to the network service data is obtained, an initial transmission file matched with the communication data file is generated, and the data volume of the communication data file is the target data volume; and periodically obtaining the initial transmission file according to a preset period, sending the initial transmission file to a target platform, and deleting the initial transmission file under the condition that the sending is completed. By adopting the method, the safety can be improved, and resources are saved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data transmission method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] With the rapid development of the Internet, more and more companies choose to deploy service products on the network for users to use. In order to ensure the security and reliability of the product, it can be monitored by network packet capture. Network packet capture is a network diagnosis and analysis technology. By capturing network data packets and analyzing them, you can understand the transmission of data packets in the network, evaluate network performance for network failures.

[0003] In the related art, the packet capture file can be obtained through the network packet capture module in the system and transmitted to the monitoring platform. However, this method requires large storage resources, it is difficult to achieve long-term packet capture, and the security and reliability of data services cannot be guaranteed. Summary of the invention

[0004] Based on this, it is necessary to provide a data transmission method, apparatus, computer device, computer-readable storage medium and computer program product that can improve security and save resources in response to the above technical problems.

[0005] In a first aspect, the present application provides a data transmission method, which is applied to a network service system and includes:

[0006] In response to receiving a data transmission instruction, determining a target data volume corresponding to the data transmission instruction;

[0007] According to the target data volume, acquiring a communication data file corresponding to the network service data, and generating an initial transmission file matching the communication data file, wherein the data volume of the communication data file is the target data volume;

[0008] The initial transmission file is periodically obtained according to a preset period and sent to the target platform. When the sending is completed, the initial transmission file is deleted.

[0009] In one embodiment, the periodically obtaining the initial transmission file and sending it to the target platform includes:

[0010] Periodically acquiring a plurality of initial transmission files corresponding to a current period, wherein the initial transmission files include data acquisition parameters and communication data;

[0011] Deleting data acquisition parameters in other files except the target file in the initial transmission file to obtain a processed initial transmission file;

[0012] The processed initial transmission file is sent to the target platform.

[0013] In one embodiment, the target file is determined by:

[0014] Determine the file generation time corresponding to each of the initial transmission files;

[0015] From the multiple initial transmission files, determine the initial transmission file with the earliest file generation time as the target file.

[0016] In one embodiment, in response to receiving a data transmission instruction, determining a target data volume corresponding to the data transmission instruction includes:

[0017] In response to receiving the data transmission instruction, determining a resource occupancy rate corresponding to the network service system;

[0018] When the resource occupancy rate is less than or equal to a preset threshold, a target data volume corresponding to the data transmission instruction is determined.

[0019] In one embodiment, determining the resource occupancy rate corresponding to the network service system includes:

[0020] Determining a target resource type according to the data transmission instruction;

[0021] An initial resource occupancy rate corresponding to the target resource type in the network service system is determined, and a resource occupancy rate is generated according to the initial resource occupancy rate.

[0022] In one embodiment, the method further comprises:

[0023] In response to the resource occupancy rate of the network service system being greater than a preset threshold, the acquisition of the communication data file is stopped.

[0024] In a second aspect, the present application further provides a data transmission device, which is applied to a network service system and includes:

[0025] A receiving module, configured to determine, in response to receiving a data transmission instruction, a target data volume corresponding to the data transmission instruction;

[0026] an acquisition module, configured to acquire a communication data file corresponding to the network service data according to the target data volume, and generate an initial transmission file matching the communication data file, wherein the data volume of the communication data file is the target data volume;

[0027] The sending module is used to periodically obtain the initial transmission file according to a preset period and send it to the target platform. When the sending is completed, the initial transmission file is deleted.

[0028] In one embodiment, the sending module is further used for:

[0029] Periodically acquiring a plurality of initial transmission files corresponding to a current period, wherein the initial transmission files include data acquisition parameters and communication data;

[0030] Deleting data acquisition parameters in other files except the target file in the initial transmission file to obtain a processed initial transmission file;

[0031] The processed initial transmission file is sent to the target platform.

[0032] In one of the embodiments, the device further comprises a module for determining the target file, and the module for determining the target file is configured to:

[0033] Determine the file generation time corresponding to each of the initial transmission files;

[0034] From the multiple initial transmission files, determine the initial transmission file with the earliest file generation time as the target file.

[0035] In one embodiment, the receiving module is further used for:

[0036] In response to receiving the data transmission instruction, determining a resource occupancy rate corresponding to the network service system;

[0037] When the resource occupancy rate is less than or equal to a preset threshold, a target data volume corresponding to the data transmission instruction is determined.

[0038] In one embodiment, the receiving module is further used for:

[0039] Determining a target resource type according to the data transmission instruction;

[0040] An initial resource occupancy rate corresponding to the target resource type in the network service system is determined, and a resource occupancy rate is generated according to the initial resource occupancy rate.

[0041] In one embodiment, the device is further used for:

[0042] In response to the resource occupancy rate of the network service system being greater than a preset threshold, the acquisition of the communication data file is stopped.

[0043] In a third aspect, the embodiments of the present disclosure further provide a computer device, wherein the computer device comprises a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of any one of the methods in the embodiments of the present disclosure are implemented.

[0044] In a fourth aspect, the embodiments of the present disclosure further provide a computer-readable storage medium, wherein a computer program is stored thereon, and when the computer program is executed by a processor, the steps of any one of the methods in the embodiments of the present disclosure are implemented.

[0045] In a fifth aspect, the embodiments of the present disclosure further provide a computer program product, wherein the computer program product includes a computer program, and when the computer program is executed by a processor, the steps of any one of the methods in the embodiments of the present disclosure are implemented.

[0046] The above-mentioned data transmission method, device, computer equipment, computer-readable storage medium and computer program product are used to capture relevant data during the operation of the network service system. When receiving a data transmission instruction, the corresponding target data volume is determined, the communication data file corresponding to the data transmission instruction is obtained according to the target data volume, and an initial transmission file matching the communication data file is generated. At the same time, the initial transmission file is periodically obtained according to a preset period and sent to the target platform, and the initial transmission file is deleted after the sending is completed, so that data can be captured and uploaded during the operation of the network service system, ensuring the security and reliability of the network service system. When performing data capture, the communication data file is obtained according to the target data volume, rather than the entire file package directly, so that when it is subsequently uploaded to the target platform, the initial transmission file can be directly periodically obtained and uploaded without waiting for the entire file package to be obtained, ensuring the efficiency of data upload; and the initial transmission file is directly deleted after uploading, which can effectively reduce the storage space occupied by the transmission file, save resources, realize the fragmented acquisition, generation, sending and deletion of data, ensure the efficiency and stability of data transmission, and is suitable for more application scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0048] Figure 1 A schematic diagram of a flow chart of a data transmission method in an embodiment;

[0049] Figure 2 A schematic diagram of an initial transmission file in one embodiment;

[0050] Figure 3 A schematic diagram of a flow chart of a method for determining a target file in one embodiment;

[0051] Figure 4A schematic diagram of a flow chart of a data transmission method in another embodiment;

[0052] Figure 5 is a structural block diagram of a data transmission device in one embodiment;

[0053] Figure 6 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0055] In one embodiment, Figure 1 As shown, a data transmission method is provided. This embodiment takes the method applied to a terminal as an example. It can be understood that the method can also be applied to a server, and can also be applied to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server. In this embodiment, the method is applied to a network service system, including:

[0056] Step S110, in response to receiving a data transmission instruction, determining a target data volume corresponding to the data transmission instruction;

[0057] Exemplarily, the network service system may be a service system deployed on the network, used to provide network services to relevant users. During the interaction with the users, communication data files are generated. Through the communication data files, the data transmission status of the network service system can be understood, network faults can be diagnosed, network performance can be evaluated, etc.

[0058] Optionally, the data transmission instruction may be sent when data monitoring starts, may be sent periodically, or may be sent to an operation and maintenance account, which may be determined based on actual application scenarios.

[0059] In one example, the target data volume may be a file slice size determined according to an actual application scenario. In one example, a preset parameter, such as parameter "-C", may be used to split a packet capture file (ie, an original communication data file) into multiple small files.

[0060] Step S120, acquiring a communication data file corresponding to the network service data according to the target data volume, and generating an initial transmission file matching the communication data file, wherein the data volume of the communication data file is the target data volume;

[0061] Generally, when capturing communication data files, the captured packet files are relatively large. In order to ensure data transmission efficiency, in this embodiment, a target data volume is set. When capturing data, the communication data files are captured according to the target data volume. Exemplarily, the original communication data file can be split into multiple small files, i.e., communication data files, according to the target data volume.

[0062] In one example, the communication data files may be continuously captured, and the actions of capturing, generating, sending, and deleting may be performed simultaneously.

[0063] Optionally, while capturing the communication data file, a corresponding initial transmission file is generated. In one example, the initial transmission file is generated in a corresponding target directory, and the initial transmission file can be obtained by processing the communication data file according to a corresponding file format in a data capture scenario. For example, the initial book splitting file may include a PCAP file.

[0064] Step S130, periodically acquiring the initial transmission file according to a preset period, and sending it to the target platform, and deleting the initial transmission file when the sending is completed.

[0065] Exemplarily, the preset period may be a data transmission period determined according to an actual application scenario. The initial transmission file is periodically obtained and sent to a target platform. In one example, the target platform may include but is not limited to a cloud.

[0066] Optionally, after the initial transmission file is sent, the initial transmission file is deleted to reduce the occupation of storage resources.

[0067] The disclosed embodiment is used to capture relevant data during the operation of the network service system. When receiving a data transmission instruction, the corresponding target data volume is determined, the communication data file corresponding to the data transmission instruction is obtained according to the target data volume, and an initial transmission file matching the communication data file is generated. At the same time, the initial transmission file is periodically obtained according to a preset period and sent to the target platform, and the initial transmission file is deleted after the sending is completed, so that data can be captured and uploaded during the operation of the network service system, ensuring the security and reliability of the network service system. When performing data capture, the communication data file is obtained according to the target data volume, rather than the entire file package directly, so that when it is subsequently uploaded to the target platform, the initial transmission file can be directly periodically obtained and uploaded without waiting for the entire file package to be obtained, ensuring the efficiency of data upload; and the initial transmission file is directly deleted after uploading, which can effectively reduce the storage space occupied by the transmission file, save resources, and realize the fragmented acquisition, generation, sending, and deletion of data, ensuring the efficiency and stability of data transmission, and being suitable for more application scenarios.

[0068] In one embodiment, the periodically obtaining the initial transmission file and sending it to the target platform includes:

[0069] Periodically acquiring a plurality of initial transmission files corresponding to a current period, wherein the initial transmission files include data acquisition parameters and communication data;

[0070] Deleting data acquisition parameters in other files except the target file in the initial transmission file to obtain a processed initial transmission file;

[0071] The processed initial transmission file is sent to the target platform.

[0072] Exemplarily, the initial transmission file may include data acquisition parameters and communication data. The data acquisition parameters may include but are not limited to the file's modulus, version number, timestamp accuracy, data link type, etc. The same data transmission instruction corresponds to the same data acquisition parameters.

[0073] Figure 2 is a schematic diagram of an initial transmission file according to an exemplary embodiment, referring to Figure 2 As shown in the figure, taking the initial transmission file as a PCAP file as an example, the structure of the PCAP file can be divided into two main parts: the global file header (i.e., data acquisition parameters) and the data packet block (i.e., communication data). The global file header is located at the beginning of the PCAP file, generally occupies 24 bytes, and contains some key information, such as the file's modulus, version number, timestamp accuracy, data link type, etc.

[0074] Optionally, multiple initial transmission files include the same data acquisition parameters. In this case, the data acquisition parameters in other files except the target file are deleted to obtain the processed initial transmission file. The target file can be determined according to the actual application scenario. For example, the target file can be the first file of multiple initial transmission files. In one example, since the command parameters (i.e., data transmission instructions) are the same, only the global file header of the first PCAP file needs to be paid attention to. If it needs to be spliced ​​into a large PCAP file, the first PCAP file header is retained, and the first 24 bytes of the subsequent PCAP files are cut off to retain the data packet splicing. In the Linux shell environment, the cut command can be used to directly intercept files.

[0075] Send the processed transmission file to the target platform. In one example, the target file may be the first file among multiple initial transmission files. When sending to the target platform, the target file is sent first, and other deleted files are sent in sequence. The file received by the target platform is the data acquisition parameters of the target file and the communication data of multiple initial transmission files.

[0076] In the embodiment of the present disclosure, when the initial transmission file is obtained and uploaded, according to the structure of the initial transmission file, the data acquisition parameters in some files are deleted when sending, which effectively reduces the workload when sending data, improves the data sending efficiency, and ensures the integrity and reliability of the data through the setting of the target file.

[0077] In one embodiment, Figure 3 As shown, the method for determining the target file includes:

[0078] Step S310, determining the file generation time corresponding to each of the initial transmission files;

[0079] Step S320: From the multiple initial transmission files, determine the initial transmission file with the earliest file generation time as the target file.

[0080] Exemplarily, the target file is determined according to the file generation time. In one example, the initial transmission file can be generated sequentially, corresponding to the file generation time.

[0081] In one example, the initially transmitted file with the earliest file generation time is determined as the target file. Optionally, when transmitting the files to the target platform, the files are transmitted to the target platform in sequence according to the file generation time corresponding to the files.

[0082] The disclosed embodiment determines the target file according to the file generation time of the initial transmission file, so that the target file can be quickly and accurately located from multiple initial transmission files, and then subsequent data can be intercepted and sent, ensuring the real-time and accuracy of data transmission.

[0083] In one embodiment, in response to receiving a data transmission instruction, determining a target data volume corresponding to the data transmission instruction includes:

[0084] In response to receiving the data transmission instruction, determining a resource occupancy rate corresponding to the network service system;

[0085] When the resource occupancy rate is less than or equal to a preset threshold, a target data volume corresponding to the data transmission instruction is determined.

[0086] Exemplarily, in response to receiving the data transmission instruction, the resource occupancy rate corresponding to the network service system is determined. In one example, the resource occupancy rate may be the occupancy rate of the computing resources of the processor corresponding to the network service system, which may be determined according to the actual application scenario.

[0087] When the resource occupancy rate is less than or equal to the preset threshold, it can be considered that the network service system has sufficient remaining resources and data packet capture can be performed, so the subsequent process continues to be executed. The preset threshold can be determined according to the actual application scenario. In one example, the preset threshold can be sent through a data transmission instruction.

[0088] The embodiment of the present disclosure, when receiving a data transmission instruction, first determines the resource occupancy rate corresponding to the network service system. When the resource occupancy rate is small, executes the subsequent data acquisition and sending steps, thereby starting the data capture process according to the resource occupancy rate of the network service system in the actual application scenario, ensuring the stability of the operation of the network service system, avoiding problems such as network service system operation freezes due to data capture, and is suitable for more application scenarios.

[0089] In one embodiment, determining the resource occupancy rate corresponding to the network service system includes:

[0090] Determining a target resource type according to the data transmission instruction;

[0091] An initial resource occupancy rate corresponding to the target resource type in the network service system is determined, and a resource occupancy rate is generated according to the initial resource occupancy rate.

[0092] Exemplarily, when determining the resource occupancy rate, the target resource type is first determined according to the data transmission instruction. The target resource type can be determined from the resource type corresponding to the network service system, and the resource type can include but is not limited to processor computing resources, memory resources, etc., which can be determined according to the actual application scenario.

[0093] Optionally, an initial resource occupancy rate corresponding to a target resource type in the network service system is determined, wherein different target resource types may correspond to different initial resource occupancy rates, and when a target resource type includes multiple types, multiple initial resource occupancy rates may correspond to the target resource type.

[0094] In one example, the resource occupancy rate is generated according to the initial resource occupancy rates. For example, the sum of the initial resource occupancy rates may be determined as the resource occupancy rate, and a weighted sum may be calculated according to a preset weight to obtain the resource occupancy rate.

[0095] The disclosed embodiments can determine the specified target resource type and calculate the resource occupancy rate according to the data transmission instruction, thereby realizing flexible calculation of the resource occupancy rate. The target resource type can be specified according to actual needs. Compared with the data capture of components and built-in modules, it is more flexible and suitable for more application scenarios.

[0096] In one embodiment, the method further comprises:

[0097] In response to the resource occupancy rate of the network service system being greater than a preset threshold, the acquisition of the communication data file is stopped.

[0098] Exemplarily, the resource occupancy rate of the network service system is monitored in real time, and when the resource occupancy rate of the network service system is greater than a preset threshold, the acquisition of the communication data file is stopped.

[0099] In one example, if the resource occupancy rate is greater than a preset threshold, it can be considered that the network service system is busy at this time, and continuing to capture data may cause service lag and other problems. The preset threshold can be set according to the actual application scenario. In one example, the generation of the initial transmission file and the sending of the initial transmission file can also be stopped at the same time.

[0100] Optionally, when the resource occupancy rate is less than or equal to a preset threshold, the communication data file may continue to be acquired, and subsequently generated and transmitted.

[0101] In the embodiment of the present disclosure, during the data transmission process, the resource occupancy rate of the network service system is monitored. When the resource occupancy rate is greater than a preset threshold, the acquisition of communication data files is stopped, that is, the data capture process is stopped, so that data capture can be automatically stopped according to the resource occupancy rate, thereby improving the flexibility of data transmission and being suitable for more application scenarios.

[0102] Figure 4 FIG. 1 is a flow chart of a data transmission method according to an exemplary embodiment. Figure 4As shown, first, an object storage, ordinary cloud disk or a log monitoring platform that meets the requirements can be set up in the network service system to support file segment upload and storage services. In one example, data capture can be performed through data transmission software, such as Tcpdump software. The data transmission software is installed on the target machine corresponding to the network service system. Use the preset program to perform the following steps: a) Monitor the resource utilization rate of the machine, control Tcpdump to start and stop packet capture (data capture) according to the resource utilization rate, and use the Tcpdump parameter "-C" to split the packet capture file into multiple small files when capturing packets. b) After executing the Tcpdump command for a period of time, multiple files (i.e., initial transmission files) such as "output.pcap, output.pcap1, output.pcap2..." will be generated in the target directory. All packet capture files need special processing as a file stream. When transmitting, keep the first PCAP file header, and cut off the first 24 bytes of the subsequent PCAP files to keep the data packet splicing. In the Linux shell environment, the cut command can be used to directly intercept files. c) Upload the PCAP file processed in the previous step to the cloud. In the Linux shell environment, you can use the curl command to POST to upload the file fragments. d) Delete the file immediately after uploading to reduce the consumption of machine storage resources.

[0103] This embodiment provides a solution for dynamically detecting system resource utilization and automatically starting and stopping packet capture. It can easily and low-coupledly implement long-term low-resource network packet capture, and transmit data through software programs and scripts. It can be expanded based on more complex needs and is suitable for more application scenarios.

[0104] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0105] Based on the same inventive concept, the embodiment of the present application also provides a data transmission device for implementing the data transmission method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more data transmission device embodiments provided below can refer to the limitations on the data transmission method above, and will not be repeated here.

[0106] In an exemplary embodiment, Figure 5 As shown, a data transmission device 500 is provided, and the device is applied to a network service system, comprising:

[0107] The receiving module 510 is configured to determine, in response to receiving a data transmission instruction, a target data volume corresponding to the data transmission instruction;

[0108] An acquisition module 520 is used to acquire a communication data file corresponding to the network service data according to the target data volume, and generate an initial transmission file matching the communication data file, wherein the data volume of the communication data file is the target data volume;

[0109] The sending module 530 is used to periodically obtain the initial transmission file according to a preset period and send it to the target platform. When the sending is completed, the initial transmission file is deleted.

[0110] In one embodiment, the sending module is further used for:

[0111] Periodically acquiring a plurality of initial transmission files corresponding to a current period, wherein the initial transmission files include data acquisition parameters and communication data;

[0112] Deleting data acquisition parameters in other files except the target file in the initial transmission file to obtain a processed initial transmission file;

[0113] The processed initial transmission file is sent to the target platform.

[0114] In one of the embodiments, the device further comprises a module for determining the target file, and the module for determining the target file is configured to:

[0115] Determine the file generation time corresponding to each of the initial transmission files;

[0116] From the multiple initial transmission files, determine the initial transmission file with the earliest file generation time as the target file.

[0117] In one embodiment, the receiving module is further used for:

[0118] In response to receiving the data transmission instruction, determining a resource occupancy rate corresponding to the network service system;

[0119] When the resource occupancy rate is less than or equal to a preset threshold, a target data volume corresponding to the data transmission instruction is determined.

[0120] In one embodiment, the receiving module is further used for:

[0121] Determining a target resource type according to the data transmission instruction;

[0122] An initial resource occupancy rate corresponding to the target resource type in the network service system is determined, and a resource occupancy rate is generated according to the initial resource occupancy rate.

[0123] In one embodiment, the device is further used for:

[0124] In response to the resource occupancy rate of the network service system being greater than a preset threshold, the acquisition of the communication data file is stopped.

[0125] Each module in the above data transmission device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0126] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 6 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store communication data files and other data involved in the method described in this embodiment. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a data transmission method is implemented.

[0127] Those skilled in the art will understand that Figure 6The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0128] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.

[0129] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0130] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0131] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0132] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0133] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0134] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A data transmission method, characterized in that: The method is applied to a network service system, comprising: In response to receiving a data transmission instruction, determining a target data volume corresponding to the data transmission instruction; According to the target data volume, acquiring a communication data file corresponding to the network service data, and generating an initial transmission file matching the communication data file, wherein the data volume of the communication data file is the target data volume; The initial transmission file is periodically obtained according to a preset period and sent to the target platform. When the sending is completed, the initial transmission file is deleted.

2. The method according to claim 1, characterized in that The periodically acquiring the initial transmission file and sending it to the target platform includes: Periodically acquiring a plurality of initial transmission files corresponding to a current period, wherein the initial transmission files include data acquisition parameters and communication data; Deleting data acquisition parameters in other files except the target file in the initial transmission file to obtain a processed initial transmission file; The processed initial transmission file is sent to the target platform.

3. The method according to claim 2, characterized in that The method for determining the target file includes: Determine the file generation time corresponding to each of the initial transmission files; From the multiple initial transmission files, determine the initial transmission file with the earliest file generation time as the target file.

4. The method according to claim 1, characterized in that: In response to receiving the data transmission instruction, determining the target data volume corresponding to the data transmission instruction includes: In response to receiving the data transmission instruction, determining a resource occupancy rate corresponding to the network service system; When the resource occupancy rate is less than or equal to a preset threshold, a target data volume corresponding to the data transmission instruction is determined.

5. The method according to claim 1, characterized in that The determining the resource occupancy rate corresponding to the network service system includes: Determining a target resource type according to the data transmission instruction; An initial resource occupancy rate corresponding to the target resource type in the network service system is determined, and a resource occupancy rate is generated according to the initial resource occupancy rate.

6. The method according to claim 1, characterized in that The method further comprises: In response to the resource occupancy rate of the network service system being greater than a preset threshold, the acquisition of the communication data file is stopped.

7. A data transmission device, characterized in that: The device is applied to a network service system, and comprises: A receiving module, configured to determine, in response to receiving a data transmission instruction, a target data volume corresponding to the data transmission instruction; an acquisition module, configured to acquire a communication data file corresponding to the network service data according to the target data volume, and generate an initial transmission file matching the communication data file, wherein the data volume of the communication data file is the target data volume; The sending module is used to periodically obtain the initial transmission file according to a preset period and send it to the target platform. When the sending is completed, the initial transmission file is deleted.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images