Data transmission method, apparatus, device, storage medium, and program product
By generating multiple second data retrieval requests and sending data in batches, the problem of low data transmission efficiency when a reactive service calls a blocking service is solved, and faster data retrieval is achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- CHINA CONSTRUCTION BANK
- Filing Date
- 2024-09-02
- Publication Date
- 2026-08-04
AI Technical Summary
In a network environment, when a reactive service calls a blocking service, the blocking service returns data all at once, causing the data transmission device to store the complete data before sending it, and the reactive service to process and send it. This results in a longer time for the data caller to obtain the data, leading to lower efficiency.
The data transmission device generates multiple second data retrieval requests based on the first data request from the responsive service, and sends a portion of the first data to the responsive service in batches, thereby improving data retrieval efficiency.
By sending data in batches, the waiting time for data callers is reduced, and the efficiency of data retrieval is improved.
Smart Images
Figure CN118945226B_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of big data processing technology, and in particular relates to a data transmission method, apparatus, device, storage medium and program product. Background Technology
[0002] Currently, there are two types of services in the network environment: blocking services and reactive services. A blocking service returns data all at once after being invoked by the callee. A reactive service, on the other hand, establishes a network channel between the caller and the callee, and returns the data to the caller in multiple installments.
[0003] Responsive services invoke blocking services through data transmission devices. However, since blocking services return data only once, the data transmission device needs to store the complete data before sending it to the reactive service. The data is received and then sent again. The reactive service processes the received data before sending the processed data back to the caller, resulting in a longer time for the data caller to obtain the data, which means there is a problem of low data retrieval efficiency. Summary of the Invention
[0004] This application provides a data transmission method, apparatus, device, storage medium, and program product to address the problem of low data retrieval efficiency.
[0005] In a first aspect, embodiments of this application provide a data transmission method applied to a data transmission device, the data transmission method comprising:
[0006] Receive a first data acquisition request sent by a first client, wherein the first client is used to indicate the client corresponding to the responsive service;
[0007] A first data parameter is determined based on the first data acquisition request. The first data parameter is used to indicate the data length or data volume of the first data. The first data is used to indicate the data that the first data acquisition request needs to acquire.
[0008] Multiple second data acquisition requests are generated based on the first data parameters, and each second data acquisition request is sent to a second client, which is used to indicate the client corresponding to the blocking service.
[0009] Each time the second data is received from the second client based on the second data acquisition request, the received second data is sent to the first client.
[0010] In some possible implementations, the step of generating multiple second data acquisition requests based on the first data parameters includes:
[0011] Based on the first data parameter, configure multiple second data parameters, wherein the second data parameters are smaller than the first data parameter;
[0012] Generate a second data acquisition request corresponding to each of the second data parameters, wherein the second data parameter is used to indicate the data length or data volume of the second data to be acquired in the corresponding second data acquisition request.
[0013] In some possible implementations, the first data parameter includes a first data volume of the first data, and the step of configuring multiple second data parameters according to the first data parameter includes:
[0014] Obtain the remaining storage capacity of the storage area in the data transmission device;
[0015] The second data quantity of the second data to be acquired by the data transmission device is determined based on the remaining storage quantity, and the ratio of the first data quantity to the second data quantity is determined, wherein the second data quantity is less than the remaining storage quantity;
[0016] Based on the ratio, a second data parameter is configured for the target quantity, wherein the target data is greater than or equal to the ratio, and the second data parameter is the second data quantity.
[0017] In some possible implementations, the step of generating multiple second data acquisition requests based on the first data parameters includes:
[0018] Obtain the remaining storage capacity of the storage area in the data transmission device.
[0019] In response to the first data parameter being greater than or equal to the remaining storage amount, a plurality of second data acquisition requests are generated based on the first data parameter.
[0020] In some possible implementations, the step of sending each of the second data acquisition requests to the second client includes:
[0021] Determine the time interval between the data transmission device sending the second data acquisition request and receiving the second data;
[0022] A target duration is configured according to the interval duration, wherein the target duration is greater than or equal to the interval duration;
[0023] At each target time interval, a second data acquisition request is sent to the second client.
[0024] In some possible implementations, the step of generating multiple second data acquisition requests based on the first data parameters includes:
[0025] Multiple sorted second data acquisition requests are generated based on the first data parameters. The second data to be acquired by each second data acquisition request is concatenated according to the sorting sequence number of each second data acquisition request to obtain the first data.
[0026] The step of sending a second data acquisition request to the second client at each target time interval includes:
[0027] According to the sorting order of the various second data acquisition requests, one second data acquisition request is sent to the second client at each target time interval.
[0028] In some possible implementations, the step of determining the first data parameter based on the first data acquisition request includes:
[0029] Parse the first data acquisition request to obtain the data identifier of the first data;
[0030] A parameter retrieval request is generated based on the data identifier, and the parameter retrieval request is sent to the second client;
[0031] Receive the first data parameters from the second client based on the parameter acquisition request.
[0032] Secondly, an embodiment of this application provides a data transmission device, comprising:
[0033] The receiving module is used to receive a first data acquisition request sent by a first client, wherein the first client is used to indicate the client corresponding to the responsive service;
[0034] The determining module is used to determine a first data parameter based on the first data acquisition request. The first data parameter is used to indicate the data length or data volume of the first data. The first data is used to indicate the data to be acquired by the first data acquisition request.
[0035] The generation module is used to generate multiple second data acquisition requests based on the first data parameters, and send each second data acquisition request to a second client, wherein the second client is used to indicate the client corresponding to the blocking service.
[0036] The sending module is configured to send the received second data to the first client each time it receives second data sent by the second client based on the second data acquisition request.
[0037] Thirdly, embodiments of this application provide a data transmission device, the device comprising: a processor and a memory storing computer program instructions; the processor, when executing the computer program instructions, implements the data transmission method as described above.
[0038] Fourthly, embodiments of this application provide a computer-readable storage medium, characterized in that the computer-readable storage medium stores computer program instructions, which, when executed by a processor, implement the data transmission method described above.
[0039] Fifthly, embodiments of this application provide a computer program product, wherein instructions in the computer program product, when executed by a processor of an electronic device, enable the electronic device to perform the data transmission method as described above.
[0040] The data transmission method, apparatus, device, storage medium, and program product of this application embodiment receive a first data acquisition request sent by a first client corresponding to a responsive service. Based on the first data acquisition request, data parameters such as the data length and data volume of the first data required by the responsive service are determined. Multiple second data acquisition requests corresponding to second data portions of the first data are generated according to the first data parameters. Each second data acquisition request is then sequentially sent to a second client corresponding to a blocking service. Each time second data is received from the second client, the second data is sent to the first client. In this application, the data transmission apparatus generates multiple second data requests to acquire portions of the first data based on the first data request for the first data acquired by the responsive service. This allows a portion of the first data to be sent to the responsive service first, enabling the responsive service to transmit the data to the caller, thus improving data retrieval efficiency. Attached Figure Description
[0041] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0042] Figure 1 This is a schematic diagram of the scenario involving the data transmission method of this application;
[0043] Figure 2 This is a flowchart illustrating the first embodiment of the data transmission method of this application;
[0044] Figure 3 This is a flowchart illustrating the second embodiment of the data transmission method of this application;
[0045] Figure 4 This is a flowchart illustrating the third embodiment of the data transmission method of this application;
[0046] Figure 5 This is a schematic diagram of the functional modules of the data transmission device of this application;
[0047] Figure 6 This is a schematic diagram of the data transmission device of this application. Detailed Implementation
[0048] The features and exemplary embodiments of various aspects of this application will be described in detail below. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain this application and not to limit it. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples.
[0049] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes said element.
[0050] It should be noted that the acquisition, storage, use, and processing of data in this application embodiment all comply with the relevant provisions of national laws and regulations.
[0051] It should be noted that in the embodiments of this application, certain software, components, models and other existing solutions in the industry may be mentioned. These should be regarded as exemplary and are only intended to illustrate the feasibility of implementing the technical solution of this application. However, it does not mean that the applicant has used or necessarily used the solution.
[0052] Currently, there are two types of services in the network environment: blocking services and reactive services. A blocking service returns data all at once after being invoked by the callee. A reactive service, on the other hand, establishes a network channel between the caller and the callee, and returns the data to the caller in multiple installments.
[0053] The inventors of this application discovered that a responsive service calls a blocking service through a data transmission device. However, since a blocking service returns data only once, the data transmission device needs to store the complete data before sending it to the responsive service. The data is received and then sent again. The responsive service processes the received data before sending the processed data back to the caller, resulting in a long time for the data caller to obtain the data, which means there is a problem of low data retrieval efficiency.
[0054] The inventors of this application therefore conceived of a data transmission device that generates multiple second data requests for obtaining portions of the first data based on a first data request obtained from a responsive service, thereby sending portions of the first data to the responsive service first, enabling the responsive service to transmit the data to the caller, thus improving data retrieval efficiency.
[0055] Reference Figure 1 , Figure 1 This is a schematic diagram illustrating a data transmission method according to this application. (Refer to...) Figure 1 The data transmission device 100 communicatively connects the first client 200 and the second client 300. The data transmission device 100 can be a physical or virtual device corresponding to a network proxy. The first client 200 is a responsive service client, and the second client 300 is a blocking service client. The first client 200 sends a first data acquisition request to the data transmission device 100. Based on the first data acquisition request, the data transmission device 100 obtains the data parameters of the first data required by the first client 200, generates multiple second data acquisition requests using the data parameters, and then sends each of the first data acquisition requests to the second client 300. For example, if the data transmission device 100 sends two second data acquisition requests to the second client, it will receive two sets of second data from the second client 300 and then send the two sets of second data back to the first client 100.
[0056] The following combination Figure 1 The data transmission method of this application is described in detail.
[0057] Reference Figure 2 , Figure 2 This is a flowchart illustrating a first embodiment of the data transmission method of this application. The data transmission method includes:
[0058] Step S201: Receive a first data acquisition request sent by a first client, wherein the first client is used to indicate the client corresponding to the responsive service.
[0059] In this embodiment, the executing entity is a data transmission device. For ease of description, the term "device" will be used to refer to the data transmission device below. The device can be a physical device or a virtual device of a network proxy.
[0060] The device is communicatively connected to a first client and a second client. The first client is the client corresponding to the responsive service, and the second client is the client corresponding to the blocking service.
[0061] When the first client needs to obtain data for the caller, it generates a data retrieval request, defined as the first data retrieval request. The first data retrieval request contains the data identifier of the data to be retrieved. The data to be retrieved is defined as the first data. The first client sends the first data retrieval request to the device.
[0062] Step S202: Determine the first data parameter according to the first data acquisition request. The first data parameter is used to indicate the data length or data volume of the first data. The first data is used to indicate the data to be acquired by the first data acquisition request.
[0063] After receiving a first data acquisition request, the device parses the request to obtain the data identifier of the first data. Based on the data identifier, the device obtains the first data parameters of the first data. The first data parameters include the data length or data volume of the first data.
[0064] In one example, the device stores a data table containing data parameters for various data items in the second client, and these data parameters are associated with data identifiers. The device retrieves the data parameter associated with the data identifier from the data table as the first data parameter.
[0065] In another example, the device parses the first data acquisition request to obtain the data identifier of the first data, generates a parameter acquisition request based on the data identifier, and then sends the parameter acquisition request to the second client. The second client parses the parameter acquisition request to obtain the data identifier, and then sends the first data parameter of the first data associated with the data identifier to the device. That is, the device receives the first data parameter fed back by the second client based on the data acquisition request.
[0066] Step S203: Generate multiple second data acquisition requests based on the first data parameters, and send each second data acquisition request to a second client. The second client is used to indicate the client corresponding to the blocking service.
[0067] After obtaining the first data parameters, the device generates multiple second data acquisition requests based on the first data parameters. The data requested by each second data acquisition request is defined as second data, and all the second data constitute the first data. It can be understood that the device splits the first data acquisition request into multiple second data acquisition requests, thus changing the device's approach from acquiring the complete first data to acquiring multiple parts of the first data.
[0068] After receiving each second data acquisition request, the device sends each second data acquisition request to the second client. Upon receiving the second data acquisition request, the second client segments the first data to obtain the portion of the first data required by the second data request. This portion of the first data constitutes the second data, which the second client then returns to the device.
[0069] Step S204: Each time the second data sent by the second client based on the second data acquisition request is received, the received second data is sent to the first client.
[0070] Each time the device receives second data sent by the second client based on the second data acquisition request, the device sends the received second data to the first client. That is, the device sends the second data to the first client immediately after receiving the second data, so that the first client can process the second data as part of the first data without waiting for the first client to receive the complete first data before processing. This allows the caller to obtain the required data from the first client as quickly as possible.
[0071] The first data has a length of 10,000. Assume the first client takes 0.01 seconds to retrieve each data length. If the first client needs to retrieve the complete data before processing, it would need to wait 10 seconds. However, in this solution, the device sends 1000 second data retrieval requests to the second client, each request retrieving 10 data lengths. Therefore, the first device only needs to wait 0.1 seconds to process the data.
[0072] In this embodiment, a first data acquisition request is received from a first client corresponding to a responsive service. Based on the first data acquisition request, data parameters such as the data length and data volume of the first data required by the responsive service are determined. Multiple second data acquisition requests corresponding to the acquisition of second data portions of the first data are generated according to the first data parameters. These second data acquisition requests are then sequentially sent to the second client corresponding to a blocking service. Each time second data is received from the second client, the second data is sent to the first client. In this embodiment, the data transmission device generates multiple second data requests to acquire portions of the first data based on the first data request acquired by the responsive service. This allows a portion of the first data to be sent to the responsive service first, enabling the responsive service to transmit the data to the caller, thus improving data retrieval efficiency.
[0073] Reference Figure 3 , Figure 3 This is a flowchart illustrating the second embodiment of the data transmission method of this application. Based on the first embodiment, step S203 includes:
[0074] Step S301: Configure multiple second data parameters according to the first data parameter, wherein the second data parameters are smaller than the first data parameter.
[0075] In this embodiment, after obtaining the first data parameter, the device can configure multiple second data parameters based on the first data parameter, and each data parameter is smaller than the first data parameter. For example, when the first data parameter is a first data quantity, the second data parameter is a second data quantity smaller than the first data quantity; when the first data parameter is a first data length, the second data parameter is a second data length smaller than the first data length.
[0076] In one example, the first client has a quantity requirement. For instance, the first client requires a target quantity of first data. The device then segments the first data parameter according to the target data to obtain multiple second data parameters. For example, if the target quantity is 10, the first data parameter is segmented 9 times to obtain 10 second data parameters. If the first data length is 100, segmenting it nine times yields 10 second data lengths, and each second data length is 10. Of course, each second data length can also be different.
[0077] In another example, the first client has requirements for the amount of data received, for example, requiring that the amount of data received is not less than the target amount of data. The ratio of the first amount of data to the target amount of data can determine multiple second data parameters. For example, if the first amount of data is 100M and the target amount of data is 8M, the ratio of 100 to 8 is 12.5, then there are 13 second data parameters, of which 12 second data parameters are 8M and the last second data parameter is 4M.
[0078] In another example, the first data parameter is the first data volume. The remaining storage space in the device's storage area is obtained, and based on this remaining storage space, the second data volume of the second data to be acquired by the device is determined. The device determines the ratio of the first data volume to the second data volume, and the second data volume must be less than the remaining storage space to prevent the device from being unable to receive the second data completely. The device configures a target number of second data parameters based on this ratio; the second data parameter is the second data volume. For example, if the remaining storage space is 7MB and the first data volume is 100MB, the ratio of 100 to 7 is 14.3. Rounding 14.3 to 15, the target number is greater than or equal to 15. This method prevents the device from being unable to receive the second data. Furthermore, this method eliminates the need for the device to configure a large storage space for data transmission, reducing the device's data transmission cost. In the example technology, the device needs to configure 100MB of storage space for the first data volume of 100MB. However, in this embodiment, since the maximum second data volume is 7MB, the device only needs to configure 7MB of storage space to complete the reception of the second data and then transmit the received second data to the first client.
[0079] Step S302: Generate a second data acquisition request corresponding to each second data parameter. The second data parameter is used to indicate the data length or data volume of the second data to be acquired by the corresponding second data acquisition request.
[0080] After obtaining multiple second data parameters, the device generates a data acquisition request corresponding to each second data parameter. The second data parameter is the data length or data volume of the second data to be acquired by the second data acquisition request.
[0081] It should be noted that when the second client receives a second data acquisition request, it extracts the second data corresponding to the second data parameters from the first data. When the second client receives another second data acquisition request, it continues to segment the first data from which the second data has already been extracted, until the first data is completely segmented and sent. For example, if the second data acquisition request is 10M, the second client will segment 10M from the 100M first data and transmit it to the device, resulting in 90M of first data. If the second client receives another second data acquisition request with a 10M segment, it will segment 10M from the 90M first data and send it, until the second client sends the last segmented second data to the device. In this way, the device does not need to set different second data acquisition requests, saving the device's computing resources.
[0082] In this embodiment, the device configures multiple second data parameters based on the first data parameters, and then generates a second data acquisition request corresponding to each second data parameter, thereby enabling the second client to send multiple parts of the first data to the first client through the device.
[0083] In one embodiment, after obtaining the first data parameter, the device obtains the remaining storage amount in the storage area of the device. If the first data parameter is greater than or equal to the remaining storage amount, multiple second data acquisition requests need to be generated based on the first data parameter. The first data parameter is the first data amount.
[0084] If the first data parameter is less than the remaining storage capacity, it is necessary to determine whether the first data parameter is less than the preset data capacity. If the first data parameter is greater than or equal to the preset data capacity, it can be determined that the first data is large-capacity data, and the device needs to generate multiple second data acquisition requests based on the first data parameter.
[0085] In this embodiment, when the first data parameter is greater than or equal to the remaining storage space of the device, the device needs to generate multiple second data acquisition requests based on the first data parameter in order to obtain multiple small-capacity data segments from the second client, so as to avoid the device not having enough storage space to receive the data required by the first client.
[0086] Reference Figure 4 , Figure 4 This is a flowchart illustrating the third embodiment of the data transmission method of this application. Based on the first or second embodiment, step S203 includes:
[0087] Step S401: Determine the time interval between sending the second data acquisition request and receiving the second data by the data transmission device.
[0088] In this embodiment, the interval between the acquisition device sending the second data acquisition request and receiving the second data can be obtained through testing. For example, the device sends a heartbeat packet to the second client and starts timing. When the device receives a response message from the second client based on the heartbeat packet, it stops timing. The timing duration obtained by the device is the interval duration.
[0089] Step S402: Configure the target duration according to the interval duration, where the target duration is greater than or equal to the interval duration.
[0090] Step S403: Send a second data acquisition request to the second client at each target time interval.
[0091] After obtaining the interval duration, the device configures a target duration based on the interval duration, where the target duration is greater than or equal to the interval duration. The device sends a second data acquisition request to the second client every interval of the target duration.
[0092] In this embodiment, when the device generates multiple second data acquisition requests based on the first data parameters, it generates multiple sorted second data acquisition requests based on the first data parameters. The second data to be acquired by each second data acquisition request is concatenated according to the sorting sequence number of the second data acquisition requests to obtain the first data. The device sends one second data acquisition request to the second client at target time intervals according to the sorting order of the second data acquisition requests. For example, assuming there are three second data acquisition requests sorted 1, 2, and 3, the device first sends the second data acquisition request sorted 1 to the second client and receives second data 1 from the second client; after sending the second data acquisition request sorted 1, the device starts timing. If the timing duration reaches the target duration, the timing stops, and the device then sends the second data acquisition request sorted 2 to the second client and receives second data 2 from the second client; after sending the second data acquisition request sorted 2, the device starts timing again. If the timing duration reaches the target duration, the timing stops, and the device then sends the second data acquisition request sorted 3 to the second client and receives second data 3 from the second client. The first data is obtained by combining second data 1, second data 2, and third data 3.
[0093] It should be noted that the device sends the second data to the first client in sequence, and the first client then forms streaming data based on the second data sent in sequence.
[0094] In this embodiment, the device sends a second data acquisition request to the second client at target time intervals, which allows the device to store one piece of second data within a time period. This reduces the storage space requirements of the device and thus lowers the data transmission cost.
[0095] In one embodiment, the device parses the first data acquisition request to obtain a latency parameter, which refers to the time required for the first client to acquire the complete first data. For example, if the latency parameter is 2 seconds, the device needs to transmit the first data to the first client within 2 seconds.
[0096] The device has multiple methods for transmitting second data, including parallel transmission and serial transmission. Parallel transmission means that the device simultaneously sends each second data acquisition request to the second client, enabling the second client to respond with second data to the device within the same time period, thus allowing the second device to send each piece of second data to the first client in parallel. Serial transmission means that the device sends a second data request to the second client at target intervals.
[0097] After generating each second data acquisition request, the device obtains a latency parameter based on the first data acquisition request and determines whether the latency parameter is greater than a preset threshold. If the latency parameter is greater than the preset threshold, it can be determined that the first client is not in urgent need of acquiring the complete first data, and the device proceeds to steps S401 to S403, sending a second data acquisition request to the second client at target time intervals. When the latency parameter is less than or equal to the preset threshold, the device sends each second data acquisition request to the second client within the current time period.
[0098] In this embodiment, the device determines the method of sending the second data acquisition request through a delay parameter, thereby transmitting the second data to the second client in a reasonable manner, and the device has a high degree of intelligence.
[0099] See Figure 5 The data transmission device 500 provided in this application embodiment includes:
[0100] The receiving module 510 is used to receive a first data acquisition request sent by a first client, wherein the first client is used to indicate the client corresponding to the responsive service;
[0101] The determining module 520 is used to determine the first data parameter according to the first data acquisition request. The first data parameter is used to indicate the data length or data volume of the first data. The first data is used to indicate the data to be acquired by the first data acquisition request.
[0102] The generation module 530 is used to generate multiple second data acquisition requests based on the first data parameters, and send each second data acquisition request to a second client, which is used to indicate the client corresponding to the blocking service.
[0103] The sending module 540 is used to send the received second data to the first client each time it receives second data sent by the second client based on the second data acquisition request.
[0104] In one embodiment, the data transmission device 500 is specifically used for:
[0105] Based on the first data parameter, configure multiple second data parameters, where each second data parameter is smaller than the first data parameter.
[0106] Generate a second data acquisition request corresponding to each second data parameter. The second data parameter is used to indicate the data length or data volume of the second data to be acquired in the corresponding second data acquisition request.
[0107] In one embodiment, the data transmission device 500 is specifically used for:
[0108] Obtain the remaining storage capacity of the storage area in the data transmission device;
[0109] The second data quantity to be acquired by the data transmission device is determined based on the remaining storage quantity, and the ratio of the first data quantity to the second data quantity is determined, wherein the second data quantity is less than the remaining storage quantity.
[0110] Based on the ratio, configure the second data parameter for the target quantity. The target data is greater than or equal to the ratio, and the second data parameter is the second data quantity.
[0111] In one embodiment, the data transmission device 500 is specifically used for:
[0112] Obtain the remaining storage capacity of the storage area in the data transmission device.
[0113] In response to the first data parameter being greater than or equal to the remaining storage, multiple second data retrieval requests are generated based on the first data parameter.
[0114] In one embodiment, the data transmission device 500 is specifically used for:
[0115] Determine the time interval between the data transmission device sending the second data acquisition request and receiving the second data;
[0116] Configure the target duration based on the interval duration, and the target duration shall be greater than or equal to the interval duration;
[0117] A second data retrieval request is sent to the second client at each target time interval.
[0118] In one embodiment, the data transmission device 500 is specifically used for:
[0119] Multiple sorted second data retrieval requests are generated based on the first data parameters. The second data to be retrieved by each second data retrieval request is concatenated according to the sorting sequence number of each second data retrieval request to obtain the first data.
[0120] The steps of sending a second data retrieval request to the second client at each target time interval include:
[0121] According to the sorting order of the various second data acquisition requests, a second data acquisition request is sent to the second client at target intervals.
[0122] In one embodiment, the data transmission device 500 is specifically used for:
[0123] Parse the first data retrieval request to obtain the data identifier of the first data;
[0124] A parameter retrieval request is generated based on the data identifier, and the parameter retrieval request is sent to the second client;
[0125] Receive the first data parameters returned by the second client based on the parameter acquisition request.
[0126] The various modules of the data transmission device provided in this application embodiment can achieve Figures 2 to 4 Each embodiment provides the functionality of each step of the data transmission method and achieves its corresponding technical effect. For the sake of brevity, it will not be described in detail here.
[0127] Figure 6 A schematic diagram of the hardware structure of the data transmission device provided in an embodiment of this application is shown.
[0128] The data transmission device may include a processor 601 and a memory 602 storing computer program instructions.
[0129] Specifically, the processor 601 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.
[0130] Memory 602 may include mass storage for data or instructions. For example, and not limitingly, memory 602 may include a hard disk drive (HDD), floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 602 may include removable or non-removable (or fixed) media. Where appropriate, memory 602 may be internal or external to the integrated gateway disaster recovery device. In a particular embodiment, memory 602 is non-volatile solid-state memory.
[0131] In a particular embodiment, memory 602 may include read-only memory (ROM), random access memory (RAM), disk storage media device, optical storage media device, flash memory device, electrical, optical, or other physical / tangible memory storage device. Thus, generally, memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to one aspect of this disclosure.
[0132] The processor 601 implements any of the authentication methods described in the above embodiments by reading and executing computer program instructions stored in the memory 602.
[0133] In one example, the data transmission device may further include a communication interface 603 and a bus 610. Wherein, as... Figure 6 As shown, the processor 601, memory 602, and communication interface 603 are connected through bus 610 and complete communication with each other.
[0134] The communication interface 603 is mainly used to realize communication between various modules, devices, units and / or equipment in the embodiments of this application.
[0135] Bus 610 includes hardware, software, or both, that couples components of an online data traffic metering device together. For example, and not limitingly, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, bus 610 may include one or more buses. Although specific buses are described and illustrated in embodiments of this application, any suitable bus or interconnect is contemplated herein.
[0136] The data transmission methods described in the above embodiments can be implemented using a computer storage medium provided in this application. This computer storage medium stores computer program instructions; when these computer program instructions are executed by a processor, they implement any of the data transmission methods described in the above embodiments.
[0137] This application also provides a computer program product, including a computer program, which, when executed, implements any of the data transmission methods described in the above embodiments.
[0138] It should also be noted that the exemplary embodiments mentioned in this application describe methods or systems based on a series of steps or apparatus. However, this application is not limited to the order of the above steps; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.
[0139] The aspects of this disclosure have been described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block in the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data transmission apparatus to create a machine such that these instructions, executable via the processor of the computer or other programmable data transmission apparatus, enable the implementation of the functions / actions specified in one or more blocks of the flowchart illustrations and / or block diagrams. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field-programmable logic circuit. It is also understood that each block in the block diagrams and / or flowchart illustrations, and combinations of blocks in the block diagrams and / or flowchart illustrations, can also be implemented by special-purpose hardware performing the specified functions or actions, or can be implemented by a combination of special-purpose hardware and computer instructions.
[0140] The above are merely specific embodiments of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.
Claims
1. A data transmission method, characterized by, The data transmission method, applied to a data transmission device, includes: Receive a first data acquisition request sent by a first client, wherein the first client is used to indicate the client corresponding to the responsive service; A first data parameter is determined based on the first data acquisition request. The first data parameter is used to indicate the data length or data volume of the first data. The first data is used to indicate the data that the first data acquisition request needs to acquire. The first data parameter includes the first data volume of the first data. Multiple second data acquisition requests are generated based on the first data parameters, and each second data acquisition request is sent to a second client, which is used to indicate the client corresponding to the blocking service. The step of generating multiple second data acquisition requests based on the first data parameters includes: Based on the first data parameter, configure multiple second data parameters, wherein the second data parameters are smaller than the first data parameter; The step of configuring multiple second data parameters based on the first data parameters includes: Based on the ratio of the first data volume to the minimum target data volume, a number of second data parameters are determined; the minimum target data volume is the minimum target data volume required by the first client for the received data. Generate a second data acquisition request corresponding to each of the second data parameters, wherein the second data parameter is used to indicate the data length or data volume of the second data to be acquired in the corresponding second data acquisition request; Each time the second data is received from the second client based on the second data acquisition request, the received second data is sent to the first client.
2. The data transmission method of claim 1, wherein, The step of configuring multiple second data parameters based on the first data parameter includes: Obtain the remaining storage capacity of the storage area in the data transmission device; The second data quantity of the second data to be acquired by the data transmission device is determined based on the remaining storage quantity, and the ratio of the first data quantity to the second data quantity is determined, wherein the second data quantity is less than the remaining storage quantity; Based on the ratio, a second data parameter is configured for the target quantity, wherein the target quantity is greater than or equal to the ratio, and the second data parameter is the second data quantity.
3. The data transmission method of claim 1, wherein, The step of generating multiple second data acquisition requests based on the first data parameters includes: Obtain the remaining storage capacity of the storage area in the data transmission device; In response to the first data parameter being greater than or equal to the remaining storage amount, a plurality of second data acquisition requests are generated based on the first data parameter.
4. The data transmission method of claim 1, wherein, The step of sending each of the second data acquisition requests to the second client includes: Determine the time interval between the data transmission device sending the second data acquisition request and receiving the second data; A target duration is configured according to the interval duration, wherein the target duration is greater than or equal to the interval duration; At each target time interval, a second data acquisition request is sent to the second client.
5. The data transmission method of claim 4, wherein, The step of generating multiple second data acquisition requests based on the first data parameters includes: Multiple sorted second data acquisition requests are generated based on the first data parameters. The second data to be acquired by each second data acquisition request is concatenated according to the sorting sequence number of each second data acquisition request to obtain the first data. The step of sending a second data acquisition request to the second client at each target time interval includes: According to the sorting order of the various second data acquisition requests, one second data acquisition request is sent to the second client at each target time interval.
6. The data transmission method of any of claims 1-5, wherein, The step of determining the first data parameter based on the first data acquisition request includes: Parse the first data acquisition request to obtain the data identifier of the first data; A parameter retrieval request is generated based on the data identifier, and the parameter retrieval request is sent to the second client; Receive the first data parameters from the second client based on the parameter acquisition request.
7. A data transmission apparatus, characterized by comprising: include: The receiving module is used to receive a first data acquisition request sent by a first client, wherein the first client is used to indicate the client corresponding to the responsive service; The determining module is configured to determine a first data parameter based on the first data acquisition request. The first data parameter is used to indicate the data length or data volume of the first data. The first data is used to indicate the data to be acquired by the first data acquisition request. The first data parameter includes the first data volume of the first data. The generation module is used to generate multiple second data acquisition requests based on the first data parameters, and send each second data acquisition request to a second client, wherein the second client is used to indicate the client corresponding to the blocking service. The generation module is specifically used for: Based on the first data parameter, configure multiple second data parameters, wherein the second data parameters are smaller than the first data parameter; Based on the ratio of the first data volume to the minimum target data volume, a number of second data parameters are determined; the minimum target data volume is the minimum target data volume required by the first client for the received data. Generate a second data acquisition request corresponding to each of the second data parameters, wherein the second data parameter is used to indicate the data length or data volume of the second data to be acquired in the corresponding second data acquisition request; The sending module is configured to send the received second data to the first client each time it receives second data sent by the second client based on the second data acquisition request.
8. A data transmission device, characterized by The device includes: a processor and a memory storing computer program instructions; the processor, when executing the computer program instructions, implements the data transmission method as described in any one of claims 1-6.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions, which, when executed by a processor, implement the data transmission method as described in any one of claims 1-6.
10. A computer program product, characterised in that, When the instructions in the computer program product are executed by the processor of the electronic device, the electronic device is able to perform the data transmission method as described in any one of claims 1-6.