Data acquisition method and device, equipment and storage medium

Abstract

The invention provides a data acquisition method and device, equipment and a storage medium, the method is applied to data acquisition equipment, the method comprises the following steps: sending an acquisition request to data transmission equipment, the acquisition request being used for requesting to acquire target data; downloading information of target data sent by the data transmission equipment is received, the target data is received, and the downloading information comprises the total downloading packet number corresponding to the target data and the data size corresponding to each downloading packet number; according to the downloading information, error data are determined, and the error data are data which are not successfully downloaded by the data acquisition equipment in the target data; and sending the retransmission request to the data transmission device until all target data is successfully received, the retransmission request being used for requesting to acquire the error data. Through the method, the data acquisition efficiency can be improved.

Description

Technical Field

[0001] The present application relates to the field of information technology, and in particular to a data acquisition method, device, equipment and storage medium. Background Art

[0002] The data acquisition device can acquire data from the data storage device through the data transmission device.

[0003] At present, in response to the acquisition request of the data acquisition device, the data transmission device can obtain the corresponding data from the data storage device and can send data to the data acquisition device. Correspondingly, the data acquisition device can receive the data sent by the data transmission device. However, when the data acquisition device receives data, if there is a data reception failure, the data acquisition device needs to request the data transmission device to obtain all the data again, resulting in low data acquisition efficiency. Summary of the invention

[0004] The embodiments of the present application provide a data acquisition method, apparatus, device and storage medium to improve data acquisition efficiency.

[0005] In a first aspect, an embodiment of the present application provides a data acquisition method, which is applied to a data acquisition device, and the method includes:

[0006] Sending an acquisition request to a data transmission device, wherein the acquisition request is used to request acquisition of target data;

[0007] receiving download information of target data sent by the data transmission device, and receiving the target data, wherein the download information includes a total number of download packages corresponding to the target data, and a data volume corresponding to each number of download packages;

[0008] Determining error data according to the download information, wherein the error data is data in the target data that is not successfully downloaded by the data acquisition device;

[0009] The retransmission request is sent to the data transmission device until all target data are successfully received, wherein the retransmission request is used to request to obtain the erroneous data.

[0010] In a possible implementation, the data acquisition device includes a robotic process automation (RPA) component; and determining error data according to the downloaded information includes:

[0011] The RPA component detects the download status corresponding to each download package number, where the download status is a success status or an unsuccessful status;

[0012] The error data is determined according to the download status corresponding to each download package number and the download information.

[0013] In a possible implementation, for any number of download packages, detecting the download status corresponding to the number of download packages by the RPA component includes:

[0014] Detecting, by the RPA component, whether the data corresponding to the number of download packages is downloaded successfully;

[0015] If the data corresponding to the download package number is downloaded successfully, the download status corresponding to the download package number is a success status;

[0016] If the data corresponding to the download package number is not downloaded successfully, the download status corresponding to the download package number is an unsuccessful status.

[0017] In a possible implementation, determining the error data according to the download status corresponding to each number of download packages and the download information includes:

[0018] Determining a target number of download packages in the download information, wherein the download status of the target number of download packages is an unsuccessful status;

[0019] The data corresponding to the target number of download packages is determined as the error data.

[0020] In a possible implementation manner, sending the retransmission request to the data transmission device includes:

[0021] The retransmission request is determined according to the download information, and the retransmission request is sent to the data transmission device.

[0022] In a possible implementation manner, the download information further includes download instructions corresponding to each number of download packets; and determining the retransmission request according to the download information includes:

[0023] Determining target information corresponding to the error data in the download information, the target information including a target download package number corresponding to the error data, a data volume corresponding to the target download package number, and a download instruction corresponding to the target download package number;

[0024] Determine that the retransmission request includes the target information.

[0025] In a second aspect, an embodiment of the present application provides a data acquisition method, which is applied to a data transmission device, and the method includes:

[0026] In response to an acquisition request of a data acquisition device, determining a total amount of target data corresponding to the acquisition request, wherein the acquisition request is used to request acquisition of the target data;

[0027] Determine the download information of the target data according to the total data volume, and send the download information to the data acquisition device, wherein the download information includes the total number of download packages corresponding to the target data and the data volume corresponding to each download package number;

[0028] Acquire the target data from the data storage device according to the download information, and send the target data to the data acquisition device;

[0029] receiving a retransmission request sent by the data acquisition device, wherein the retransmission request is used to request to obtain error data, and the error data is data in the target data that is not successfully received by the data acquisition device;

[0030] The erroneous data is acquired from the data storage device according to the retransmission request, and the erroneous data is sent to the data acquisition device.

[0031] In a possible implementation manner, determining the download information of the target data according to the total data amount includes:

[0032] Determining whether the total data volume is greater than or equal to a preset threshold;

[0033] If the total data volume is less than the preset threshold, determining that the total number of download packages included in the download information is one, and the data volume corresponding to the number of download packages is the total data volume;

[0034] If the total data volume is greater than or equal to the preset threshold, the download information is determined according to the total data volume and the preset threshold.

[0035] In a possible implementation manner, determining the download information according to the total data volume and the preset threshold includes:

[0036] Determining the total number of downloaded packages as a ratio of the total data volume to the preset threshold;

[0037] Determine that the amount of data corresponding to the number of download packages i is the preset threshold, where i is 1, 2, ..., N-1, N is the total number of download packages, and N is an integer greater than or equal to 2;

[0038] The product of N-1 and the preset threshold is determined, and the data volume corresponding to the number of download packages N is determined as the difference between the total data volume and the product.

[0039] In a possible implementation manner, the download information further includes download instructions corresponding to each download package number; and obtaining the target data from a data storage device according to the download information includes:

[0040] Sending the download information to the data storage device, so that the data storage device determines corresponding data according to the download instructions corresponding to each download package number;

[0041] Receive data corresponding to each number of download packages sent by the data storage device.

[0042] In a third aspect, an embodiment of the present application provides a data acquisition device, which is applied to a data acquisition device. The device includes: a sending module, a receiving module, and a determining module, wherein:

[0043] The sending module is used to send an acquisition request to the data transmission device, and the acquisition request is used to request to acquire the target data;

[0044] The receiving module is used to receive download information of the target data sent by the data transmission device and receive the target data, wherein the download information includes the total number of download packages corresponding to the target data and the data volume corresponding to each download package number;

[0045] The determination module is used to determine error data according to the download information, wherein the error data is data in the target data that is not successfully downloaded by the data acquisition device;

[0046] The sending module is further used to send the retransmission request to the data transmission device until all target data are successfully received, and the retransmission request is used to request to obtain the erroneous data.

[0047] In a possible implementation, the data acquisition device includes a robotic process automation (RPA) component; the determination module is specifically configured to:

[0048] The RPA component detects the download status corresponding to each download package number, where the download status is a success status or an unsuccessful status;

[0049] The error data is determined according to the download status corresponding to each download package number and the download information.

[0050] In a possible implementation, for any number of download packages, the determining module is specifically configured to:

[0051] Detecting, by the RPA component, whether the data corresponding to the number of download packages is downloaded successfully;

[0052] If the data corresponding to the download package number is downloaded successfully, the download status corresponding to the download package number is a success status;

[0053] If the data corresponding to the download package number is not downloaded successfully, the download status corresponding to the download package number is an unsuccessful status.

[0054] In a possible implementation, the determining module is specifically configured to:

[0055] Determining a target number of download packages in the download information, wherein the download status of the target number of download packages is an unsuccessful status;

[0056] The data corresponding to the target number of download packages is determined as the error data.

[0057] In a possible implementation, the sending module is specifically used to:

[0058] The retransmission request is determined according to the download information, and the retransmission request is sent to the data transmission device.

[0059] In a possible implementation, the download information further includes download instructions corresponding to each download package number; the sending module is specifically configured to:

[0060] Determining target information corresponding to the error data in the download information, the target information including a target download package number corresponding to the error data, a data volume corresponding to the target download package number, and a download instruction corresponding to the target download package number;

[0061] Determine that the retransmission request includes the target information.

[0062] In a fourth aspect, an embodiment of the present application provides a data acquisition device, which is applied to a data transmission device. The device includes: a determination module, a sending module, an acquisition module, and a receiving module, wherein:

[0063] In response to an acquisition request of a data acquisition device, the determination module is used to determine a total amount of target data corresponding to the acquisition request, wherein the acquisition request is used to request acquisition of the target data;

[0064] The determination module is further used to determine the download information of the target data according to the total data volume;

[0065] The sending module is used to send the download information to the data acquisition device, wherein the download information includes the total number of download packages corresponding to the target data and the data volume corresponding to each download package number;

[0066] The acquisition module is used to acquire the target data from the data storage device according to the download information;

[0067] The sending module is also used to send the target data to the data acquisition device;

[0068] The receiving module is used to receive a retransmission request sent by the data acquisition device, wherein the retransmission request is used to request to obtain error data, and the error data is data in the target data that is not successfully received by the data acquisition device;

[0069] The acquisition module is further used to acquire the error data from the data storage device according to the retransmission request;

[0070] The sending module is further used to send the error data to the data acquisition device.

[0071] In a possible implementation, the determining module is specifically configured to:

[0072] Determining whether the total data volume is greater than or equal to a preset threshold;

[0073] If the total data volume is less than the preset threshold, it is determined that the total number of download packages included in the download information is one, and the data volume corresponding to the number of download packages is the total data volume.

[0074] If the total data volume is greater than or equal to the preset threshold, the download information is determined according to the total data volume and the preset threshold.

[0075] In a possible implementation, the determining module is specifically configured to:

[0076] Determining the total number of downloaded packages as a ratio of the total data volume to the preset threshold;

[0077] Determine that the amount of data corresponding to the number of download packages i is the preset threshold, where i is 1, 2, ..., N-1, N is the total number of download packages, and N is an integer greater than or equal to 2;

[0078] The product of N-1 and the preset threshold is determined, and the data volume corresponding to the number of download packages N is determined as the difference between the total data volume and the product.

[0079] In a possible implementation, the download information further includes download instructions corresponding to each download package number; the acquisition module is specifically configured to:

[0080] Sending the download information to the data storage device, so that the data storage device determines corresponding data according to the download instructions corresponding to each download package number;

[0081] Receive data corresponding to each number of download packages sent by the data storage device.

[0082] In a fifth aspect, an embodiment of the present application provides an electronic device, including: a memory, a processor;

[0083] The memory stores computer-executable instructions;

[0084] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the above first aspect and / or various possible implementations of the first aspect.

[0085] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-readable storage medium is stored computer execution instructions, and when the computer execution instructions are executed by a processor, they are used to implement the first aspect above and / or various possible implementation methods of the first aspect.

[0086] In a seventh aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the above first aspect and / or various possible implementation methods of the first aspect.

[0087] The data acquisition method, apparatus, device and storage medium provided by the embodiments of the present application can send an acquisition request to the data transmission device, and the acquisition request is used to request to obtain the target data; can receive the download information of the target data sent by the data transmission device, and receive the target data; can determine the error data according to the download information; and can send a retransmission request to the data transmission device until all the target data are successfully received, and the retransmission request is used to request to obtain the error data. In the above method, in the case of error data, the data storage device can only request to obtain the error data without requesting to re-acquire all the target data, thereby improving the efficiency of data acquisition. BRIEF DESCRIPTION OF THE DRAWINGS

[0088] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0089] Figure 1 A schematic diagram of a data acquisition system provided in an embodiment of the present application;

[0090] Figure 2 A flowchart of a data acquisition method provided in an embodiment of the present application;

[0091] Figure 3 A flowchart of another data acquisition method provided in an embodiment of the present application;

[0092] Figure 4 A flowchart of another data acquisition method provided in an embodiment of the present application;

[0093] Figure 5 A flowchart of another data acquisition method provided in an embodiment of the present application;

[0094] Figure 6A flowchart of a data acquisition method provided in an embodiment of the present application;

[0095] Figure 7 A schematic diagram of the structure of a data acquisition device provided in an embodiment of the present application;

[0096] Figure 8 A schematic diagram of the structure of another data acquisition device provided in an embodiment of the present application;

[0097] Fig. 9 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0098] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0099] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0100] To facilitate understanding, the technical terms involved in the embodiments of the present application are first explained.

[0101] Structured Query Language (SQL): is a standard programming language for managing and manipulating relational databases. It is used to perform various tasks such as querying data, updating data, inserting data, deleting data, and creating and modifying database structures such as tables and indexes.

[0102] For ease of understanding, the following Figure 1 , the data acquisition system involved in this application is described.

[0103] Figure 1 Schematic diagram of a data acquisition system provided in an embodiment of the present application. Figure 1 As shown, the data acquisition system may include a data acquisition device, a data transmission device, and a data storage device, and the data transmission device may communicate with the data acquisition device and the data storage device respectively.

[0104] Data storage devices may also be referred to as data source devices. Data storage devices may be used to store business data.

[0105] The data transmission device can obtain data from the data storage device and can send data to the data acquisition device.

[0106] The data acquisition device can request the data transmission device to obtain business data from the data storage device.

[0107] In actual implementation, the data acquisition device may initiate a data acquisition request to the data transmission device. The data transmission device may download data from the data storage device through one or more download operations according to the data acquisition request, and may send data to the data acquisition device through one or more send operations.

[0108] Specifically, if the data transmission device downloads data from the data storage device through a download operation, the data can be sent to the data acquisition device through a send operation. Accordingly, the data acquisition device can download the data sent by the data transmission device through a download operation.

[0109] If the data transmission device downloads data from the data storage device through multiple download operations, the data can be sent to the data acquisition device through multiple sending operations. Correspondingly, the data acquisition device can download the data sent by the data transmission device through multiple download operations.

[0110] Currently, for a data acquisition request, if the data acquisition device fails to download once or multiple times, the data acquisition device needs to initiate a data acquisition request to the data transmission device again. In other words, if there is data that has not been successfully downloaded, the data acquisition device needs to request to re-acquire all the data, resulting in low data acquisition efficiency.

[0111] In view of this, an embodiment of the present application provides a data acquisition method, in which a data acquisition device can only request to re-acquire data that failed to be downloaded, thereby avoiding re-acquiring all data. In this way, the amount of data acquired can be reduced and the data acquisition efficiency can be improved.

[0112] In addition, in the data acquisition method provided in the embodiment of the present application, the data acquisition device does not need to reread and acquire the successfully downloaded data, thereby avoiding repeated occupation of download resources, shortening the occupation time of download resources, and further increasing the utilization rate of download resources.

[0113] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0114] Figure 2This is a flow chart of a data acquisition method provided in an embodiment of the present application. The execution subject of the method can be a data acquisition device, or a data acquisition device set in a data acquisition device. The data acquisition device can be implemented by software, or by a combination of software and hardware. Figure 2 , the method may include:

[0115] S201. Send an acquisition request to a data transmission device, where the acquisition request is used to request to acquire target data.

[0116] The data transmission device may be an electronic device that can communicate with the data storage device and download data from the data storage device, for example, a server or a computer.

[0117] Furthermore, a middleware system may be run in the data transmission device, and the middleware system may receive an acquisition request sent by the data acquisition device and download data from the data storage device.

[0118] The acquisition request may include the storage address of the target data, the address of the middleware system, and the download instruction corresponding to the target data.

[0119] The address of the middleware system is used by the data transmission device to process the acquisition request through the middleware system. For example, the address of the middleware system can be Process Interchange (PI).

[0120] The storage address of the target data is used for the data transmission device to download the data. The storage address of the target data may also be a data source uniform resource locator (URL). For example, the storage address of the target data may be Java Database Connectivity (JDBC) information of the data storage device.

[0121] The download instruction corresponding to the target data is used by the data storage device to query the target data. The download instruction may be a structured query language (SQL).

[0122] Optionally, the acquisition request may also include an account number and password, etc. The data storage device may perform security verification based on the account number and password.

[0123] S202: Receive download information of target data sent by the data transmission device, and receive the target data.

[0124] After receiving the acquisition request, the data transmission device may determine the download information according to the acquisition request, may acquire the target data from the data storage device, and may send the download information and the target data to the data acquisition device.

[0125] The download information includes the total number of download packages corresponding to the target data and the data volume corresponding to each download package number.

[0126] The download information is described below in conjunction with Table 1.

[0127] Table 1

[0128]

[0129] As shown in Table 1, the request number may be the number of the acquisition request sent by the data acquisition device. The number of download packages may be the number of download packages corresponding to the request number. The sequence number may be used to indicate the order of data in the number of download packages. As shown in Table 1, the total number of download packages corresponding to acquisition request 1 may be 2, the amount of data corresponding to download package number 1 may be 3000 pieces of data, and the amount of data corresponding to download package number 2 may be 2765 pieces of data.

[0130] It should be noted that the method for determining the download information can be found in Figure 4 Example or Figure 5 The embodiments are not described in detail here.

[0131] S203: Determine error data according to the downloaded information.

[0132] The error data refers to the data in the target data that the data acquisition device has not successfully downloaded.

[0133] In this embodiment, the data acquisition device may include a Robotic Process Automation (RPA) component. The data acquisition device may detect the download status corresponding to each download package number through the RPA component, and the download status may be a successful state or an unsuccessful state; and determine the error data according to the download status corresponding to each download package number and the download information.

[0134] Specifically, the data acquisition device can download the target data from the data transmission device through one or more download operations according to the number of download packages in the download information; and can detect the download status corresponding to each download package number through the RPA component.

[0135] In this embodiment, for any number of download packages, if the download status corresponding to the number of download packages is an unsuccessful status, the data acquisition device determines the data corresponding to the number of download packages as error data.

[0136] S204: Send a retransmission request to the data transmission device until all target data are successfully received, where the retransmission request is used to request to obtain erroneous data.

[0137] In this embodiment, after determining the erroneous data, the data acquisition device may request to re-acquire the erroneous data through a retransmission request.

[0138] In the data acquisition method provided by this embodiment, the data acquisition device can send an acquisition request to the data transmission device, and the acquisition request is used to request to obtain the target data; it can receive the download information of the target data sent by the data transmission device, and receive the target data; it can determine the error data according to the download information; and it can send a retransmission request to the data transmission device until all the target data are successfully received, and the retransmission request is used to request to obtain the error data. In the above method, in the case of error data, the data storage device can only request to obtain the error data without requesting to re-acquire all the target data, thereby improving the data acquisition efficiency.

[0139] exist Figure 2 Based on the examples below, combined Figure 3 , further illustrating the data acquisition method performed by the data acquisition device.

[0140] Figure 3 This is a flow chart of another data acquisition method provided by an embodiment of the present application. The execution subject of the method can be a data acquisition device, or a data acquisition device set in the data acquisition device. The data acquisition device can be implemented by software, or by a combination of software and hardware. Figure 3 , the method may include:

[0141] S301. Send an acquisition request to a data transmission device, where the acquisition request is used to request to acquire target data.

[0142] S302: Receive download information of target data sent by the data transmission device, and receive the target data.

[0143] It should be noted that the specific implementation method of S301-S302 can refer to S201-S202 and will not be repeated here.

[0144] In this embodiment, the data acquisition device may send multiple acquisition requests to the data transmission device to acquire the target data corresponding to each acquisition request. The data acquisition device may receive download information corresponding to each acquisition request sent by the data transmission device, so as to record the download status of the target data corresponding to each acquisition request according to the download information.

[0145] In the following, in conjunction with Table 2, the download information corresponding to each acquisition request recorded by the data acquisition device is described.

[0146] Table 2

[0147]

[0148] As shown in Table 2, the total number of download packages corresponding to the acquisition request 1 may be 10, and the number of download packages successfully acquired is 6. The total number of download packages corresponding to the acquisition request 2 may be 8, and the number of download packages successfully acquired is 7. The total number of download packages corresponding to the acquisition request 3 may be 12, and the number of download packages successfully acquired is 12.

[0149] The data acquisition device can determine whether the target data corresponding to each acquisition request has been successfully acquired according to the content recorded in Table 2.

[0150] It should be noted that the data acquisition device may also record the download date, download user ID, total data volume, etc. corresponding to each acquisition request. Table 2 is only an exemplary description and does not constitute a limitation on the technical solution provided in the embodiment of the present application.

[0151] It should be noted that the request number can also be used to indicate the initiating organization corresponding to the acquisition request. For example, the request number may include: the code of the initiating organization corresponding to the acquisition request (such as the provincial company code or the municipal company code, etc.), the type of target data (such as payment data or reserve data, etc.), the identifier of the data storage system (such as the payment system or the reserve system), the year, month, and day, and the request sequence number, etc.

[0152] For example, the request number can be: P0613Y510120210701001, where P0613 represents the payment system, Y represents business data, 5101 represents the XX city company under the XX province company, 20210701 represents the data time point July 1, 2021, and 001 is the acquisition request with sequence number 001 requested in this time period.

[0153] Optionally, the request number may also include an identifier of a specific business organization in the initiating organization. For example, the specific business organization in the initiating organization may be a business attribution organization.

[0154] It should be noted that, for any content recorded in Table 2 (any row of content in Table 2), the data acquisition device can respond to a user's click or other operation to display detailed information corresponding to the content. Below, taking the content corresponding to request number 2 in Table 2 as an example, in combination with Table 3, detailed information corresponding to any content is described.

[0155] Table 3

[0156]

[0157] As shown in Table 3, the user ID corresponding to request number 2 in Table 2 is user ID 1, that is, the acquisition request with request number 2 can be a request initiated by the user corresponding to user ID 1 through the data acquisition device. The total number of download packages is 10, that is, the data acquisition device can obtain the target data corresponding to the acquisition request with request number 2 through 10 download operations. The number of download packages successfully obtained is 7, that is, the data acquisition device has successfully downloaded data corresponding to 7 download packages. The download date is 2023.11.06, which is used to indicate that the data acquisition device downloaded the target data corresponding to the acquisition request with request number 2 on November 6, 2023.

[0158] S303. Detect the download status corresponding to each download package number through the RPA component. The download status is a success status or an unsuccessful status.

[0159] In this embodiment, for any download package number, the data acquisition device can detect whether the data corresponding to the download package number is downloaded successfully through the RPA component; if the data corresponding to the download package number is downloaded successfully, the download status corresponding to the download package number is a successful status; if the data corresponding to the download package number is not downloaded successfully, the download status corresponding to the download package number is an unsuccessful status.

[0160] Specifically, for any download package number, if the data acquisition device detects through the RPA component that the data corresponding to the download package number has been downloaded successfully, it can be determined that the download status corresponding to the download package number is a successful status; if the data acquisition device detects through the RPA component that the data corresponding to the download package number has failed to be downloaded, it can be determined that the download status corresponding to the download package number is an unsuccessful status.

[0161] In this embodiment, the data acquisition device can automatically identify the download status corresponding to each download package number through the RPA component, without the need to manually monitor the download status corresponding to each download package number, thereby reducing the manpower cost of monitoring operation and maintenance.

[0162] S304: Determine error data according to the download status corresponding to each download package number and the download information.

[0163] In this embodiment, the data acquisition device can determine the target number of download packages in the download information, and the download status of the target number of download packages is an unsuccessful status; and determine the data corresponding to the target number of download packages as error data.

[0164] For example, assuming that the total number of download packages is 3, the 3 download package numbers are download package number 1, download package number 2, and download package number 3. Assuming that the download status corresponding to download package number 3 is an unsuccessful status, the data acquisition device can determine download package number 3 as the target download package number, and can determine the data corresponding to download package number 3 as error data.

[0165] S305: Determine a retransmission request according to the download information.

[0166] In this embodiment, the download information may also include sub-download instructions corresponding to each download package number. The data acquisition device may determine the target information corresponding to the erroneous data in the download information, the target information including the target download package number corresponding to the erroneous data, the data volume corresponding to the target download package number, and the sub-download instructions corresponding to the target download package number; determine that the retransmission request includes the target information.

[0167] Specifically, the data acquisition device may determine that the retransmission request includes the target download packet number corresponding to the erroneous data, the data volume corresponding to the target download packet number, and the sub-download instructions corresponding to the target download packet number.

[0168] S306: Send a retransmission request to the data transmission device.

[0169] The data acquisition method provided in this embodiment is that the data acquisition device can send an acquisition request to the data transmission device, and the acquisition request is used to request to obtain the target data; the download information of the target data sent by the data transmission device can be received, and the target data can be received; the download status corresponding to each download package number can be detected through the RPA component, and the download status is a successful state or an unsuccessful state; the error data can be determined according to the download status corresponding to each download package number and the download information; the retransmission request can be determined according to the download information, and the retransmission request is sent to the data transmission device. In the above method, the data acquisition device can automatically detect whether the data corresponding to each download package number is successfully downloaded, and can only request to re-acquire the error data without requesting to re-acquire all target data, thereby improving the data acquisition efficiency. Through the above method, data download resources can be saved, and during the peak period of data download, the problem of low download efficiency caused by the shortage of data download resources can be reduced, thereby improving the user experience.

[0170] Based on any of the above embodiments, Figure 4 , a data acquisition method performed by a data transmission device is described.

[0171] Figure 4 A flowchart of another data acquisition method provided in an embodiment of the present application. The execution subject of the method can be a data transmission device, or a data transmission device set in the data transmission device. The data transmission device can be implemented by software, or by a combination of software and hardware. Figure 4 , the method may include:

[0172] S401, responding to an acquisition request from a data acquisition device, and determining a total data volume of target data corresponding to the acquisition request.

[0173] Get request is used to request to get the target data.

[0174] In this embodiment, the data transmission device may send an acquisition request to the data storage device, so that the data transmission device can query the total data volume of the target data according to the data acquisition request. The data transmission device can obtain the total data volume of the target data from the data storage device.

[0175] The total amount of target data can be represented by the capacity of the storage space occupied by the target data, or the total amount of target data can also be represented by the number of data items. For example, the total amount of target data can be 1 GB, or the total amount of target data can also be 300 data items.

[0176] Specifically, the acquisition request may include a download instruction for the target data, and the data transmission device may send the download instruction for the target data to the data storage device. The data transmission device may query the total data volume of the target data according to the download instruction for the target data, and may send the total data volume of the target data to the data transmission device.

[0177] S402: Determine download information of target data according to the total data volume, and send the download information to the data acquisition device.

[0178] The download information includes the total number of download packages corresponding to the target data and the data volume corresponding to each download package number.

[0179] In this embodiment, if the target data has a small amount of data, the data transmission device may determine that the total number of download packages corresponding to the target data is one; if the target data has a large amount of data, the data transmission device may determine that the total number of download packages corresponding to the target data is multiple, where multiple may be two or more.

[0180] Taking Table 1 as an example, assuming that the total data volume of the target data is 5765 data items, the data transmission device can determine that the total number of download packages is 2, the data volume corresponding to download package number 1 can be 3000 data items, and the data volume corresponding to download package number 2 can be 2756 data items.

[0181] S403: Acquire target data from the data storage device according to the download information, and send the target data to the data acquisition device.

[0182] The data transmission device may obtain the target data from the data storage device through one or more download operations according to the total number of download packages in the download information.

[0183] It should be noted that the total number of packets of target data obtained by the data transmission device from the data storage device is the same as the total number of packets of target data sent by the data transmission device to the data acquisition device.

[0184] For example, assuming that the total number of download packages corresponding to the target data is 1, the data transmission device can obtain the target data from the data storage device through 1 download operation, and can send the target data to the data acquisition device through 1 send operation. Assuming that the total number of download packages corresponding to the target data is 5, the data transmission device can obtain the target data from the data storage device through 5 download operations, and can send the target data to the data acquisition device through 5 send operations.

[0185] S404: Receive a retransmission request sent by the data acquisition device.

[0186] The retransmission request is used to request to obtain error data, where the error data is data in the target data that is not successfully received by the data acquisition device.

[0187] In this embodiment, when there is erroneous data, the data acquisition device may send a retransmission request to the data transmission device to request to re-acquire the erroneous data.

[0188] S405 , acquiring error data from the data storage device according to the retransmission request, and sending the error data to the data acquisition device.

[0189] The data transmission device may obtain the erroneous data from the data storage device according to the retransmission request, and may send the erroneous data to the data acquisition device.

[0190] In the data acquisition method provided in this embodiment, the data transmission device responds to the acquisition request of the data acquisition device, and can determine the total data volume of the target data corresponding to the acquisition request; can determine the download information of the target data based on the total data volume, and send the download information to the data acquisition device; can obtain the target data from the data storage device based on the download information, and send the target data to the data acquisition device; can receive the retransmission request sent by the data acquisition device; can obtain the error data from the data storage device based on the retransmission request, and send the error data to the data acquisition device. In the above method, in the case of error data, the data transmission device only sends the error data to the data acquisition device, without sending all the target data to the data acquisition device, thereby improving the data acquisition efficiency. Through the above method, the data transmission device can quickly transmit the target data to the data acquisition device without being in the data transmission state for a long time, so that the overhead of the data transmission device is small and the resource utilization rate is high.

[0191] exist Figure 4 Based on the examples below, combined Figure 5 , further illustrating the data acquisition method performed by the data transmission device.

[0192] Figure 5A flowchart of another data acquisition method provided in an embodiment of the present application. The execution subject of the method can be a data transmission device, or a data transmission device set in the data transmission device. The data transmission device can be implemented by software, or by a combination of software and hardware. Figure 5 , the method may include:

[0193] S501: respond to an acquisition request from a data acquisition device and determine the total data volume of target data corresponding to the acquisition request.

[0194] It should be noted that the specific implementation method of S501 can refer to S401 and will not be repeated here.

[0195] S502: Determine whether the total data volume is greater than or equal to a preset threshold.

[0196] If not, it is determined that the total number of download packages included in the download information is one, and the data volume corresponding to the number of download packages is the total data volume.

[0197] If yes, execute S503.

[0198] The preset threshold value may be the maximum amount of data that the data transmission device obtains from the data storage device at one time, or the maximum amount of data that the data acquisition device obtains from the data transmission device at one time. In this embodiment, the maximum amount of data that the data transmission device obtains from the data storage device at one time is the same as the maximum amount of data that the data acquisition device obtains from the data transmission device at one time.

[0199] For example, assuming that the preset threshold is 3000 data items, the maximum amount of data that the data transmission device can obtain from the data storage device at one time is 3000 data items, and the maximum amount of data that the data acquisition device can obtain from the data transmission device at one time is also 3000 data items.

[0200] The preset threshold may be a threshold pre-stored in the data transmission device; or, the acquisition request may include the preset threshold; or, the data acquisition device may send the preset threshold to the data transmission device via other messages.

[0201] In this embodiment, if the total amount of target data is less than a preset threshold, the data transmission device can obtain the target data from the data storage device through a download operation, and the data acquisition device can also obtain the target data from the data transmission device through a download operation.

[0202] S503: Determine download information according to the total data volume and a preset threshold.

[0203] In this embodiment, if the total data volume of the target data is greater than or equal to a preset threshold, the data transmission device can determine the total number of download packages as the ratio of the total data volume to the preset threshold; determine the data volume corresponding to the number of download packages i as the preset threshold, i is 1, 2...N-1, N is the total number of download packages, and N is an integer greater than or equal to 2; determine the product of N-1 and the preset threshold, and determine the data volume corresponding to the number of download packages N as the difference between the total data volume and the product.

[0204] It should be noted that if the ratio of the total data volume to the preset threshold is a decimal, the data transmission device can determine the ratio of the total data volume to the preset threshold, and can round up the ratio to determine the value obtained as the total number of download packages.

[0205] For example, if the preset threshold is 3000 and the total data volume is 10000, the total number of download packages can be 4, the data volume corresponding to download package number 1, download package number 2 and download package number 3 can be 3000, and the data volume corresponding to download package number 4 can be 10000-3000*3=1000.

[0206] It should be noted that when determining the download information, the data transmission device can determine the sub-download instructions corresponding to each download package number according to the download instruction in the acquisition request. For any download package number, the sub-download instruction corresponding to the download package number is used for the data storage device to query the data corresponding to the download package number.

[0207] The download information is further described below in conjunction with Table 4.

[0208] Table 4

[0209]

[0210] As shown in Table 4, based on Table 1, the download information may further include download instructions corresponding to each download package number. For example, the download instruction corresponding to download package number 1 may be sub-download instruction 1, and the download instruction corresponding to download package number 2 may be sub-download instruction 2.

[0211] It should be noted that the download instruction included in the acquisition request may be SQL. The sub-download instruction determined by the data transmission device may also be SQL. The sub-download instruction may be in the form of Select Skip.

[0212] Optionally, the download information may also include other contents. The other contents may include the storage address of the target data, the number of acquisition packages corresponding to each download package number, etc. Among them, for any download package number, the number of acquisition packages corresponding to the download package number may be the number of packages of data corresponding to the download package number acquired by the data acquisition device from the data transmission device.

[0213] S504: Send download information to the data acquisition device.

[0214] It should be noted that S503 can be executed before S504; or S503 and S504 can be executed simultaneously; or S503 can be executed after S504. This embodiment is described by taking S503 executed before S504 as an example, which does not constitute a limitation on the technical solution provided in the embodiment of the present application.

[0215] S505: Send download information to the data storage device.

[0216] In this embodiment, after the data transmission device determines the download information, it can send the download information to the data acquisition device, so that the data acquisition device can determine the erroneous data according to the download information.

[0217] In this embodiment, the data transmission device may concurrently send sub-download instructions corresponding to each download package number in the download information to the data storage device; or, the data transmission device may also send sub-download instructions corresponding to one or more download package numbers to the data storage device at regular time intervals.

[0218] For example, assuming that the total number of download packages in the download information is 30, the data transmission device can concurrently send download instructions corresponding to each number of download packages to the data storage device; the data transmission device can also send a download instruction corresponding to a number of download packages at fixed time intervals (for example, 240 seconds).

[0219] S506: Receive data corresponding to each number of download packages sent by the data storage device.

[0220] In this embodiment, download information can be sent to a data storage device so that the data storage device can determine the data corresponding to each download package number based on the sub-download instructions corresponding to each download package number in the download information, and can send the data corresponding to each download package number to a data storage device.

[0221] S507: Send target data to the data acquisition device.

[0222] After receiving the data corresponding to each download package number sent by the data storage device, the data transmission device can send the data corresponding to each download package number to the data acquisition device. In other words, after receiving the target data sent by the data storage device, the data transmission device can send the target data to the data acquisition device.

[0223] In this embodiment, the acquisition request may also include a callback address. The data transmission device may call the callback address to send the target data to the data acquisition device.

[0224] Optionally, the data transmission device may process the target data into a file in an extensible markup language (XML) format, and may send the file in the XML format to the data acquisition device.

[0225] S508: Receive a retransmission request sent by the data acquisition device.

[0226] In this embodiment, if there is erroneous data, the data acquisition device may send a retransmission request to the data transmission device to request to re-acquire the erroneous data.

[0227] S509: Acquire error data from the data storage device according to the retransmission request.

[0228] In this embodiment, the data transmission device may obtain the error data from the data storage device.

[0229] Specifically, the retransmission request may include a download instruction corresponding to the erroneous data. The data transmission device may forward the retransmission request to the data storage device. The data storage device may determine the erroneous data according to the download instruction corresponding to the erroneous data in the retransmission request, and may send the erroneous data to the data transmission device.

[0230] S510: Send error data to a data acquisition device.

[0231] In the data acquisition method provided by the present embodiment, the data transmission device responds to the acquisition request of the data acquisition device, and can determine the total data volume of the target data corresponding to the acquisition request; if the total volume is less than the preset threshold, it can be determined that the total number of download packages included in the download information is one, and the data volume corresponding to the number of download packages is the total data volume; if the total data volume is greater than or equal to the preset threshold, the download information can be determined based on the total data volume and the preset threshold; the download information can be sent to the data storage device; the data corresponding to each number of download packages sent by the data storage device can be received; the target data can be sent to the data acquisition device; the retransmission request sent by the data acquisition device can be received; the error data can be obtained from the data storage device according to the retransmission request; and the error data can be sent to the data acquisition device. In the above method, in the case of error data, the data transmission device only sends the error data to the data acquisition device, without sending all the target data to the data acquisition device, thereby improving the data acquisition efficiency.

[0232] Based on any of the above embodiments, Figure 6 , the data acquisition method provided in the embodiment of the present application is further explained.

[0233] Figure 6 A flowchart of a data acquisition method provided in an embodiment of the present application. Figure 6 , the method may include:

[0234] S601: A data acquisition device sends an acquisition request to a data transmission device.

[0235] S602: The data transmission device determines the total data volume of the target data corresponding to the acquisition request according to the acquisition request.

[0236] S603: If the total data volume is less than a preset threshold, the data transmission device determines that the total number of download packages included in the download information is one, and the data volume corresponding to the number of download packages is the total data volume.

[0237] S604: If the total data volume is greater than or equal to the preset threshold, the data transmission device determines download information according to the total data volume and the preset threshold.

[0238] S605: The data transmission device sends download information to the data acquisition device.

[0239] S606: The data transmission device sends download information to the data storage device.

[0240] S607: The data transmission device receives data corresponding to each number of download packages sent by the data storage device.

[0241] S608: The data transmission device sends data corresponding to each number of download packages to the data acquisition device.

[0242] It should be noted that the specific implementation method of S602-S608 can refer to S501-S507 and will not be repeated here.

[0243] S609. The data acquisition device detects the download status corresponding to each download package number through the RPA component. The download status is a success status or an unsuccessful status.

[0244] S610: The data acquisition device determines error data according to the download status corresponding to each download package number and the download information.

[0245] S611. The data acquisition device determines a retransmission request according to the download information, where the retransmission request is used to request to acquire erroneous data.

[0246] S612: The data acquisition device sends a retransmission request to the data transmission device.

[0247] It should be noted that the specific implementation method of S609-S612 can refer to S303-S306 and will not be repeated here.

[0248] S613: The data transmission device obtains the erroneous data from the data storage device according to the retransmission request.

[0249] S614: The data transmission device sends error data to the data acquisition device.

[0250] It should be noted that the specific implementation method of S613-S614 can be found in S509-S510 and will not be repeated here.

[0251] Figure 7 This is a schematic diagram of the structure of a data acquisition device provided in an embodiment of the present application. Figure 7 The data acquisition device is applied to a data acquisition device, and the data acquisition device 10 includes: a sending module 11, a receiving module 12, and a determining module 13, wherein:

[0252] The sending module 11 is used to send an acquisition request to the data transmission device, wherein the acquisition request is used to request to acquire target data;

[0253] The receiving module 12 is used to receive download information of target data sent by the data transmission device and receive the target data, wherein the download information includes the total number of download packages corresponding to the target data and the data volume corresponding to each download package number;

[0254] The determination module 13 is used to determine error data according to the download information, where the error data is data in the target data that is not successfully downloaded by the data acquisition device;

[0255] The sending module 11 is further used to send the retransmission request to the data transmission device until all target data are successfully received, and the retransmission request is used to request to obtain the erroneous data.

[0256] The data acquisition device provided in this embodiment can be used to execute the data acquisition method executed by the data acquisition device in the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail here.

[0257] In a possible implementation, the data acquisition device includes a robotic process automation (RPA) component; the determination module 13 is specifically configured to:

[0258] The RPA component detects the download status corresponding to each download package number, where the download status is a success status or an unsuccessful status;

[0259] The error data is determined according to the download status corresponding to each download package number and the download information.

[0260] In a possible implementation, for any number of download packages, the determining module 13 is specifically configured to:

[0261] Detecting, by the RPA component, whether the data corresponding to the number of download packages is downloaded successfully;

[0262] If the data corresponding to the download package number is downloaded successfully, the download status corresponding to the download package number is a success status;

[0263] If the data corresponding to the download package number is not downloaded successfully, the download status corresponding to the download package number is an unsuccessful status.

[0264] In a possible implementation, the determining module 13 is specifically configured to:

[0265] Determining a target number of download packages in the download information, wherein the download status of the target number of download packages is an unsuccessful status;

[0266] The data corresponding to the target number of download packages is determined as the error data.

[0267] In a possible implementation, the sending module 11 is specifically used to:

[0268] The retransmission request is determined according to the download information, and the retransmission request is sent to the data transmission device.

[0269] In a possible implementation, the download information further includes download instructions corresponding to each download package number; the sending module 11 is specifically configured to:

[0270] Determining target information corresponding to the error data in the download information, the target information including a target download package number corresponding to the error data, a data volume corresponding to the target download package number, and a download instruction corresponding to the target download package number;

[0271] Determine that the retransmission request includes the target information.

[0272] The data acquisition device provided in this embodiment can be used to execute the data acquisition method executed by the data acquisition device in the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail here.

[0273] Figure 8 This is a schematic diagram of the structure of another data acquisition device provided in an embodiment of the present application. Figure 8 The data acquisition device is applied to data transmission equipment. The data acquisition device 20 includes: a determination module 21, a sending module 22, an acquisition module 23, and a receiving module 24, wherein:

[0274] In response to an acquisition request of a data acquisition device, the determination module 21 is used to determine the total data volume of the target data corresponding to the acquisition request, wherein the acquisition request is used to request to acquire the target data;

[0275] The determination module 21 is further used to determine the download information of the target data according to the total data volume;

[0276] The sending module 22 is used to send the download information to the data acquisition device, where the download information includes the total number of download packages corresponding to the target data and the data volume corresponding to each download package number;

[0277] The acquisition module 23 is used to acquire the target data from the data storage device according to the download information;

[0278] The sending module 22 is also used to send the target data to the data acquisition device;

[0279] The receiving module 24 is used to receive a retransmission request sent by the data acquisition device, wherein the retransmission request is used to request to obtain error data, and the error data is data in the target data that is not successfully received by the data acquisition device;

[0280] The acquisition module 23 is further used to acquire the error data from the data storage device according to the retransmission request;

[0281] The sending module 22 is further used to send the error data to the data acquisition device.

[0282] The data acquisition device provided in this embodiment can be used to execute the data acquisition method executed by the data transmission device in the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail here.

[0283] In a possible implementation, the determining module 21 is specifically configured to:

[0284] Determining whether the total data volume is greater than or equal to a preset threshold;

[0285] If the total data volume is less than the preset threshold, determining that the total number of download packages included in the download information is one, and the data volume corresponding to the number of download packages is the total data volume;

[0286] If the total data volume is greater than or equal to the preset threshold, the download information is determined according to the total data volume and the preset threshold.

[0287] In a possible implementation, the determining module 21 is specifically configured to:

[0288] Determining the total number of downloaded packages as a ratio of the total data volume to the preset threshold;

[0289] Determine that the amount of data corresponding to the number of download packages i is the preset threshold, where i is 1, 2, ..., N-1, N is the total number of download packages, and N is an integer greater than or equal to 2;

[0290] The product of N-1 and the preset threshold is determined, and the data volume corresponding to the number of download packages N is determined as the difference between the total data volume and the product.

[0291] In a possible implementation, the download information further includes download instructions corresponding to each download package number; the acquisition module 23 is specifically configured to:

[0292] Sending the download information to the data storage device, so that the data storage device determines corresponding data according to the download instructions corresponding to each download package number;

[0293] Receive data corresponding to each number of download packages sent by the data storage device.

[0294] The data acquisition device provided in this embodiment can be used to execute the data acquisition method executed by the data transmission device in the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail here.

[0295] Fig. 9 This is a hardware structure diagram of an electronic device provided in an embodiment of the present application. Fig. 9 The electronic device 30 may include: a processor 31 and a memory 32, wherein the processor 31 and the memory 32 can communicate; illustratively, the processor 31 and the memory 32 communicate via a communication bus 33, the memory 32 is used to store computer-executable instructions, and the processor 31 is used to call the computer-executable instructions in the memory to execute the method shown in any of the above method embodiments.

[0296] Optionally, the electronic device 30 may further include a communication interface, which may include a transmitter and / or a receiver.

[0297] Optionally, the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc. The steps of the method disclosed in the present application may be directly implemented as being executed by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.

[0298] The electronic device 30 may be a data acquisition device or a data transmission device involved in any of the above embodiments.

[0299] The present application provides a computer-readable storage medium, on which computer-executable instructions are stored; the computer-executable instructions are used to implement the method described in any of the above method embodiments.

[0300] An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed, the computer executes the method shown in any of the above method embodiments.

[0301] All or part of the steps of the above-mentioned method embodiments can be completed by hardware related to program instructions. The above-mentioned program can be stored in a readable memory. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the above-mentioned memory (storage medium) includes: read-only memory (English: read-only memory, abbreviated: ROM), RAM, flash memory, hard disk, solid state drive, magnetic tape (English: magnetic tape), floppy disk (English: floppy disk), optical disc (English: optical disc) and any combination thereof.

[0302] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable terminal device to generate a machine, so that the instructions executed by the processing unit of the computer or other programmable terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0303] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0304] These computer program instructions can also be loaded onto a computer or other programmable terminal device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0305] Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

[0306] In the present application, the term "include" and its variations may refer to non-restrictive inclusion; the term "or" and its variations may refer to "and / or". The terms "first", "second", etc. in the present application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. In the present application, "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previously associated objects are in an "or" relationship.

[0307] Those skilled in the art will readily come up with other embodiments of the present application after considering the invention disclosed in the specification and practice. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary technical means in the art that are not disclosed in the present application.

Claims

1. A data acquisition method, characterized in that: Applied to a data acquisition device, the method comprises: Sending an acquisition request to a data transmission device, wherein the acquisition request is used to request acquisition of target data; receiving download information of target data sent by the data transmission device, and receiving the target data, wherein the download information includes a total number of download packages corresponding to the target data, and a data volume corresponding to each number of download packages; Determining error data according to the download information, wherein the error data is data in the target data that is not successfully downloaded by the data acquisition device; A retransmission request is sent to the data transmission device until all target data are successfully received, wherein the retransmission request is used to request to obtain the erroneous data.

2. The method according to claim 1, characterized in that The data acquisition device includes a robotic process automation (RPA) component; and determining error data according to the downloaded information includes: The RPA component detects the download status corresponding to each download package number, where the download status is a success status or an unsuccessful status; The error data is determined according to the download status corresponding to each download package number and the download information.

3. The method according to claim 2, characterized in that For any number of download packages, the RPA component detects the download status corresponding to the number of download packages, including: Detecting, by the RPA component, whether the data corresponding to the number of download packages is downloaded successfully; If the data corresponding to the download package number is downloaded successfully, the download status corresponding to the download package number is a success status; If the data corresponding to the download package number is not downloaded successfully, the download status corresponding to the download package number is an unsuccessful status.

4. The method according to claim 2 or 3, characterized in that: Determining the error data according to the download status corresponding to each download package number and the download information includes: Determining a target number of download packages in the download information, wherein the download status of the target number of download packages is an unsuccessful status; The data corresponding to the target number of download packages is determined as the error data.

5. The method according to any one of claims 1 to 4, characterized in that: Sending the retransmission request to the data transmission device includes: The retransmission request is determined according to the download information, and the retransmission request is sent to the data transmission device.

6. The method according to claim 5, characterized in that The download information also includes download instructions corresponding to each number of download packages; and determining the retransmission request according to the download information includes: Determining target information corresponding to the error data in the download information, the target information including a target download package number corresponding to the error data, a data volume corresponding to the target download package number, and a download instruction corresponding to the target download package number; Determine that the retransmission request includes the target information.

7. A data acquisition method, characterized in that: Applied to data transmission equipment, the method comprises: In response to an acquisition request of a data acquisition device, determining a total amount of target data corresponding to the acquisition request, wherein the acquisition request is used to request acquisition of the target data; Determine the download information of the target data according to the total data volume, and send the download information to the data acquisition device, wherein the download information includes the total number of download packages corresponding to the target data and the data volume corresponding to each download package number; Acquire the target data from the data storage device according to the download information, and send the target data to the data acquisition device; receiving a retransmission request sent by the data acquisition device, wherein the retransmission request is used to request to obtain error data, and the error data is data in the target data that is not successfully received by the data acquisition device; The erroneous data is acquired from the data storage device according to the retransmission request, and the erroneous data is sent to the data acquisition device.

8. The method according to claim 7, characterized in that Determining the download information of the target data according to the total data amount includes: Determining whether the total data volume is greater than or equal to a preset threshold; If the total data volume is less than the preset threshold, determining that the total number of download packages included in the download information is one, and the data volume corresponding to the number of download packages is the total data volume; If the total data volume is greater than or equal to the preset threshold, the download information is determined according to the total data volume and the preset threshold.

9. The method according to claim 8, characterized in that Determining the download information according to the total data volume and the preset threshold includes: Determining the total number of downloaded packages as a ratio of the total data volume to the preset threshold; Determine that the amount of data corresponding to the number of download packages i is the preset threshold, where i is 1, 2, ..., N-1, N is the total number of download packages, and N is an integer greater than or equal to 2; The product of N-1 and the preset threshold is determined, and the data volume corresponding to the number of download packages N is determined as the difference between the total data volume and the product.

10. The method according to any one of claims 7 to 9, characterized in that: The download information also includes download instructions corresponding to each download package number; obtaining the target data from the data storage device according to the download information includes: Sending the download information to the data storage device, so that the data storage device determines corresponding data according to the download instructions corresponding to each download package number; Receive data corresponding to each number of download packages sent by the data storage device.

11. A data acquisition device, characterized in that: Applied to a data acquisition device, the device comprises: a sending module, a receiving module, and a determining module, wherein: The sending module is used to send an acquisition request to the data transmission device, and the acquisition request is used to request to acquire the target data; The receiving module is used to receive download information of the target data sent by the data transmission device and receive the target data, wherein the download information includes the total number of download packages corresponding to the target data and the data volume corresponding to each download package number; The determination module is used to determine error data according to the download information, wherein the error data is data in the target data that is not successfully downloaded by the data acquisition device; The sending module is further used to send the retransmission request to the data transmission device until all target data are successfully received, and the retransmission request is used to request to obtain the erroneous data.

12. A data acquisition device, characterized in that: Applied to data transmission equipment, the device comprises: a determination module, a sending module, an acquisition module, and a receiving module, wherein: In response to an acquisition request of a data acquisition device, the determination module is used to determine a total amount of target data corresponding to the acquisition request, wherein the acquisition request is used to request acquisition of the target data; The determination module is further used to determine the download information of the target data according to the total data volume; The sending module is used to send the download information to the data acquisition device, wherein the download information includes the total number of download packages corresponding to the target data and the data volume corresponding to each download package number; The acquisition module is used to acquire the target data from the data storage device according to the download information; The sending module is also used to send the target data to the data acquisition device; The receiving module is used to receive a retransmission request sent by the data acquisition device, wherein the retransmission request is used to request to obtain error data, and the error data is data in the target data that is not successfully received by the data acquisition device; The acquisition module is further used to acquire the error data from the data storage device according to the retransmission request; The sending module is further used to send the error data to the data acquisition device.

13. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 6, or implements the method according to any one of claims 7 to 10.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 6, or to implement the method according to any one of claims 7 to 10 when executed by a processor.

Images