Data downloading method and device, storage medium and electronic equipment

Abstract

The invention discloses a data downloading method and device, a storage medium and electronic equipment. A server can provide a standard access mode for a user on a user level; the data downloading request sent by the user can be converted according to data access rules specified by different third-party platforms through various adapter programs arranged at the bottom layer, so that different data access rules of different third-party platforms are adapted through various adapters; therefore, the specific interaction details of the data downloaded by the user from the third-party platform are hidden by the adapter, so that the user can interact with different third-party platforms in a consistent manner.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a data downloading method, device, storage medium and electronic device. Background Art

[0002] With the rapid development of information technology, enterprises and developers usually need to obtain resources from various third-party platforms for the development and maintenance of products and services. The resources obtained may include: application update packages, data sets, software development kits (Service Development Toolkits And Software Development Kits, SDKs), documents, and other types of information and software.

[0003] However, since each third-party platform uses its own unique download method and interface specifications, the process of obtaining third-party resources for enterprises is complex and diverse. For example, a third-party platform may require the use of the Representational State Transfer Application Programming Interface (RESTful API) to request and download resources, while other third-party platforms may rely on the Simple Object Access Protocol (SOAP) or other customized communication standards to request and download resources. Because the process of obtaining third-party resources for enterprises is complex and diverse, most enterprises and developers still use manual methods to connect to third-party platform resources. This process is time-consuming and inefficient, which affects the timeliness of resource acquisition.

[0004] Therefore, how to improve the efficiency of obtaining resources from third-party platforms is an urgent problem to be solved. Summary of the invention

[0005] This specification provides a data downloading method, device, storage medium and electronic device to partially solve the above-mentioned problems existing in the prior art.

[0006] This manual adopts the following technical solutions:

[0007] This manual provides a data download method, including:

[0008] Receive data download request;

[0009] Determine the target platform identifier according to the data download request, and determine the adapter program that matches the target platform identifier from the preset adapter programs as the target adapter program, wherein different adapter programs are used to download data according to data access rules specified by different third-party platforms;

[0010] Execute the target adapter program, convert the format of the data download request into a request format that complies with the third-party platform corresponding to the target platform identifier, obtain the converted data download request, and send the converted data download request to the third-party platform corresponding to the target platform identifier to establish a data connection with the third-party platform corresponding to the target platform identifier, and download data based on the data connection.

[0011] Optionally, the step of receiving a data download request specifically includes:

[0012] Obtaining the user's permission information, and determining, based on the permission information, the platform identification information of each third-party platform that grants the user data download permission as candidate platform identification information;

[0013] Generate a user interface according to the candidate platform identification information, and display the user interface to the user;

[0014] Determining a target platform identifier and identifier information of data to be downloaded according to an operation performed by the user on the user interface;

[0015] A data download request is generated according to the target platform identifier and the identification information of the data to be downloaded.

[0016] Optionally, the step of generating a data download request according to the target platform identifier and the identifier information of the data to be downloaded specifically includes:

[0017] According to the target platform identifier, account data matching the target platform identifier is determined from the account data pre-registered on each third-party platform as target account data;

[0018] A data download request is generated according to the target platform identifier, the identification information of the data to be downloaded, and the target account data.

[0019] Optionally, the step of downloading data based on the data connection specifically includes:

[0020] Determine transmission reference information, the transmission reference information comprising: at least one of data information of the data to be downloaded corresponding to the data download request and data transmission environment information;

[0021] According to the transmission reference information, a fragmentation strategy matching the data to be downloaded is determined from various preset fragmentation strategies as a target fragmentation strategy;

[0022] According to the target sharding strategy, the data to be downloaded is divided into data shards;

[0023] Based on the data connection, the data slices are downloaded.

[0024] Optionally, the method further comprises:

[0025] In the case that an exception occurs during the process of downloading the data segments based on the data connection and the downloading is stopped, determining data download progress information;

[0026] When it is determined that the abnormality is eliminated, the data segments continue to be downloaded according to the data download progress information.

[0027] Optionally, the method further comprises:

[0028] When it is determined that the downloading of each data slice is completed, merging the data slices to obtain the target data to be detected;

[0029] Determining whether the target data to be detected satisfies a conversion condition for converting the target data to be detected into structured data conforming to a specified data structure, wherein the specified data structure is used to characterize the organizational form of each data contained in the target data;

[0030] If it is determined that the target data to be detected meets the conversion condition, the target data to be detected is converted into structured data conforming to a specified data structure as the target data.

[0031] Optionally, the method further comprises:

[0032] Determine various monitoring data in a process of data downloading based on the data connection, wherein the monitoring data is used to reflect a transmission status in the process of data transmission;

[0033] According to the data type of the to-be-downloaded data corresponding to the data download request, a target user is determined from preset designated users, and the monitoring data are sent to the target user.

[0034] This specification provides a data download device, including:

[0035] A receiving module, used for receiving a data download request;

[0036] A determination module, used to determine a target platform identifier according to the data download request, and determine an adapter program that matches the target platform identifier from preset adapter programs as a target adapter program, wherein different adapter programs are used to download data according to data access rules specified by different third-party platforms;

[0037] A download module is used to execute the target adapter program, convert the format of the data download request into a request format that complies with the third-party platform corresponding to the target platform identifier, obtain the converted data download request, and send the converted data download request to the third-party platform corresponding to the target platform identifier to establish a data connection between the third-party platform corresponding to the target platform identifier, and download data based on the data connection.

[0038] At least one of the above technical solutions adopted in this specification can achieve the following beneficial effects:

[0039] In the data download method provided in the present specification, a data download request is first received, a target platform identifier is determined based on the data download request, and an adapter program matching the target platform identifier is determined from the preset adapter programs as the target adapter program, wherein different adapter programs are used to download data in accordance with data access rules specified by different third-party platforms, the target adapter program is executed, the format of the data download request is converted into a request format that complies with the third-party platform corresponding to the target platform identifier, a converted data download request is obtained, and the converted data download request is sent to the third-party platform corresponding to the target platform identifier to establish a data connection between the third-party platform corresponding to the target platform identifier, and data download is performed based on the data connection.

[0040] It can be seen from the above method that the server can provide users with a standard access method at the user level, and can convert the data download requests sent by users according to the data access rules specified by different third-party platforms through the various adapter programs set at the bottom layer, so as to adapt to the different data access rules of different third-party platforms through various adapters, so that the specific interaction details of users downloading data from the third-party platform are hidden by the adapter, thereby enabling users to interact with different third-party platforms in a consistent manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The drawings described herein are used to provide a further understanding of this specification and constitute a part of this specification. The illustrative embodiments and descriptions of this specification are used to explain this specification and do not constitute an improper limitation on this specification. In the drawings:

[0042] Figure 1A flowchart of a data download method provided in this specification;

[0043] Figure 2 A schematic diagram of the user interface provided for this application;

[0044] Figure 3 A schematic diagram of a data downloading device provided in this specification;

[0045] Figure 4 A method corresponding to the Figure 1 Schematic diagram of electronic equipment. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solutions and advantages of this specification more clear, the technical solutions of this specification will be clearly and completely described below in combination with the specific embodiments of this specification and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of this specification, not all of them. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this specification.

[0047] The technical solutions provided by the embodiments of this specification are described in detail below in conjunction with the accompanying drawings.

[0048] Figure 1 A flowchart of a data download method provided in this specification includes the following steps:

[0049] S101: receiving a data download request.

[0050] In this specification, in the process of developing and maintaining products or services, enterprises and developers usually need to obtain resources from third-party platforms to develop and maintain products or services based on the resources obtained from the third-party platforms.

[0051] For example, an enterprise can obtain transaction reports corresponding to its products or services from various third-party payment platforms, and then analyze market dynamics, consumer behavior and industry trends based on the obtained transaction reports, and then update and maintain the products or services based on the analysis results.

[0052] For another example, an enterprise can obtain usage information of resources such as cloud computing and cloud storage used by its products or services from various third-party cloud service platforms, and then adjust the cloud resources used by the enterprise's products or services based on the usage information to reduce the cost of the enterprise's products or services.

[0053] Furthermore, when an enterprise or developer needs to obtain resources from various third-party platforms, they can send a data download request to the business platform through the user interface provided by the business platform, so that the business platform receives the data download request and establishes a data connection with the designated third-party platform based on the received data download request, so that data can be downloaded through the established data connection.

[0054] Specifically, when an enterprise or developer needs to obtain resources from various third-party platforms, they can execute the startup operation of the client provided by the business platform installed in the device on the device used. When the business platform determines that the client is started, the enterprise or developer can be regarded as the user to obtain the user's permission information. Based on the obtained permission information, the platform identification information of each third-party platform that grants the user data download permission is determined as candidate platform identification information, so that a user interface can be generated according to the candidate platform identification information through the client used by the user, and the user interface can be displayed to the user.

[0055] Furthermore, the business platform can determine the target platform identifier and the identification information of the data to be downloaded according to the operation performed by the user on the user interface, and according to the target platform identifier, determine the account data matching the target platform identifier from the account data pre-registered on each third-party platform as the target account data, and then generate a data download request according to the target platform identifier, the identification information of the data to be downloaded and the target account data, as shown in the following example: Figure 2 shown.

[0056] Figure 2 Schematic diagram of the user interface provided for this application.

[0057] Combination Figure 2 It can be seen that the user can perform touch operations on each candidate platform identification information displayed in the user interface, so that the business platform can determine the candidate platform identification selected by the user as the target platform identification based on the touch operations performed by the user, and can determine the preset default data identification information corresponding to the target platform identification as the identification information of the data to be downloaded, and then generate a data download request based on the target platform identification, the identification information of the data to be downloaded and the target account data.

[0058] Of course, the user can also perform text input operations on the text input box displayed in the user interface, so that the business platform can determine the identification information of the data to be downloaded input by the user based on the text input operation performed by the user, and then generate a data download request based on the target platform identification, the identification information of the data to be downloaded, and the target account data.

[0059] The identification information of the data to be downloaded may refer to, for example, the name of the data to be downloaded, a unique identification ID of the data to be downloaded, and the like.

[0060] The above-mentioned account data may be identification data obtained by the user and used to identify the user and have data downloading authority when downloading data from a third-party platform.

[0061] It should be noted that when the user obtains data download permissions granted by a new third-party platform, the user can enter the identification information of the new third-party platform and the account data matching the new third-party platform in the text input box provided in the above-mentioned user interface, and then, by performing a touch operation on the "Add" button provided in the above-mentioned user interface, the business platform can save the identification information of the new third-party platform and the account data matching the new third-party platform.

[0062] Similarly, users can also delete or modify the platform identification information and account data of each third-party platform that grants users data download permissions saved by the business platform by performing touch operations on the "Delete" button and "Modify" button provided in the above-mentioned user interface.

[0063] It should be noted that in order to improve data security, when the business platform saves the identification information of the third-party platform input by the user and the account data that matches the third-party platform, it can use a preset specified encryption algorithm to encrypt the identification information of the third-party platform input by the user and the account data that matches the third-party platform, so as to obtain the encrypted identification information of the third-party platform and the account data that matches the third-party platform, and then save the encrypted identification information of the third-party platform and the account data that matches the third-party platform.

[0064] The above-mentioned designated encryption algorithm may be an asymmetric encryption algorithm, such as Rivest–Shamir–Adleman (RSA) encryption algorithm, Elliptic Curve Cryptography (ECC) encryption algorithm, and the like.

[0065] In this specification, the execution entity used to implement the data download method may refer to a designated device such as a server set up on a business platform, or may refer to a terminal device such as a desktop computer or a laptop computer. For the sake of ease of description, the data download method provided in this specification is described below using the server as the execution entity as an example.

[0066] S102: Determine the target platform identifier according to the data download request, and determine the adapter program that matches the target platform identifier from the preset adapter programs as the target adapter program, wherein different adapter programs are used to download data according to data access rules specified by different third-party platforms.

[0067] It can be seen from the above content that after receiving a data download request, the server can determine the target platform identifier based on the received data download request, and then determine the adapter program that matches the target platform identifier from the preset adapter programs as the target adapter program, and then establish a data connection between the third-party platform corresponding to the target platform identifier through the target adapter program, and then download data from the third-party platform corresponding to the target platform identifier through the established data connection.

[0068] Among them, different adapter programs are used to download data according to the data access rules specified by different third-party platforms. In other words, for each adapter program, the adapter program is used to convert the data download request sent by the user into the format of the data download request specified by the corresponding third-party platform, and download data from the corresponding third-party platform in accordance with the interactive method of establishing a connection and conducting data interaction specified by the corresponding third-party platform.

[0069] The above-mentioned data access rules may refer to the format of data download requests specified by different third-party platforms, the communication protocol used to establish a connection, and the interaction method in the process of establishing a connection and conducting data interaction (for example: identity authentication, error handling, retry mechanism, data encryption, rate limiting and other specific steps of interaction).

[0070] From the above content, it can be seen that the server can adapt to different data access rules of different third-party platforms through preset adapter programs, so that the specific interaction details of downloading data from the third-party platform are hidden by the adapter, thereby enabling users to interact with different third-party platforms in a consistent manner.

[0071] S103: Execute the target adapter program, convert the format of the data download request into a request format specified by the third-party platform corresponding to the target platform identifier, obtain the converted data download request, and send the converted data download request to the third-party platform corresponding to the target platform identifier to establish a data connection with the third-party platform corresponding to the target platform identifier, and download data based on the data connection.

[0072] In this specification, the server can execute the target adapter program to convert the format of the data download request into a request format that complies with the third-party platform corresponding to the target platform identifier, obtain the converted data download request, and send the converted data download request to the third-party platform corresponding to the target platform identifier to establish a data connection with the third-party platform corresponding to the target platform identifier, and download the data to be downloaded corresponding to the data download request sent by the user from the third-party platform corresponding to the target platform identifier based on the established data connection, and then display the downloaded data to the user.

[0073] It should be noted that the above-mentioned data connection may refer to the data connection between the server and the third-party platform. At this time, after downloading the data corresponding to the data download request sent by the user, the server can send the downloaded data to the client used by the user, so that the client used by the user will display the downloaded data to the user.

[0074] Of course, the above-mentioned data connection may also refer to the data connection between the device used by the user and the third-party platform. At this time, the device used by the user can download the data corresponding to the data download request sent by the user from the third-party platform through the above-mentioned data connection, and then display the downloaded data to the user.

[0075] In actual application scenarios, when a user downloads target data from a third-party platform corresponding to the target platform identifier through an established data connection, the download may fail due to network instability, system failure, etc., and the entire target data needs to be re-downloaded when the network is restored, resulting in low file download efficiency.

[0076] Based on this, in this specification, the server can determine the transmission reference information when downloading data based on the data connection. If it is determined based on the transmission reference information that the data size of the data to be downloaded exceeds a preset first threshold, then a sharding strategy that matches the data to be downloaded can be determined from the preset sharding strategies based on the transmission reference information as the target sharding strategy. Then, the data to be downloaded can be divided into data shards according to the target sharding strategy, and then each data shard can be downloaded based on the above-mentioned data connection.

[0077] The transmission reference information may refer to at least one of data information of the data to be downloaded corresponding to the data download request (eg data size, etc.) and data transmission environment information (eg network bandwidth, server load, etc.).

[0078] The above-mentioned sharding strategies can be determined according to actual needs, for example: fixed-size sharding, multi-level sharding, first adaptive sharding, second adaptive sharding, etc. The above-mentioned allocation strategies will be described in detail below.

[0079] Specifically, if it is determined based on the above-mentioned transmission reference information that the data size of the data to be downloaded is greater than a preset first threshold and lower than a preset second threshold, then the above-mentioned fixed-size segmentation can be determined as the target segmentation strategy. At this time, the server can divide the data to be downloaded into fixed-size data segments according to the data size of the data to be downloaded.

[0080] For example, if the size of the data to be downloaded is 10MB, and the above fixed size is 2MB, the server may divide it into five data segments, namely, 0-2MB, 2MB-4MB, 4MB-6MB, 6MB-8MB, and 8MB-10MB.

[0081] If it is determined based on the above-mentioned transmission reference information that the data size of the data to be downloaded is greater than the preset second threshold, then the above-mentioned multi-level segmentation can be determined as the target segmentation strategy. At this time, the server can divide the data to be downloaded into a first specified number of data segments according to the data size of the data to be downloaded, and then for each data segment, the data segment can be divided into a second specified number of sub-data segments.

[0082] For example: if the data size of the data to be downloaded is 10MB, and the above-mentioned first specified number and second specified number are 2, the server can divide it into two data slices, namely 0~5MB and 5MB~10MB. For each data slice, the server can also divide the data slice into two sub-data slices, namely, 0~2.5MB, 2.5MB~5MB, 5MB~7.5MB, and 7.5MB~10MB.

[0083] It should be noted that the above-mentioned first specified number and the second specified number can be set according to actual needs. Through the above-mentioned multi-level sharding, the server can download the sub-data shards under each data shard in parallel when performing data transmission, so as to improve data download efficiency. When data transmission is abnormal, if each sub-data shard is to be restored, more computing resources may be required to manage and schedule the recovery tasks for each sub-data shard. Therefore, the server can directly restore and download the entire data shard with the abnormality, thereby avoiding the problem of more network requests and additional computing overhead required to restore each sub-data shard.

[0084] If, based on the above transmission reference information, it is determined that the network bandwidth is greater than the preset first bandwidth threshold and less than the preset second bandwidth threshold (it can be understood that when the network bandwidth is sufficient), then the above-mentioned first adaptive fragmentation can be determined as the target fragmentation strategy. At this time, the server can divide the data to be downloaded into data fragments of the first specified size.

[0085] For example, if the size of the data to be downloaded is 10MB, and the first specified size is 2MB, the server may divide it into five data segments, namely, 0-2MB, 2MB-4MB, 4MB-6MB, 6MB-8MB, and 8MB-10MB.

[0086] Furthermore, if it is determined based on the above-mentioned transmission reference information that the network bandwidth is greater than the preset second bandwidth threshold, the above-mentioned second adaptive fragmentation can be determined as the target fragmentation strategy. At this time, the server can divide the data to be downloaded into data fragments of a second specified size, where the second specified size is greater than the above-mentioned first specified size.

[0087] If the data size of the data to be downloaded is 10MB, and the first specified size is 5MB, the server may divide it into two data segments, namely, 0-5MB and 5MB-10MB.

[0088] From the above content, it can be seen that the server can determine the fragmentation strategy for downloading data based on the data transmission environment information, and then when it is determined that the data transmission environment is poor, the data to be transmitted can be divided into small data fragments, and when it is determined that the data transmission environment is poor, the data to be transmitted can be divided into large data fragments.

[0089] It should be noted that since the above-mentioned transmission reference information includes information of multiple dimensions, the server can determine, based on the transmission reference information, from the preset sharding strategies that match the data to be downloaded. There can be multiple sharding strategies. At this time, the server can determine the corresponding sharding strategy with the highest priority from the sharding strategies that match the data to be downloaded as the target sharding strategy based on the priority set in advance for each sharding strategy.

[0090] Furthermore, when the server stops downloading each data segment due to an exception during the process of downloading each data segment based on the data connection, the server can determine the data download progress information, and then when it is determined that the exception is eliminated, the server can continue downloading each data segment according to the data download progress information.

[0091] Furthermore, when determining that each data segment has been downloaded, the server can merge the data segments to obtain the target data to be detected, and then determine whether the target data to be detected meets the conversion conditions for converting the target data to be detected into structured data that conforms to the specified data structure. If it is determined that the target data to be detected meets the conversion conditions, the server can convert the target data to be detected into structured data that conforms to the specified data structure as the target data.

[0092] The above-mentioned designated data structure is used to characterize the organization form of each data contained in the target data, which can be understood as being used to specify the quantity of each data that the target data needs to contain and the type of each data.

[0093] The above conversion conditions are the regulations on the quantity of each data and the type of each data that the target data needs to contain in the specified data structure.

[0094] For example: the specified data structure stipulates that the number of each data that the target data needs to contain is 2, and stipulates that the data type of the first data is text data, and the data type of the second data is floating-point data. At this time, if the server determines that the number of each data contained in the target data to be detected is 2, and determines that the data type of the first data is text data, and the data type of the second data is floating-point data, then it can be determined that the target data to be detected meets the above-mentioned conversion conditions.

[0095] Furthermore, the server can also determine the monitoring data in the process of data downloading based on the data connection, and then determine the target user from the preset designated users according to the data type of the data to be downloaded corresponding to the data download request, and send the monitoring data to the target user. The above-mentioned monitoring data is used to reflect the transmission status during the data transmission process.

[0096] The above-mentioned designated users may be pre-set users who manage the data to be downloaded of different data types.

[0097] From the above content, it can be seen that the server can provide users with a standard access method at the user level, and can convert the data download requests sent by users according to the data access rules specified by different third-party platforms through the various adapter programs set at the bottom layer, so as to adapt to the different data access rules of different third-party platforms through each adapter, so that the specific interaction details of users downloading data from the third-party platform are hidden by the adapter, thereby enabling users to interact with different third-party platforms in a consistent manner.

[0098] The above are one or more implementation data download methods of this specification. Based on the same idea, this specification also provides a corresponding data download device, such as Figure 3 shown.

[0099] Figure 3 A schematic diagram of a data download device provided in this specification includes:

[0100] Receiving module 301, used for receiving a data download request;

[0101] A determination module 302, for determining a target platform identifier according to the data download request, and determining an adapter program that matches the target platform identifier from preset adapter programs as a target adapter program, wherein different adapter programs are used to download data according to data access rules specified by different third-party platforms;

[0102] The download module 303 is used to execute the target adapter program, convert the format of the data download request into a request format specified by the third-party platform corresponding to the target platform identifier, obtain the converted data download request, and send the converted data download request to the third-party platform corresponding to the target platform identifier to establish a data connection between the third-party platform corresponding to the target platform identifier, and download data based on the data connection.

[0103] Optionally, the receiving module 301 is specifically used to obtain the user's permission information, and determine the platform identification information of each third-party platform that grants the user data download permission based on the permission information, as candidate platform identification information; generate a user interface based on the candidate platform identification information, and display the user interface to the user; determine the target platform identification and identification information of the data to be downloaded based on the operation performed by the user on the user interface; and generate a data download request based on the target platform identification and the identification information of the data to be downloaded.

[0104] Optionally, the device further includes: a generating module 304.

[0105] The generation module 304 is specifically used to determine, based on the target platform identifier, account data that matches the target platform identifier from the account data pre-registered on each third-party platform as the target account data; and generate a data download request based on the target platform identifier, the identification information of the data to be downloaded, and the target account data.

[0106] Optionally, the download module 303 is specifically used to determine transmission reference information, the transmission reference information including: at least one of data information of the data to be downloaded corresponding to the data download request and data transmission environment information; according to the transmission reference information, determining a sharding strategy that matches the data to be downloaded from various preset sharding strategies as a target sharding strategy; according to the target sharding strategy, dividing the data to be downloaded into various data shards; and downloading each data shard based on the data connection.

[0107] Optionally, the download module 303 is specifically used to determine data download progress information when an exception occurs during the process of downloading the data slices based on the data connection and the download is stopped; when it is determined that the exception is eliminated, continue downloading the data slices according to the data download progress information.

[0108] Optionally, the download module 303 is specifically used to, when it is determined that the download of each data segment is completed, merge the data segments to obtain the target data to be detected; determine whether the target data to be detected meets the conversion condition of converting the target data to be detected into structured data that conforms to a specified data structure, and the specified data structure is used to characterize the organizational form of each data contained in the target data; if it is determined that the target data to be detected meets the conversion condition, convert the target data to be detected into structured data that conforms to the specified data structure as the target data.

[0109] Optionally, the download module 303 is specifically used to determine various monitoring data in the process of data downloading based on the data connection, and the monitoring data is used to reflect the transmission status during the data transmission process; according to the data type of the data to be downloaded corresponding to the data download request, the target user is determined from the preset designated users, and the various monitoring data are sent to the target user.

[0110] This specification also provides a computer-readable storage medium, which stores a computer program, which can be used to execute the above Figure 1 A data download method is provided.

[0111] This manual also provides Figure 4 The one shown corresponds to Figure 1 A schematic diagram of the electronic device. Figure 4 As mentioned above, at the hardware level, the electronic device includes a processor, an internal bus, a network interface, a memory, and a non-volatile memory, and may also include other hardware required for the business. The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it to achieve the above Figure 1 Of course, in addition to the software implementation, this specification does not exclude other implementations, such as logic devices or a combination of software and hardware, etc., that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0112] For the improvement of a technology, it can be clearly distinguished whether it is a hardware improvement (for example, improvement of the circuit structure of diodes, transistors, switches, etc.) or a software improvement (improvement of the method flow). However, with the development of technology, many improvements of the method flow today can be regarded as direct improvements of the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that the improvement of a method flow cannot be implemented with a hardware entity module. For example, a programmable logic device (PLD) (such as a field programmable gate array (FPGA)) is such an integrated circuit whose logical function is determined by the user's programming of the device. Designers can "integrate" a digital system on a PLD by programming themselves, without having to ask chip manufacturers to design and make dedicated integrated circuit chips. Moreover, nowadays, instead of manually making integrated circuit chips, this kind of programming is mostly implemented by "logic compiler" software, which is similar to the software compiler used when developing and writing programs, and the original code before compilation must also be written in a specific programming language, which is called hardware description language (HDL). There is not only one HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also know that it is only necessary to program the method flow slightly in the above-mentioned hardware description languages ​​and program it into the integrated circuit, and then it is easy to obtain the hardware circuit that implements the logic method flow.

[0113] The controller can be implemented in any appropriate manner, for example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (such as software or firmware) that can be executed by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that in addition to implementing the controller in a purely computer-readable program code manner, the controller can be implemented in the form of a logic gate, a switch, an application-specific integrated circuit, a programmable logic controller, and an embedded microcontroller by logically programming the method steps. Therefore, this controller can be considered as a hardware component, and the devices included therein for implementing various functions can also be regarded as structures within the hardware component. Or even, the devices for implementing various functions can be regarded as both software modules for implementing the method and structures within the hardware component.

[0114] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0115] For the convenience of description, the above device is described in various units according to their functions. Of course, when implementing this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0116] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Therefore, this specification may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0117] This specification is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of this specification. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0118] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0119] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0120] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0121] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0122] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0123] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0124] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems or computer program products. Therefore, this specification may take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0125] This specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0126] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0127] The above description is only an embodiment of the present specification and is not intended to limit the present specification. For those skilled in the art, the present specification may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present specification shall be included in the scope of the claims of the present specification.

Claims

1. A data downloading method, characterized in that: include: Receive data download request; Determine the target platform identifier according to the data download request, and determine the adapter program that matches the target platform identifier from the preset adapter programs as the target adapter program, wherein different adapter programs are used to download data according to data access rules specified by different third-party platforms; Execute the target adapter program, convert the format of the data download request into a request format that complies with the third-party platform corresponding to the target platform identifier, obtain the converted data download request, and send the converted data download request to the third-party platform corresponding to the target platform identifier to establish a data connection with the third-party platform corresponding to the target platform identifier, and download data based on the data connection.

2. The method according to claim 1, characterized in that The step of receiving a data download request specifically includes: Obtaining the user's permission information, and determining, based on the permission information, the platform identification information of each third-party platform that grants the user data download permission as candidate platform identification information; Generate a user interface according to the candidate platform identification information, and display the user interface to the user; Determining a target platform identifier and identifier information of data to be downloaded according to an operation performed by the user on the user interface; A data download request is generated according to the target platform identifier and the identification information of the data to be downloaded.

3. The method according to claim 2, characterized in that The step of generating a data download request according to the target platform identifier and the identifier information of the data to be downloaded specifically includes: According to the target platform identifier, account data matching the target platform identifier is determined from the account data pre-registered on each third-party platform as target account data; A data download request is generated according to the target platform identifier, the identification information of the data to be downloaded, and the target account data.

4. The method according to claim 1, characterized in that The step of downloading data based on the data connection specifically includes: Determine transmission reference information, the transmission reference information comprising: at least one of data information of the data to be downloaded corresponding to the data download request and data transmission environment information; According to the transmission reference information, a fragmentation strategy matching the data to be downloaded is determined from various preset fragmentation strategies as a target fragmentation strategy; According to the target sharding strategy, the data to be downloaded is divided into data shards; Based on the data connection, the data slices are downloaded.

5. The method according to claim 4, characterized in that The method further comprises: In the case that an exception occurs during the process of downloading the data segments based on the data connection and the downloading is stopped, determining data download progress information; When it is determined that the abnormality is eliminated, the data segments continue to be downloaded according to the data download progress information.

6. The method according to claim 4, characterized in that The method further comprises: When it is determined that the downloading of each data slice is completed, merging the data slices to obtain the target data to be detected; Determining whether the target data to be detected satisfies a conversion condition for converting the target data to be detected into structured data conforming to a specified data structure, wherein the specified data structure is used to characterize the organizational form of each data contained in the target data; If it is determined that the target data to be detected meets the conversion condition, the target data to be detected is converted into structured data conforming to a specified data structure as the target data.

7. The method according to claim 1, characterized in that The method further comprises: Determine various monitoring data in a process of data downloading based on the data connection, wherein the monitoring data is used to reflect a transmission status in the process of data transmission; According to the data type of the to-be-downloaded data corresponding to the data download request, a target user is determined from preset designated users, and the monitoring data are sent to the target user.

8. A data downloading device, characterized in that: include: A receiving module, used for receiving a data download request; A determination module, used to determine a target platform identifier according to the data download request, and determine an adapter program that matches the target platform identifier from preset adapter programs as a target adapter program, wherein different adapter programs are used to download data according to data access rules specified by different third-party platforms; A download module is used to execute the target adapter program, convert the format of the data download request into a request format that complies with the third-party platform corresponding to the target platform identifier, obtain the converted data download request, and send the converted data download request to the third-party platform corresponding to the target platform identifier to establish a data connection between the third-party platform corresponding to the target platform identifier, and download data based on the data connection.

9. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 7 is implemented.

Images