Data processing method and device oriented to cloud platform, and cloud data management system

Abstract

The invention provides a cloud platform-oriented data processing method and device and a cloud data management system. The method comprises the steps that original data which are maintained by any cloud platform and conform to a first format are obtained from the cloud platform, a format conversion template created for the first format is determined, and a conversion rule between the first format and a standard format is recorded in the template; and converting the original data into standard data conforming to the standard format according to the conversion rule, and providing the standard data for a user to process. The method can reduce the workload to improve the data processing efficiency; and meanwhile, the problems of function missing, inconsistent data processing results and the like can be avoided, and the accuracy of data processing is improved.

Description

Technical Field

[0001] The present invention relates to the field of cloud computing, and in particular to a data processing method and device for a cloud platform, and a cloud data management system. Background Art

[0002] At present, tenants (such as individuals or institutions) can use the data computing, storage and processing services provided by cloud platforms based on cloud computing technology to host data in the cloud. When tenants use multiple cloud platforms to host data at the same time, different cloud platforms often store and send data in different formats due to differences in the services provided by different cloud platforms and the interface technology standards used. In order to improve the management efficiency of cloud data, tenants need to manage the data hosted by each cloud platform in a unified manner.

[0003] In related technologies, tenants can write different adaptability codes for each cloud platform to execute corresponding codes according to the connected cloud platform to complete data processing. However, such solutions often have complex implementation logic and require a large workload for writing code and interface adaptation, which is inefficient. Alternatively, there are also solutions for unified processing of interface protocols used by multiple cloud platforms, but such solutions often have problems such as missing functions and even inconsistent data processing results when the interface standards and underlying technologies of different cloud platforms vary greatly, and need to be improved urgently. Summary of the invention

[0004] In view of this, the present invention provides a data processing method and device for a cloud platform, and a cloud data management system to solve the deficiencies in the related art.

[0005] Specifically, the present invention is achieved through the following technical solutions:

[0006] According to a first aspect of the present invention, there is provided a cloud platform-oriented data processing method, which is applied to a cloud data management system connected to multiple cloud platforms, and the method comprises:

[0007] Acquire original data in a first format maintained by any cloud platform from the cloud platform, and determine a format conversion template created for the first format, wherein the template records a conversion rule between the first format and a standard format;

[0008] The original data is converted into standard data conforming to the standard format according to the conversion rule, and the standard data is provided to the user for processing.

[0009] According to a second aspect of the present invention, there is provided a cloud data management system, the system being connected to a plurality of cloud platforms, the system being used for:

[0010] Acquire original data in a first format maintained by any cloud platform from the cloud platform, and determine a format conversion template created for the first format, wherein the template records a conversion rule between the first format and a standard format;

[0011] The original data is converted into standard data conforming to the standard format according to the conversion rule, and the standard data is provided to the user for processing.

[0012] According to a third aspect of the present invention, there is provided a data processing device for a cloud platform, which is applied to a cloud data management system connected to multiple cloud platforms, and the device comprises:

[0013] an acquisition unit, configured to acquire, from any cloud platform, original data in a first format maintained by the cloud platform, and to determine a format conversion template created for the first format, wherein the template records a conversion rule between the first format and a standard format;

[0014] The conversion unit is used to convert the original data into standard data conforming to the standard format according to the conversion rule, and provide the standard data to the user for processing.

[0015] According to a fourth aspect of the present invention, there is provided an electronic device, comprising:

[0016] a processor; a memory for storing instructions executable by the processor;

[0017] The processor implements the steps of any one of the methods described in the first aspect by running the executable instructions.

[0018] According to a fifth aspect of the present invention, there is provided a computer-readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of any one of the methods described in the first aspect.

[0019] According to a sixth aspect of the present invention, there is provided a computer program product, comprising a computer program and / or instructions, which, when executed by a processor, implement the steps of the method as described in any one of the first aspects.

[0020] The technical solution provided by the embodiments of the present invention may have the following beneficial effects:

[0021] In the scheme described in the present invention, after the cloud data management system connected to multiple cloud platforms obtains original data conforming to a first format from any cloud platform, it first determines a format conversion template created for the first format, and then converts the original data into standard data conforming to a standard format according to the conversion rules recorded in the template, and provides it to the user for processing.

[0022] The present invention proposes a cloud data management system that is independent of each cloud platform. As a data processor, the system can use a pre-created format conversion template to uniformly convert raw data in different formats obtained from each cloud platform into standard data in a standard format. This allows users to not need to pay attention to the underlying standards and data formats of the cloud platform, nor to the differences in data formats supported by different cloud platforms. They only need to process the data in the standard format (i.e., the converted standard data).

[0023] It can be seen that this solution only needs to create a format conversion template corresponding to the first format supported by the cloud platform and the standard format supported by the system, and the data format conversion can be automatically and efficiently completed according to the conversion rules in the template, without the need for users or technicians to manually write code or adapt interfaces, which significantly reduces the workload and helps to improve data processing efficiency. In addition, the general format conversion template provided by this solution can perform format conversion based on differences in data formats, without having to pay attention to the differences between interface standards and underlying technologies of different cloud platforms, which helps to avoid problems such as missing functions and inconsistent data processing results, and improves the accuracy of data processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solution of the present invention, the following briefly introduces the drawings required for use in the embodiments or prior art descriptions. Obviously, the drawings described below are only some embodiments of the present invention, and for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

[0025] Figure 1 It is a schematic diagram of the architecture of a cloud platform-oriented data processing system and a cloud platform connected thereto, shown in an embodiment of the present invention;

[0026] Figure 2 is a schematic diagram of the architecture of another cloud platform-oriented data processing system shown in an embodiment of the present invention;

[0027] Figure 3 is a flow chart of a data processing method for a cloud platform shown in an embodiment of the present invention;

[0028] Figure 4 is a schematic diagram of a field mapping result shown in an embodiment of the present invention;

[0029] Figure 5 is a schematic diagram of another field mapping result shown in an embodiment of the present invention;

[0030] Figure 6 is a flow chart of another cloud platform-oriented data processing method shown in an embodiment of the present invention;

[0031] Figure 7 is a schematic structural diagram of an electronic device shown in an embodiment of the present invention;

[0032] Figure 8 It is a block diagram of a data processing device for a cloud platform shown in an embodiment of the present invention. DETAILED DESCRIPTION

[0033] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are only examples of devices and methods consistent with some aspects of the present invention.

[0034] The terms used in the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The singular forms "a", "the" and "the" used in the present invention and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0035] It should be understood that although the terms first, second, third, etc. may be used in the present invention to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present invention, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0036] In order to solve the above-mentioned technical problems existing in the related art, the present invention proposes a cloud data management system and a data processing method for a cloud platform implemented by the system, so as to uniformly convert the raw data in any format obtained from any cloud platform into a standard format supported by the system through a pre-created format conversion template and the conversion rules recorded therein, so as to facilitate the user to post-process it. The data processing scheme for a cloud platform of the present invention is described in detail below with reference to the accompanying drawings.

[0037] Figure 1 FIG. 1 is a schematic diagram of the architecture of a cloud data management system and a cloud platform to which it is connected, provided by an exemplary embodiment. Figure 1As shown, the scenario may include a network 10, several servers, such as server 11, server 12 and server 13; and several electronic devices, such as PC (Personal Computer) 14 and PC 15. Among them, some servers may constitute the cloud data management system, such as server 11 may be configured as the system; or some servers and several electronic devices may constitute the cloud data management system, such as server 11 and PC 14, PC 15 may be configured as the system, which is hereby explained.

[0038] Any of the servers 11, 12 and 13 may be a physical server including an independent host, or may be a virtual server carried by a host cluster. During operation, the server may run a program on the server side of a certain application to implement the relevant functions of the application. For example, when the server 11 runs a program for a data processing service, it may be implemented as a server end of the data processing service, such as cooperating with a client end of the data processing service to provide data processing services to users. In addition, the servers 12 and 13 may be different cloud platforms, respectively. For example, when the server 12 runs a program for a certain cloud computing service, it may be implemented as a certain cloud platform for providing cloud computing services; when the server 13 runs a program for another cloud computing service, it may be implemented as another cloud platform for providing cloud computing services. The cloud computing services provided by the above two cloud platforms may be the same or different, and the embodiments of the present invention do not limit this.

[0039] The user described in the embodiment of the present invention can be an ordinary user who is a natural person, or an organization / institution such as a company, enterprise, or school. The above-mentioned user has a corresponding account registered at at least one cloud platform connected to the cloud data management system, and can rent cloud computing related resources such as storage, computing, and network provided by the cloud platform through the account, so it is also called a tenant of the cloud platform. Of course, the user described in the embodiment of the present invention is also a user of the cloud data management system (such as using an account registered on the cloud platform to log in to the system, or registering an independent account in the system and then associating it with the account registered on the cloud platform, etc.), and the user can use the above-mentioned electronic device to interact with the cloud data management system, such as user 16 can use PC14, user 17 can use PC15, etc.

[0040] PC is only some types of electronic devices that users can use. In fact, users can obviously also use electronic devices such as the following types: mobile phones, tablet devices, laptops, PDAs (Personal Digital Assistants), wearable devices (such as smart glasses, smart watches, etc.), etc., and one or more embodiments of the present invention do not limit this. During operation, the electronic device can run a program on the client side of a certain application to implement the relevant functions of the application. For example, when the PC14 used by user 16 runs a program for a data processing service, it can be implemented as a client of the data processing service; when the PC15 used by user 17 runs a program for a data processing service, it can be implemented as another client of the data processing service, etc. Among them, the application program of any of the above clients can be started and run on the corresponding electronic device. The program on the client side can be a native application installed on the electronic device, or the program on the client side can be a mini program (Mini Program), a quick application (Quick APP) or other similar forms. Of course, when using web page technologies such as HTML5 or similar, the relevant functions can be implemented through the page displayed by the browser, where the browser can be an independent browser application or a browser module embedded in some applications.

[0041] As for the network 10 for interaction between the electronic devices such as PC 14 and the server 11, etc., a wired or wireless network can be selected to realize communication based on the communication mode supported by the corresponding electronic devices, and the present invention is not limited to this. For example, PC 14 can support both wired and wireless communication, so a wired or wireless network can be used to realize communication as needed.

[0042] It is understandable that the cloud data management system described in the embodiment of the present invention can be composed of the server and client of the above-mentioned data processing service. For example, after the server processes the standard data through the data processing scheme described in the present invention, it sends it to the client for display to the user. Alternatively, the user can add, delete, modify and other operations on the standard data displayed by the client, so that the client can upload the corresponding operation results to the server, so that the server can update the local cached standard data, etc., which will not be repeated.

[0043] Exemplarily, server 11 can be implemented as a server end of a data processing service, PC 14 and PC 15 can be implemented as a client end of a data processing service, and in this case, any one of user 16 and user 17 is the user described in the embodiment of the present invention. It can be understood that at this time, the server end implemented by server 11 and the client end implemented by any PC together constitute a cloud data management system, and the corresponding user is the user of the system. At the same time, server 12 and server 13 can be implemented as different cloud platforms connected to the cloud data management system, and any cloud platform is used to maintain the data hosted by the user on the cloud platform. This solution is used to convert the original data in the first format (which can be any format) obtained from the cloud platform into a standard format supported by the cloud data management system and provide it to the user for processing.

[0044] Figure 2 FIG. 1 is another schematic diagram of an exemplary embodiment. Figure 2 As shown, the cloud data management system is connected to multiple cloud platforms, such as Cloud1, Cloud2, and Cloud3. In addition to maintaining user-hosted data, any of the cloud platforms also provides at least one access interface to the outside world, so that the cloud data management system can access the cloud platform through the above interface to obtain the corresponding original data. For example, Cloud1 provides interface 11 and interface 12, Cloud2 provides interface 21 and interface 22, Cloud3 provides interface 31, etc., which will not be repeated here.

[0045] In addition, the cloud data management system can support at least one standard format, and maintain standard data models created for various standard formats, wherein the standard data model created for any standard format is used to characterize the standard format. Given that each cloud platform connected to the cloud data management system often returns data in a specific format to the system through the same access interface (hereinafter referred to as the access interface conforming to the specific format), the access interfaces provided by each cloud platform can correspond to the corresponding standard data models. For example, interface 11 and interface 21 correspond to standard data model 1, interface 12, interface 22 and interface 31 correspond to standard data model 2, etc. (the specific corresponding relationship is shown by the bidirectional arrows between the interface and the model in the figure), which will not be repeated here.

[0046] In one embodiment, the above-mentioned standard data model may be a unified model obtained by abstracting the access interface to which it corresponds. For example, in the case where any model corresponds to multiple access interfaces at the same time, the model may record the common fields contained in the specific formats to which these access interfaces conform respectively. In addition, considering that the data output by the cloud platform may be the resource description information of the available resources provided by the cloud platform (i.e., the aforementioned cloud computing related resources provided by the platform), the content and format of the resource description information of different types of resources are often quite different and the resource description information of the same type of resources provided by different cloud platforms often have common content, so the above-mentioned standard data model can be created according to the resource type, such as Figure 2 The standard data model 1 shown corresponds to computing resources, that is, the model is used to record the common fields in the resource description information of computing resources provided by Cloud1 and Cloud2 respectively; similarly, the standard data model 2 corresponds to storage resources, that is, the model is used to record the common fields in the resource description information of storage resources provided by Cloud1, Cloud2 and Cloud3 respectively, etc., which will not be repeated. Exemplarily, the standard data model 1 corresponding to computing resources may include but is not limited to the following fields: instance ID, instance name, instance status, instance type, creation time, etc.

[0047] In addition, as users of the cloud data management system, U1, U2, and U3 can access the system through the client of the cloud data management system running in their own electronic devices to process the converted standard data provided by the system. Figure 2 The users U1 and U2 shown can be Figure 1 The user 16 and the user 17 shown are not described in detail.

[0048] An embodiment of the present invention provides a cloud data management system, which is connected to multiple cloud platforms and is used for:

[0049] Acquire original data in a first format maintained by any cloud platform from the cloud platform, and determine a format conversion template created for the first format, wherein the template records a conversion rule between the first format and a standard format;

[0050] The original data is converted into standard data conforming to the standard format according to the conversion rule, and the standard data is provided to the user for processing.

[0051] It should be noted that the owner and / or manager of the cloud data management system can be any natural user or the aforementioned organization / institution, etc. Taking a certain enterprise as an example, the various cloud platforms connected to the cloud data management system can be used to maintain the relevant data hosted by the enterprise (such as internal management data, business data, etc.). The cloud data management system is used to obtain the above data from the cloud platform and convert it into standard data in a standard format for users to process, and the employees of the enterprise can be users of the system. Of course, access rights to the system and / or the various cloud platforms connected to the system can be set for enterprise employees to ensure the security of the data processing process.

[0052] It should be noted that the information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, original data and standard data, etc.) involved in this manual are all information and data authorized by the relevant users or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0053] For example, when the owner and / or manager of the cloud data management system is a car company, the original data maintained by the cloud platform may be the business data of the vehicle, such as vehicle production data, vehicle sales records, vehicle driving logs, vehicle after-sales service records, vehicle-related model training, deployment and operation-related data, etc., which will not be elaborated here.

[0054] Any cloud platform connected to the cloud data management system described in the present invention can be a third-party cloud platform, such as the mainstream cloud platform in the current cloud computing field; or it can be a self-built cloud platform operated by the owner and / or manager of the system (such as one of the aforementioned enterprises), and the embodiments of the present invention are not limited to this.

[0055] In fact, in addition to obtaining the original data in accordance with the first format provided by any cloud platform and converting it into standard data in accordance with the standard format based on the conversion rules recorded in the corresponding format conversion template, the system can also obtain other original data (such as the second original data) in accordance with other formats (such as the second format) maintained by the cloud platform from any cloud platform, and determine the format conversion template created for the other format, in which the conversion rules between the other format and the standard format are recorded; and, according to the conversion rules, convert the other original data into standard data (such as the second standard data) in accordance with the standard format, and provide the standard data to the user for processing. Similarly, the system can also obtain other original data (such as the third original data) in accordance with other formats (such as the third format) maintained by the cloud platform from other cloud platforms (different from the any cloud platform), and determine the format conversion template created for the other format, in which the conversion rules between the other format and the standard format are recorded; and, according to the conversion rules, convert the other original data into standard data (such as the third standard data) in accordance with the standard format, and provide the standard data to the user for processing. Through the above method, the system can uniformly convert the original data of different formats provided by any of the cloud platforms into standard data in a standard format; or uniformly convert the original data of the same or different formats provided by different cloud platforms into standard data in a standard format, which will not be repeated here.

[0056] In addition, the cloud data management system may also have cloud platform authentication and management functions, such as authenticating each cloud platform to which it is connected (or accessed) (such as based on AK / SK authentication information), obtaining access keys and other information from the cloud platform, and using the keys to sign subsequent requests, etc. It may also have model registration management functions, such as establishing a mapping relationship between the original data returned by different cloud platform interfaces and the standard data model (i.e., the first format and the standard format) based on the aforementioned standard data model.

[0057] The specific working process of the cloud data management system (i.e., the process of implementing the data processing method for the cloud platform) can be found below Figure 3 and Figure 4 The detailed description of the corresponding specific embodiments will not be repeated here.

[0058] Figure 3 A data processing method for a cloud platform is provided by an exemplary embodiment. The method is applied to a cloud data management system connected to multiple cloud platforms (such as the aforementioned Figure 1 and Figure 2 system shown). Figure 3 As shown, the method includes the following steps 302-304.

[0059] Step 302: acquiring original data in a first format maintained by any cloud platform from the cloud platform, and determining a format conversion template created for the first format, wherein the template records conversion rules between the first format and a standard format.

[0060] As mentioned above, each cloud platform connected to the cloud data management system can maintain the hosted data, and the system can obtain the above data maintained by each cloud platform respectively. Among them, the original data described in the embodiment of the present invention can be any data maintained by any cloud platform connected to the system.

[0061] It should be noted that the embodiments of the present invention do not limit the specific format used by any of the cloud platforms to store the raw data, that is, any of the cloud platforms can store the raw data locally in any format. When sending the raw data to the cloud data management system, the first format is used, that is, the raw data directly obtained by the cloud data management system from the cloud platform is organized in the first format. In addition, the format used by any of the cloud platforms to store the raw data (that is, the storage format of the raw data) can be the same as or different from the format used when sending the data to the cloud data management system (that is, the first format).

[0062] For the timing of implementation of this solution, the cloud data management system can periodically obtain the original data. For example, the system can set the same or different time intervals for each cloud platform connected to it, and only for each cloud platform, the original data maintained by it can be periodically obtained from the platform according to the time interval set for the cloud platform. Alternatively, considering that the cloud data management system may have stored the historical original data maintained by it obtained from the cloud platform before the current moment locally, and the original data maintained by the cloud platform may not have been fully updated after the last acquisition, in order to reduce the invalid workload caused by repeatedly obtaining the same data, the system can also obtain the original data based on the message mechanism. For example, any cloud platform can send a corresponding notification message to the cloud data management system when the local data changes, so that the system can obtain the changed original data (that is, the latest original data stored by the cloud platform at the current moment) from the cloud platform in response to the notification message.

[0063] In one embodiment, the cloud data management system can obtain the original data in the first format maintained by any cloud platform from the cloud platform in a variety of ways. For example, the cloud data management system can receive the original data in the first format actively pushed by any cloud platform, which enables the cloud data management system to start the subsequent data processing process under the triggering of any cloud platform.

[0064] For another example, the cloud data management system can also actively request any of the cloud platforms to obtain the original data, such as initiating an acquisition request for the original data to the cloud platform through an access interface corresponding to the original data provided by any of the cloud platforms, and receiving the original data in the first format returned by the cloud platform through the interface. This method enables the cloud data management system to actively obtain the original data and start subsequent processing according to its own needs or processing logic; at the same time, initiating an acquisition request through the access interface provided by any of the cloud platforms and receiving the original data returned by it helps to ensure accurate data reception.

[0065] Wherein, when initiating the acquisition request through the access interface, the cloud data management system can first determine the access interface provided by any cloud platform for the original data to be acquired, and determine the request template pre-created for the access interface; then generate the acquisition request for the original data according to the request template, and submit the acquisition request to the cloud platform through the access interface. Wherein, any cloud platform can specify the corresponding access interface for the data identifier of each data stored by itself, so that the cloud data management system can determine the access interface provided by any cloud platform for the data according to the data identifier of the original data; or, any cloud platform can also specify the corresponding access interface for the resource type of the resource corresponding to the resource description information, so that when the original data includes the resource description information for any resource, the cloud data management system can determine the access interface provided by any cloud platform for the data according to the resource type of the resource. It can be understood that different access interfaces often have different interface information such as interface addresses and configuration parameters, and different requests initiated through the same access interface contain the same interface information except for different data identifiers. Therefore, if the interface information of the access interface is temporarily queried and an acquisition request is generated before each data acquisition, the request generation speed may be slow, affecting the efficiency of data acquisition. However, this method only needs to fill in the data identifier and other information of the original data to be acquired into the pre-created request template, and the acquisition request can be quickly generated and initiated without temporarily acquiring the interface information of the access interface, which helps to speed up data acquisition.

[0066] Among them, the access interface can be determined in a variety of ways. For example, for each data stored by itself, any cloud platform can pre-create a corresponding relationship between the data identifier (or data ID) of these data and the access interface, or create a corresponding relationship between the storage address of these data and the access interface, etc., and send the above corresponding relationship to the cloud data management system; so that when the system needs to obtain the original data (that is, any data stored by the cloud platform), it can determine the access interface corresponding to the data according to the data identifier or access address of the data. For another example, in the case where the original data includes resource description information of the available resources provided by any cloud platform, the cloud data management system can determine the access interface corresponding to the information according to the resource type of the available resources. For example, for the available resources provided by itself, any cloud platform can pre-bind different access interfaces for the resource description information of various resources according to the resource type, and send the binding result to the cloud data management system; when the system needs to obtain the original data including the resource description information, it can determine the access interface corresponding to the original data according to the resource type of the available resources described by the data. Among them, the above-mentioned available resources may include network, computing, storage and other types; in addition, the available resources can also be divided into finer granularity dimensions from the dimensions of resource effective time, deployment location of resource-related equipment, equipment type, etc., so as to achieve refined description and management of available resources, which will not be repeated here.

[0067] As mentioned above, the original data can be any data obtained by the cloud data management system from any of the cloud platforms. In fact, the system can obtain multiple different data through the access interface, or obtain the same original data multiple times at different times, so the cloud data management system often initiates acquisition requests to the access interface multiple times. It can be understood that in the process of obtaining the original data through the access interface, the cloud data management system essentially belongs to the requester (or accessor) of the interface. In order to avoid the interface being blocked or occupied for a long time, the platform often controls multiple acquisition requests from the same requester through a current limiting mechanism. For example, if the number of requests initiated by the same requester to the same interface within the current limiting period of the access interface (such as 100ms, 5s, etc.) exceeds the current limiting threshold set by the platform for the interface (at this time, for the platform, the requester may be malicious, such as launching a DDOS attack, etc.), the platform may control the remaining requests from the requester to wait or downgrade, or even refuse to receive subsequent requests from the requester within a certain period of time. If the above-mentioned current limiting mechanism is triggered by the cloud data management system, it may affect the cloud data management system's normal acquisition of data from the interface, and even affect the subsequent data processing process of the system. Therefore, efforts should be made to avoid triggering the cloud platform's current limiting mechanism.

[0068] To this end, the cloud data management system can predetermine the current limiting period and current limiting threshold set by any of the cloud platforms for the access interface (the cloud platform usually discloses these parameters in the technical manual of the access interface), and configure the following logic implemented locally accordingly: if the number of acquisition requests initiated through the access interface within the preset time before the current moment does not reach the current limiting threshold, then initiate an acquisition request for the original data through the access interface; if the number of acquisition requests initiated through the access interface within the preset time before the current moment reaches the current limiting threshold, then wait until the number of acquisition requests initiated through the access interface within the preset time before the current moment does not reach the current limiting threshold, and then initiate an acquisition request for the original data through the access interface. Among them, the acquisition request initiated through the access interface within the current limiting period can be initiated for any data stored in any of the cloud platforms, such as the original data, or other data, and the embodiments of the present invention do not limit this. In order to ensure that the current limiting mechanism of any of the cloud platforms is not triggered, the current limiting threshold set by the cloud data management system can be smaller than the current limiting threshold of the access interface (such as the difference between the two can be 1), and / or the preset duration set by it can be greater than the current limiting period of the access interface, etc., which will not be repeated here. In addition, the cloud data management system can determine in real time whether the current limiting threshold is met according to the above logic, where the two "current moments" before and after "waiting" are not the same moment, which is hereby explained. Through the above logic, the cloud data management system can perform pre-current limiting locally (the "pre-current" indicates that the current limiting occurs before any of the cloud platforms receives the request) to ensure that the current limiting mechanism of the access interface itself is not triggered.

[0069] Exemplarily, the above-mentioned pre-current limiting logic can be implemented by a leaky bucket algorithm. The specific implementation of the algorithm can be found in the relevant technical records and will not be repeated here. In addition, the cloud data management system can also detect whether it is limited by a certain interface (i.e., the current limiting mechanism of the interface is triggered), and if it is determined to be limited, it will re-queue and initiate subsequent requests for the interface.

[0070] It is understandable that in addition to requesting the original data from any of the cloud platforms through the access interface, the cloud data management system can also obtain other original data through other interfaces provided by the platform. Therefore, it needs to initiate multiple requests to the interface provided by the platform, and according to business needs, these requests may be initiated in batches in a short period of time or even initiated at the same time. In this regard, when it is necessary to obtain other original data from the access interface or other interfaces provided by any of the cloud platforms, the cloud data management system can use a concurrent mechanism to respectively initiate the acquisition request for the original data and other acquisition requests for the other original data to ensure that each request can be successfully initiated and responded to.

[0071] In one embodiment, in view of the fact that the original data may have a dependency relationship with other data stored in any of the cloud platforms, the cloud data management system can sequentially obtain these data according to the corresponding dependency relationship. For example, when obtaining the original data in the first format, the original data can be obtained from the cloud platform after the previous data in the second format associated with the original data has been obtained from any of the cloud platforms. In this case, the original data in the first format depends on the online data in the second format. And / or, the cloud data management system can also obtain the subsequent data in the third format associated with the original data from any of the cloud platforms after obtaining the original data. In this case, the subsequent data in the third format depends on the original data in the first format. Among them, when there is one of the following relationships between the original data and any of the data, it can be determined that there is an association between the two: the standard data templates corresponding to the two data are pre-bound, the two data are obtained through the same interface or obtained through mutually bound associated interfaces, the data types of the two data are the same or the resource types of the available resources corresponding to the two data are the same, and the formats that the two data respectively conform to are pre-bound, etc. It can be understood that the prior data and the subsequent data are only for the original data and are determined by the dependency relationship between the data, such as "prior" means that the prior data needs to be obtained before the original data, and "after" means that the subsequent data needs to be obtained after the original data.

[0072] Among them, at least two of the first format, the second format and the third format are the same format, that is, the prior data and the original data can conform to the same format, the subsequent data can also conform to the same format as the original data, the prior data can also conform to the same format as the subsequent data, and the prior data, the subsequent data and the original data can also all conform to the same format, which will not be repeated.

[0073] Exemplarily, when the original data, the previous data, and the subsequent data are all resource description information of computing resources, since the load balancing policy (Load Balancer Rule) data usually depends on the load balancing (LoadBalancer) data, when the original data is the load balancing data, the subsequent data can be the load balancing policy data; or, when the original data is the load balancing policy data, the previous data can be the load balancing data. In this way, the data can be grouped and the order of acquisition sequence can be configured according to the dependency relationship between different data in the same group, so that the data can be grouped according to the data dependency relationship, which helps to achieve orderly acquisition of data and effectively avoids problems such as confusion in data logical relationships or even failure to acquire data when acquiring data randomly or out of order.

[0074] In one embodiment, after the raw data is obtained from any cloud platform, it can be cached locally, such as storing it in the local cache space of the server for subsequent processing. For the obtained raw data, the cloud data management system can determine which format the data conforms to through information such as data compression method and format identifier of the data header, that is, determine the first format.

[0075] In one embodiment, for the acquired raw data conforming to the first format, the cloud data management system can query the format conversion template created for the first format from the template mapping table maintained by itself for subsequent format conversion. For example, the system can pre-create and maintain a format template mapping table, which is used to record the mapping relationship between the data format and the format conversion template; so that the first format can be identified according to the raw data, and the format conversion template corresponding to the first format can be queried from the format template mapping table. For another example, the system can pre-create and maintain an interface template mapping table, which is used to record the mapping relationship between the access interface and the format conversion template; so that the data interface receiving the raw data can be determined, and the format conversion template corresponding to the data interface can be queried from the interface template mapping table. For another example, the system can pre-create and maintain a resource template mapping table, which is used to record the mapping relationship between the resource type of the available resource and the format conversion template; so that the resource type of the available resource can be determined when the raw data includes the resource description information of the available resource provided by any cloud platform, and the format conversion template corresponding to the resource type can be queried from the resource template mapping table. Taking the format template mapping table as an example, for various formats of the original data that it may obtain, the cloud data management system can create corresponding format conversion templates for each format in advance, and create the above-mentioned format template mapping table for recording the mapping relationship between each format and its corresponding format conversion template for subsequent query. Based on the above-mentioned various template mapping tables maintained locally, the cloud data management system can quickly determine the format conversion template corresponding to the first format by looking up the table after determining the first format of the original data, which helps to improve the efficiency of format conversion.

[0076] Step 304: convert the original data into standard data conforming to the standard format according to the conversion rule, and provide the standard data to the user for processing.

[0077] Through the above method, a format conversion template created for the first format can be determined, and the template records the conversion rules between the first format and the standard format. Based on this, the cloud data management system can convert the original data that conforms to the first format into standard data that conforms to the standard format according to the conversion rules, and provide it to the user for processing.

[0078] It can be seen that this solution only needs to create a format conversion template corresponding to the first format supported by the cloud platform and the standard format supported by the system, and the data format conversion can be automatically and efficiently completed according to the conversion rules in the template, without the need for users or technicians to manually write code or adapt interfaces, which significantly reduces the workload and helps to improve data processing efficiency. In addition, the general format conversion template provided by this solution can perform format conversion based on differences in data formats, without having to pay attention to the differences between interface standards and underlying technologies of different cloud platforms, which helps to avoid problems such as missing functions and inconsistent data processing results, and improves the accuracy of data processing.

[0079] In one embodiment, the original data may include m original fields, and the standard data may include n basic fields, where m and n are both positive integers and m≥n. In this scenario, when converting the format of the original data, the values ​​of the n original fields corresponding to the n basic fields in the m original fields may be determined according to the conversion rules, and then the values ​​of the n original fields may be used as the values ​​of the corresponding fields in the n basic fields. The number and order of the basic fields contained in the standard data may be recorded in the aforementioned standard data template corresponding to the standard format, or may be recorded in the aforementioned format conversion template corresponding to the first format.

[0080] It can be understood that if m=n, then the m original fields correspond to the n basic fields one by one, and the standard data and the original data have the same content, but the position of each content (i.e., the field order) may be different. If m>n, the remaining mn basic fields do not have corresponding basic fields, and the values ​​of these fields can be directly discarded, that is, the generated standard data only contains n basic fields and the values ​​of each basic field are the same as the values ​​of the corresponding original fields.

[0081] For example, let us assume that m=5 and n=3. The corresponding relationship between the 5 original fields in the original data and the 3 standard fields in the standard data can be found in Figure 4 , where each field has its own name and value. Figure 4 As shown, the original fields P11 to P13 correspond to the basic fields S1 to S3 one by one, and the values ​​of the remaining basic fields P14 and P15 can be directly discarded. Of course, the position order of the n standard fields and the n original fields may be inconsistent, such as Figure 4 As shown in the second original data containing 6 original fields, 3 original fields in the data (i.e., fields P22, P23 and P24) correspond one-to-one to the original fields P11 to P13. Similarly, the values ​​of the remaining basic fields P23, P25 and P26 can also be directly discarded.

[0082] It is understandable that this method only assigns values ​​to each basic field in the standard data according to the correspondence between the fields, and the value of the standard data after the assignment is the same as the value of the corresponding basic field. In some embodiments, after the above assignment is completed, standard data that conforms to the standard format is obtained; in other embodiments, it is also necessary to convert the values ​​of at least some of the n original fields, such as changing the name, converting the value, etc., which will not be described here. In addition, as mentioned above, in addition to corresponding to the first format, the standard format may also correspond to other formats (such as Figure 1 The two standard data templates shown correspond to multiple access interfaces respectively. If different data interfaces are used to transmit data in different formats, then the two standard data templates correspond to multiple data formats respectively). Therefore, the above n original fields can be the common fields of the first format and other formats (corresponding to the standard formats at the same time).

[0083] Furthermore, in the aforementioned case where m≥2, n≥1 and m>n, the standard data also includes 1 extended field. At this time, the cloud data management system can also splice the values ​​of the remaining mn original fields in the m original fields except the n original fields as the value of the extended field, that is, assign the splicing result of the values ​​of the mn original fields to the extended field. In this way, the values ​​of the remaining fields in the m original fields except the n original fields that correspond one-to-one to the n basic fields can be uniformly placed in the extended field of the standard data, which helps to avoid the loss of valid content of the original data in the converted standard data, thereby improving the accuracy of data format conversion and ensuring data integrity.

[0084] Successor to Figure 4 For the related embodiments, the corresponding results of the extended fields can be found in Figure 5 .like Figure 5 As shown, the remaining two original fields in the original data (i.e., fields P14 and P15) can correspond to the extended field E1, and the values ​​of fields P14 and P15 can be sequentially concatenated and assigned to the extended field E1. Similarly, the remaining three original fields in the second original data (i.e., fields P23, P25, and P26) can correspond to the extended field E1, and the values ​​of fields P23, P25, and P26 can be sequentially concatenated and assigned to the extended field E1, which will not be described in detail.

[0085] In one embodiment, when the cloud data management system converts the original data into standard data conforming to the standard format according to the conversion rule, it can specifically perform at least one of the following conversions. For example, the position of at least one field in the original data can be adjusted according to the field position conversion rule in the conversion rule; Figure 4 and Figure 5As shown in the second original data in , field P22 and field P24 are the second and fourth fields of the second original data, respectively, and in the standard data after conversion, the two are adjusted to the second and third fields of the data (i.e., field S2 and field S3), respectively. For another example, the name of at least one field in the original data may be changed according to the field name conversion rule in the conversion rule, such as the 'RegionId' field in the original data may be changed to the 'region' field in the standard data, that is, the value of the 'RegionId' field may be assigned to the 'region' field according to the correspondence between the two fields recorded in the conversion rule. For another example, the value of at least one field in the original data may be converted according to the value format conversion rule in the conversion rule, such as when the value of the 'status' field in the original data is 'Associating', the value may be converted to 'associating' and assigned to the corresponding standard field.

[0086] In one embodiment, the original data may be the original data of the current page maintained by any of the cloud platforms. For example, the cloud platform may maintain multiple pages of continuous data in a Web page, and the cloud data management system may obtain data page by page. After obtaining each page of data except the first page (the page data is the original data of the current page at this time), it is necessary to convert it into corresponding standard data. In the case where the original data is the original data of the current page maintained by any of the cloud platforms, the cloud data management system may merge first and then convert, or may convert first and then merge. For example, after obtaining the original data in the first format, the cloud data management system may merge the original data of the current page with the original data of other pages cached locally in the order of page numbers to obtain complete original data; then convert the complete original data into complete standard data conforming to the standard format according to the conversion rules (i.e. merge first and then convert). For another example, the original data of the current page may be first converted into the standard data of the current page conforming to the standard format according to the conversion rules; and then the standard data of the current page may be further merged with the standard data of other pages converted from the original data of other pages cached locally in the order of page numbers to obtain complete standard data. The above two conversion methods can be flexibly selected according to the actual scene requirements, and the embodiments of the present invention do not limit this.

[0087] In one embodiment, the cloud data management system can first determine the data difference between the standard data and the historical standard data, the historical standard data is obtained by converting the historical original data according to the conversion rules, and the historical original data is the historical version of the original data obtained from any of the cloud platforms; then generate processing suggestions for the standard data based on the data difference, and provide the data suggestions to the user, so that the user can properly process the converted standard data according to the suggestions. In this way, the cloud data management system can automatically determine the difference between the standard data and the historical standard data and give processing suggestions, so that the user does not need to spend more time and energy to check by himself, which helps to further reduce the user's workload and data processing difficulty.

[0088] In the embodiment of the present invention, the user can add, modify, delete, etc. the standard data according to business requirements, and the embodiment of the present invention does not limit this.

[0089] In one embodiment, the cloud data management system can also determine the processed standard data in response to the processing operation implemented by the user on the standard data, and convert the processed standard data into the data to be updated in accordance with the first format according to the conversion rule; then upload the data to be updated to any of the cloud platforms to update the original data maintained by the cloud platform. Wherein, when uploading the data to be updated to any of the cloud platforms, an update request containing the data to be updated can be initiated to the cloud platform through the access interface used when obtaining the original data, so that the cloud platform can use the access interface to complete the distribution of the original data and the reception of the corresponding data to be updated. In this way, the cloud data management system can feed back the user's processing results to any of the cloud platforms to update the cloud data. Of course, the data to be updated can be uploaded immediately after the data to be updated is converted, or in order to reduce the number of interactions with any of the cloud platforms to avoid being limited, multiple copies of the data to be updated can also be uploaded in batches according to a fixed period or according to the cumulative amount of data to be uploaded, which will not be repeated.

[0090] In one embodiment, the cloud data management system can also update or create a new format conversion template. For example, the cloud data management system can determine the changed fourth format based on the format change notification for the first format issued by any of the cloud platforms; and update the conversion rules in the format conversion template according to the fourth format, or create a corresponding format conversion template for the fourth format, which records the fourth conversion rules between the fourth format and the standard format. The format change notification can include change information of the first format, so as to inform the cloud data management system of the changes in the first format supported by the cloud platform (such as adding new field content, changing the optional name, adjusting the field order, etc.), so that the system can respond to the format change notification and update the locally maintained format conversion template in time to ensure the smooth progress of subsequent format conversion.

[0091] And / or, the cloud data management system may also allow its management party or the user to create a format conversion template on demand. For example, in response to a received template configuration request, a corresponding format conversion template may be created for the fifth format specified by the request, and the template records a fifth conversion rule between the fifth format and the standard format. The specific creation method of the template is similar to the creation method of the format conversion template created for the first format, and will not be repeated here.

[0092] As mentioned above, the cloud data management system can perform multiple data interactions with any of the cloud platforms (in fact, every cloud platform that can be connected to it), such as initiating a request to obtain original data from the cloud platform, receiving original data in the first format returned by the cloud platform, uploading data to be updated corresponding to the original data, etc. In order to ensure data security during the above data interaction process, the two parties can perform encryption / decryption, signing / verifying, etc. on the relevant data during the interaction process, which will not be described in detail.

[0093] Figure 6 It is a flow chart of another data processing method for a cloud platform shown in an embodiment of the present invention, and the method is applied to the aforementioned cloud data management system. Figure 6 Taking the original data as the current page data in the multi-page data as an example, the acquisition process and format conversion process are described exemplarily. Figure 6 As shown, the method includes the following steps 601-611.

[0094] Step 601: Generate a request template according to the interface configuration information of the access interface of the cloud platform (ie, any of the aforementioned cloud platforms).

[0095] For the access interface provided by the cloud platform for the original data to be obtained, the interface configuration information of the access interface is obtained, and a corresponding request template is generated according to the information, wherein the parameter field in the request template has been written into the interface configuration information, and the rest are blank fields.

[0096] Step 602: determine the paging method corresponding to the original data to be acquired.

[0097] The paging method may be page number paging, such as each page in a Web page has a corresponding page number, such as "Page 1", "Page 2", ..., "Page 100", etc. The paging method may also be token paging, such as in a Web page, except for the first and last pages, all intermediate pages are replaced by "previous page" and "next page", etc., and page turning is achieved by adding or subtracting a token.

[0098] Step 603: Generate an acquisition request for the current page data according to the request template, and initiate the request to the cloud platform through the access interface.

[0099] After determining the current page data to be obtained, the data identifier of the data (such as the page number or the value of the Token) can be filled into the blank field in the above request template to obtain a directly sendable acquisition request, and the request is sent to the cloud platform through the access interface. Of course, the acquisition requests generated under different paging methods are different.

[0100] Step 604: pre-process the acquired original data of the current page.

[0101] After receiving the original data of the current page returned by the cloud platform in response to the acquisition request, the data is pre-processed by data packet splicing, data decompression, decryption, signature verification, format verification, field filtering, etc.

[0102] Step 605: merge the original data of the current page with the original data of other pages.

[0103] The (pre-processed) current page raw data is merged with the other page raw data (obtained before the current moment and cached locally). For example, when the current page is the i-th page (i>1), the i-th page raw data can be merged with the i-1 pages of locally cached raw data (i.e., the 1st page raw data to the i-1th page raw data) to obtain the complete raw data at the current moment.

[0104] Step 606, determining whether the complete original data of all pages are obtained.

[0105] If all the paging data has been acquired, the process proceeds to step 608 ; if all the paging data has not been acquired, the process proceeds to step 607 a or 607 b according to the paging method.

[0106] Step 607a, when the paging mode is page number paging, determine the next page number.

[0107] That is, the page number of the current page is updated from i to i+1.

[0108] Step 607b: When the paging mode is Token paging, determine the current Token+1.

[0109] That is, the Token of the current page is updated from the current Token to the current Token+1.

[0110] Through the loop process of the above steps 603 to 607a (or steps 603 to 607b), the process proceeds to step 608 until the complete original data corresponding to all the pages are obtained.

[0111] Step 608: Perform differentiation processing according to each field and value.

[0112] Differentiate and process each field and its value in the complete original data. For example, you can obtain the value in the dictionary, the value in the list, the value at the next level, the specially defined value, etc. contained in the data, which will not be described in detail.

[0113] Step 609: Generate complete standard data according to the field mapping relationship defined in the conversion rule.

[0114] Step 610: Cache the standard data locally.

[0115] The format conversion template corresponding to the access interface can be obtained, and the complete standard data corresponding to the complete original data can be converted according to the field mapping relationship defined in the conversion rule recorded in the template, and then the data can be cached in a local storage space (such as memory).

[0116] Step 611, update the local historical standard data and the original data in the cloud.

[0117] The local historical standard data is updated according to the complete standard data. In addition, when the user processes the complete standard data, the processed complete standard data can be converted back into the data to be updated in the first format according to the conversion rule, and then an update request containing the data is sent to the cloud platform, so that the cloud platform updates the original data maintained by it in response to the request.

[0118] Figure 7 is a schematic structural diagram of an electronic device shown in an embodiment of the present invention. Figure 7At the hardware level, the device includes a processor 701, a network interface 702, a memory 703, a non-volatile memory 704, and an internal bus 705, and may also include hardware required for other services. One or more embodiments of the present invention may be implemented based on software, such as the processor 701 reading the corresponding computer program from the non-volatile memory 704 to the memory 703 and then running it. Of course, in addition to the software implementation, one or more embodiments of the present invention do not exclude other implementations, such as logic devices or a combination of software and hardware, etc., that is, the execution subject of the following processing flow is not limited to each logic unit, but may also be hardware or logic devices.

[0119] Figure 8 A block diagram of a data processing device for a cloud platform is shown in an embodiment of the present invention. Figure 8 , the device can be applied to Figure 7 In the device shown, in order to implement the technical solution of the present invention, the device is applied to a cloud data management system connected to multiple cloud platforms, and the device includes:

[0120] The acquisition unit 801 is used to acquire original data in a first format maintained by any cloud platform from the cloud platform, and determine a format conversion template created for the first format, in which a conversion rule between the first format and a standard format is recorded;

[0121] The conversion unit 802 is used to convert the original data into standard data that conforms to the standard format according to the conversion rule, and provide the standard data to the user for processing.

[0122] Optionally, the acquiring unit 801 is specifically configured to:

[0123] A request for obtaining the original data is initiated to any cloud platform through an access interface corresponding to the original data provided by the cloud platform, and the original data in the first format returned by the cloud platform through the interface is received.

[0124] Optionally, the acquiring unit 801 is specifically configured to:

[0125] For the original data to be acquired, determine an access interface provided by any cloud platform for the original data, and determine a request template pre-created for the access interface;

[0126] An acquisition request for the original data is generated according to the request template, and the acquisition request is submitted to the cloud platform through the access interface.

[0127] Optionally, the acquiring unit 801 is specifically configured to:

[0128] If the number of acquisition requests initiated through the access interface within a preset time period before the current moment does not reach the current limiting threshold, then initiating an acquisition request for the original data through the access interface;

[0129] If the number of acquisition requests initiated through the access interface within the preset time before the current moment reaches the current limiting threshold, wait until the number of acquisition requests initiated through the access interface within the preset time before the current moment does not reach the current limiting threshold, and then initiate an acquisition request for the original data through the access interface.

[0130] Optionally, the acquiring unit 801 is specifically configured to:

[0131] In case that other original data needs to be obtained from the access interface or other interfaces provided by any of the cloud platforms, the acquisition request for the original data and other acquisition requests for the other original data are respectively initiated using a concurrent mechanism.

[0132] Optional,

[0133] The acquisition unit 801 is specifically configured to: acquire the original data from any cloud platform in the case where the previous data associated with the original data and conforming to the second format has been acquired from the cloud platform; and / or,

[0134] The device further includes a subsequent data acquisition unit 803, which is used to acquire subsequent data in a third format associated with the original data from any cloud platform after acquiring the original data.

[0135] Optionally, at least two of the first format, the second format and the third format are the same format.

[0136] Optionally, the acquiring unit 801 is specifically used for one of the following:

[0137] Identify the first format according to the original data, and query a format conversion template corresponding to the first format from a format template mapping table;

[0138] Determine a data interface for receiving the original data, and query a format conversion template corresponding to the data interface from an interface template mapping table;

[0139] In the case where the original data includes resource description information of available resources provided by any cloud platform, the resource type of the available resource is determined, and a format conversion template corresponding to the resource type is queried from a resource template mapping table.

[0140] Optionally, the original data includes m original fields, the standard data includes n basic fields, m and n are both positive integers and m≥n; the conversion unit 802 is specifically used to:

[0141] According to the conversion rule, determine the values ​​of n original fields in the m original fields that correspond one-to-one to the n basic fields;

[0142] The values ​​of the n original fields are used as the values ​​of the corresponding fields in the n basic fields.

[0143] Optionally, m≥2, n≥1 and m>n, the standard data further includes an extension field, and the conversion unit 802 is specifically configured to:

[0144] The values ​​of the remaining mn original fields except the n original fields in the m original fields are concatenated to serve as the value of the extended field.

[0145] Optionally, the conversion unit 802 is specifically used for at least one of the following:

[0146] adjusting the position of at least one field in the original data according to a field position conversion rule in the conversion rule;

[0147] Changing the name of at least one field in the original data according to a field name conversion rule in the conversion rule;

[0148] The value of at least one field in the original data is converted according to the value format conversion rule in the conversion rule.

[0149] Optionally, the original data is the original data of the current page maintained by any of the cloud platforms.

[0150] The device further includes a first merging unit 804, which is used to merge the current page original data with other page original data cached locally in a page number order to obtain complete original data; the conversion unit 802 is specifically used to: convert the complete original data into complete standard data conforming to the standard format according to the conversion rule;

[0151] or,

[0152] The conversion unit 802 is specifically used to: convert the current page original data into the current page standard data that conforms to the standard format according to the conversion rules; the device also includes a second merging unit 805, which is used to merge the current page standard data with other page standard data converted from other page original data in the local cache in page number order to obtain complete standard data.

[0153] Optionally, the method further includes a processing suggestion unit 806, which is used to:

[0154] Determine a data difference between the standard data and historical standard data, where the historical standard data is obtained by converting the historical original data according to the conversion rule, and the historical original data is a historical version of the original data obtained from any of the cloud platforms;

[0155] A processing suggestion for the standard data is generated according to the data difference, and the data suggestion is provided to the user.

[0156] Optionally, the method further includes a data updating unit 807, which is used to:

[0157] Determining processed standard data in response to a processing operation performed by the user on the standard data, and converting the processed standard data into data to be updated that conforms to the first format according to the conversion rule;

[0158] The data to be updated is uploaded to any one of the cloud platforms to be used for updating the original data maintained by the cloud platform.

[0159] Optionally, the method further includes a template creation unit 808, which is used to:

[0160] Determine the changed fourth format according to the format change notification for the first format issued by any of the cloud platforms; and, update the conversion rule in the format conversion template according to the fourth format, or create a corresponding format conversion template for the fourth format, in which the fourth conversion rule between the fourth format and the standard format is recorded; and / or,

[0161] In response to the received template configuration request, a corresponding format conversion template is created for the fifth format specified by the request, wherein the template records a fifth conversion rule between the fifth format and the standard format.

[0162] Correspondingly, the present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the cloud platform-oriented data processing method as described in any of the above embodiments is implemented.

[0163] Accordingly, the present invention also provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the steps of the cloud platform-oriented data processing method as described in any of the above embodiments.

[0164] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, a game console, a tablet computer, a wearable device or a combination of any of these devices.

[0165] In a typical configuration, a computer includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0166] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0167] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, disk storage, quantum memory, graphene-based storage media or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

Claims

1. A data processing method for a cloud platform, characterized in that: Applied to a cloud data management system connected to multiple cloud platforms, the method comprises: Acquire original data in a first format maintained by any cloud platform from the cloud platform, and determine a format conversion template created for the first format, wherein the template records a conversion rule between the first format and a standard format; The original data is converted into standard data conforming to the standard format according to the conversion rule, and the standard data is provided to the user for processing.

2. The method according to claim 1, characterized in that The obtaining, from any cloud platform, original data in a first format maintained by the cloud platform includes: A request for obtaining the original data is initiated to any cloud platform through an access interface corresponding to the original data provided by the cloud platform, and the original data in the first format returned by the cloud platform through the interface is received.

3. The method according to claim 2, characterized in that The initiating a request for obtaining the original data to the cloud platform through an access interface corresponding to the original data provided by any cloud platform includes: For the original data to be acquired, determine an access interface provided by any cloud platform for the original data, and determine a request template pre-created for the access interface; An acquisition request for the original data is generated according to the request template, and the acquisition request is submitted to the cloud platform through the access interface.

4. The method according to claim 2, characterized in that: The initiating a request for obtaining the original data to the cloud platform through an access interface corresponding to the original data provided by any cloud platform includes: If the number of acquisition requests initiated through the access interface within a preset time period before the current moment does not reach the current limiting threshold, then initiating an acquisition request for the original data through the access interface; If the number of acquisition requests initiated through the access interface within the preset time before the current moment reaches the current limiting threshold, wait until the number of acquisition requests initiated through the access interface within the preset time before the current moment does not reach the current limiting threshold, and then initiate an acquisition request for the original data through the access interface.

5. The method according to claim 2, characterized in that: The initiating a request for obtaining the original data to the cloud platform through an access interface corresponding to the original data provided by any cloud platform includes: In case that other original data needs to be obtained from the access interface or other interfaces provided by any of the cloud platforms, the acquisition request for the original data and other acquisition requests for the other original data are respectively initiated using a concurrent mechanism.

6. A cloud data management system, characterized in that: The system is connected to multiple cloud platforms and is used to: Acquire original data in a first format maintained by any cloud platform from the cloud platform, and determine a format conversion template created for the first format, wherein the template records a conversion rule between the first format and a standard format; The original data is converted into standard data conforming to the standard format according to the conversion rule, and the standard data is provided to the user for processing.

7. A data processing device for a cloud platform, characterized in that: Applicable to a cloud data management system connected to multiple cloud platforms, the device comprises: an acquisition unit, configured to acquire, from any cloud platform, original data in a first format maintained by the cloud platform, and to determine a format conversion template created for the first format, wherein the template records a conversion rule between the first format and a standard format; The conversion unit is used to convert the original data into standard data conforming to the standard format according to the conversion rule, and provide the standard data to the user for processing.

8. An electronic device, comprising: processor; a memory for storing processor-executable instructions; The processor implements the method according to any one of claims 1 to 5 by running the executable instructions.

9. A computer-readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of the method according to any one of claims 1 to 5.

10. A computer program product comprising a computer program and / or instructions, characterized in that: When the computer program and / or the instructions are executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images