Data processing method and device of virtual resource, storage medium, and processor

Abstract

The application discloses a data processing method and device of virtual resources, a storage medium and a processor. The method comprises the following steps: determining attribute information of an abnormal event generated by a target system, wherein the attribute information comprises virtual resources occupied by the abnormal event; generating a corresponding to-be-processed task according to the attribute information, wherein the to-be-processed task comprises processing logic of the virtual resources; and processing the virtual resources of the abnormal event by executing the to-be-processed task. The problem that the resource utilization rate is low due to the fact that the heterogeneous virtual resources are crowded out because of system abnormalities in the prior art is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of data processing, in particular to a data processing method and device for virtual resources, a storage medium and a processor. BACKGROUND

[0002] With the development of cloud computing, various heterogeneous virtual resources (including processors, memories, and inconsistent models) emerge in an endless stream. How to solve the problem of low resource utilization, high operation and maintenance cost, and difficult fault handling caused by the abnormal occupation of heterogeneous virtual resources due to system abnormalities and the inability to release them in time is an urgent problem to be solved.

[0003] In order to solve the above problems, there are operation and maintenance management methods and hybrid cloud platforms in the prior art, which obtain abnormal information of cloud resources, determine at least one abnormal event associated with the abnormal information and a matching processing rule, and perform fault handling according to the processing rule. However, there are still the following defects: abnormal event relationship mining has high time complexity and is relatively complex to implement; and batch calculation and processing of heterogeneous cloud resources are not supported.

[0004] For the problem of low resource utilization caused by the abnormal occupation of heterogeneous virtual resources due to system abnormalities in the related art, there is currently no effective solution. SUMMARY

[0005] The main purpose of the present application is to provide a data processing method and system for virtual resources to solve the problem of low resource utilization caused by the abnormal occupation of heterogeneous virtual resources due to system abnormalities in the related art.

[0006] In order to achieve the above purpose, according to one aspect of the present application, a data processing method for virtual resources is provided, including: determining attribute information of an abnormal event generated by a target system, wherein the attribute information includes virtual resources occupied by the abnormal event; generating a corresponding to-be-processed task according to the attribute information, wherein the to-be-processed task includes processing logic for the virtual resources; and processing the virtual resources of the abnormal event by executing the to-be-processed task.

[0007] Optionally, determining the attribute information of the abnormal event generated by the target system includes: obtaining an abnormal code in the case that the target system generates an abnormality; determining an abnormal event corresponding to the abnormal code in a preset abnormal event set according to the abnormal code; generating an abnormal event instance according to the abnormal event; and determining the attribute information of the abnormal event according to the abnormal event instance.

[0008] Optionally, generating the corresponding to-be-processed task according to the attribute information comprises: calling an encapsulation interface to encapsulate the attribute information to generate the corresponding to-be-processed task; and the method further comprises: writing the to-be-processed task into a task set, wherein the task set is used for executing and recording the state of the to-be-processed task in the task set.

[0009] Optionally, processing the virtual resource of the abnormal event by executing the to-be-processed task comprises: acquiring a plurality of to-be-processed tasks that need to be processed in batches at a time, wherein the plurality of to-be-processed tasks are processing tasks of the virtual resource of at least one abnormal event, and the plurality of to-be-processed tasks correspond to virtual resources of the same type; and processing the plurality of to-be-processed tasks in batches through a corresponding processing platform, wherein the processing platform is used for processing virtual resources of the same type.

[0010] Optionally, after processing the plurality of to-be-processed tasks in batches through the corresponding processing platform, the method further comprises: receiving processing result information of the plurality of to-be-processed tasks sent by the processing platform, wherein the processing result information comprises that a target to-be-processed task is processed successfully or fails; in the case that the target to-be-processed task is processed successfully, changing the state of the target to-be-processed task to a first state; in the case that the target to-be-processed task fails, recording the number of failures of the target to-be-processed task, and in the case that the number of failures reaches a preset number of times, changing the state of the target to-be-processed task to a second state; wherein the state of the plurality of to-be-processed tasks is to-be-processed, or fails and the number of processing failures does not reach the preset number of times.

[0011] Optionally, processing the plurality of to-be-processed tasks in batches through the corresponding processing platform comprises: determining whether a data interface used for data transmission with the processing platform supports batch transmission; in the case that the data interface supports batch transmission, transmitting the plurality of to-be-processed tasks to the processing platform through the data interface for batch processing; and in the case that the data interface does not support batch transmission, transmitting the plurality of to-be-processed tasks to the processing platform through multi-threading for batch processing.

[0012] Optionally, transmitting the plurality of to-be-processed tasks to the processing platform through the data interface for batch processing comprises: aggregating the plurality of to-be-processed tasks into a task array; generating a corresponding virtual resource processing instruction according to the task array; and sending the virtual resource processing instruction to the processing platform, wherein the processing platform processes the virtual resources of the plurality of to-be-processed tasks in batches according to the virtual resource processing instruction.

[0013] To achieve the above object, according to another aspect of the present application, a data processing apparatus of virtual resource is provided. The apparatus comprises: a determining module configured to determine attribute information of an abnormal event generated by a target system, wherein the attribute information comprises virtual resource occupied by the abnormal event; a generating module configured to generate a corresponding to-be-processed task according to the attribute information, wherein the to-be-processed task comprises processing logic of the virtual resource; and a processing module configured to process the virtual resource of the abnormal event by executing the to-be-processed task.

[0014] According to another aspect of the present application, a computer readable storage medium for storing a program is also provided, wherein the program performs the data processing method of virtual resource according to any one of the above embodiments.

[0015] According to another aspect of the present application, an electronic device is also provided, comprising one or more processors and a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the data processing method of virtual resource according to any one of the above embodiments.

[0016] According to the present application, attribute information of an abnormal event generated by a target system is determined, wherein the attribute information comprises virtual resource occupied by the abnormal event; a corresponding to-be-processed task is generated according to the attribute information, wherein the to-be-processed task comprises processing logic of the virtual resource; and the virtual resource of the abnormal event is processed by executing the to-be-processed task. According to the attribute information of the virtual resource of the abnormal event, the to-be-processed task is generated, and the virtual resource of the abnormal event is processed by executing the to-be-processed task, thereby improving the efficiency and accuracy of releasing the virtual resource of the abnormal event of the system, and improving the resource utilization rate of the system. Thus, the problem of low resource utilization rate caused by the abnormal system of the related art is solved. BRIEF DESCRIPTION OF DRAWINGS

[0017] The accompanying drawings, which form a part of the present application, are intended to provide further understanding of the present application, and are used to interpret the illustrative embodiments of the present application and their descriptions, and do not constitute improper limitations to the present application. In the drawings:

[0018] Figure 1 is a flowchart of a data processing method of virtual resource according to an embodiment of the present application;

[0019] Figure 2 is a flowchart of system abnormality identification according to an embodiment of the present application;

[0020] Figure 3is a flow chart of task processing provided according to an embodiment of the present application;

[0021] Figure 4 is a flow chart of resource batch processing provided according to an embodiment of the present application;

[0022] Figure 5 is a schematic diagram of a data processing device of a virtual resource according to an embodiment of the present application;

[0023] Figure 6 is a schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0024] It should be noted that the embodiments and features of the embodiments in the present application can be combined with each other without conflict. The technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0025] In order for those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor should be within the scope of protection of the present application.

[0026] It should be noted that the terms "first", "second" and the like in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not necessarily limit to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0027] It should be noted that the relevant information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for display, analyzed data, etc.) involved in the present disclosure are all information and data authorized by the user or authorized by all parties. For example, an interface is provided between the system and the relevant user or institution. Before obtaining the relevant information, the interface needs to send a request to the aforementioned user or institution, and after receiving the consent information feedback from the aforementioned user or institution, the relevant information is obtained.

[0028] EMBODIMENTS

[0029] The application will be described in the following with reference to the preferred embodiments of the steps, Figure 1 is a flow chart of a data processing method of a virtual resource provided by an embodiment of the application, as shown in the figure, the method comprises the following steps: Figure 1

[0030] Step S101, determining attribute information of an abnormal event generated by a target system, wherein the attribute information comprises virtual resources occupied by the abnormal event;

[0031] Step S102, generating a corresponding to-be-processed task according to the attribute information, wherein the to-be-processed task comprises processing logic of the virtual resources;

[0032] Step S103, processing the virtual resources of the abnormal event by executing the to-be-processed task.

[0033] Through the above steps, the attribute information of an abnormal event generated by a target system is determined, wherein the attribute information comprises virtual resources occupied by the abnormal event; a corresponding to-be-processed task is generated according to the attribute information, wherein the to-be-processed task comprises processing logic of the virtual resources; and the virtual resources of the abnormal event are processed by executing the to-be-processed task. The to-be-processed task is generated according to the virtual resource attribute information of the abnormal event, and the virtual resources of the abnormal event are processed by executing the to-be-processed task, thereby achieving the technical effect of improving the efficiency and accuracy of releasing virtual resources of the system when an abnormal event occurs, and further improving the resource utilization rate of the system, thereby solving the problem of low resource utilization rate caused by the occupation of heterogeneous virtual resources due to system abnormalities in the related art.

[0034] The execution subject of the above steps can be a server of a cloud computing system or a third-party device outside the cloud computing system, which is used for resource coordination management of the cloud computing system. The above target system can be a cloud computing system, and the processors, memories and models in the system are inconsistent, which can cause various heterogeneous virtual resources in the system. The processing of virtual resources often involves different hardware, which is various and difficult to process uniformly. Especially when an abnormality occurs in the system, the corresponding virtual resources cannot be processed, which further causes waste of virtual resources. In the embodiment, the execution subject of the above steps is a task processing engine inside the cloud computing system, which is used to convert the processing of virtual resources into to-be-processed tasks for execution, so as to achieve the purpose of processing virtual resources.

[0035] ​Since the waste of virtual resources is caused by system exceptions, it is necessary to identify the system exceptions in time and accurately. Optionally, in the embodiment, the attribute information of the abnormal event generated by the target system includes: obtaining an abnormal code in the case of abnormality of the target system; searching for the abnormal code in the preset abnormal event set to determine the abnormal event corresponding to the abnormal code; generating an abnormal event instance according to the abnormal event; and determining the attribute information of the abnormal event according to the abnormal event instance.

[0036] The above abnormal code is an abnormal code generated by the system when an exception occurs to record the time, position and specific situation of the exception. The abnormal code corresponds to an abnormal event. The abnormal event set includes the abnormal code and the abnormal event corresponding to the abnormal code. When searching for the abnormal code, searching is performed according to a preset logic, for example, searching by keyword, and the abnormal code corresponding to the abnormal event can also be classified by clustering or machine learning to determine the category of the abnormal code, and then the abnormal event corresponding to the abnormal code is determined according to the abnormal event corresponding to the category. The purpose is to determine the corresponding abnormal event, and then process the abnormal event to obtain the attribute information of the occupied virtual resource, and then release the occupied virtual resource to realize the processing of the virtual resource.

[0037] When the virtual resource is processed according to the attribute information, the corresponding to-be-processed task is generated according to the attribute information, and the task processing engine can execute the to-be-processed task to realize the processing of the virtual resource by the to-be-processed task. Optionally, the method further comprises: calling an encapsulation interface to encapsulate the attribute information to generate a corresponding to-be-processed task; and the method further comprises: writing the to-be-processed task into a task set, wherein the task set is used to execute and record the state of the to-be-processed task in the task set.

[0038] After obtaining the attribute information, the attribute information is encapsulated by the encapsulation interface to generate a to-be-processed task, and the to-be-processed task is written into a task set, so that the task engine processes the task according to the processing strategy. Further, the processing of the virtual resource is realized.

[0039] Optionally, the virtual resource of the abnormal event is processed by executing the to-be-processed task, including: acquiring a plurality of to-be-processed tasks that need to be batch processed, wherein the plurality of to-be-processed tasks are processing tasks of the virtual resource of at least one abnormal event, and the plurality of to-be-processed tasks correspond to the same type of virtual resource; and batch processing the plurality of to-be-processed tasks by a corresponding processing platform, wherein the processing platform is used to process the same type of virtual resource.

[0040] Specifically, in the process of executing the to-be-processed tasks, the virtual resources of the abnormal events are processed in a batch processing manner. A plurality of to-be-processed tasks that need to be processed in batches are acquired at a time, and the plurality of to-be-processed tasks are processed in batches by a corresponding processing platform. The processing platform is used to process virtual resources of the same type, and the plurality of to-be-processed tasks are processing tasks of virtual resources of at least one abnormal event, and the types of the virtual resources corresponding to the plurality of to-be-processed tasks are the same, so that the plurality of to-be-processed tasks can be processed in batches.

[0041] By the batch processing manner, the processing efficiency of the to-be-processed tasks is improved, and the processing efficiency of the virtual resources is improved.

[0042] Optionally, after the plurality of to-be-processed tasks are processed in batches by the corresponding processing platform, the method further includes: receiving processing result information of the plurality of to-be-processed tasks sent by the processing platform, wherein the processing result information includes that a target to-be-processed task is processed successfully or fails; in the case that the target to-be-processed task is processed successfully, changing the state of the target to-be-processed task to the first state; in the case that the target to-be-processed task fails, recording the number of failures of the target to-be-processed task, and in the case that the number of failures reaches a preset number of times, changing the state of the target to-be-processed task to the second state; wherein the state of the plurality of to-be-processed tasks is to-be-processed, or fails and the number of processing failures does not reach the preset number of times.

[0043] For the result of batch processing, considering the processing capability of the processing platform, a failure retry mechanism is provided, that is, in the case that the processing result information of the to-be-processed task is processing failure, the task state is updated to failure, and the number of failures is recorded, and if the processing still fails after the preset number of times, the message of the to-be-processed task failure is sent. Or after reprocessing the task that fails, if the processing is successful, the task state is changed to success. It can be seen that the first state is a success state, and the second state is a final failure state, which can be the same as the normal failure state, but if the number of the failure state reaches the preset number of times, the final failure state is fed back to the user as the processing result.

[0044] Optionally, processing the plurality of to-be-processed tasks in batches by the corresponding processing platform includes: determining whether a data interface used for data transmission with the processing platform supports batch transmission; in the case that the data interface supports batch transmission, transmitting the plurality of to-be-processed tasks to the processing platform for batch processing through the data interface; in the case that the data interface does not support batch transmission, transmitting the plurality of to-be-processed tasks to the processing platform for batch processing through multithreading.

[0045] In the process of batch processing, not only the processing platform needs to perform batch processing, but also the processing platform needs to be batched with the to-be-processed tasks so as to maximize the efficiency of batch processing of the to-be-processed tasks. It should be noted that the processing platform can set multiple virtual processing modules to perform batch processing in parallel or in other ways. Batch transmission needs to determine whether the data interface of the task processing engine and the processing platform supports batch transmission. If it supports, batch transmission is performed through the data interface. If it does not support, the task processing engine needs to use multi-thread concurrent transmission to send as many to-be-processed tasks as possible to the processing platform to ensure that the to-be-processed tasks are sent to the processing platform as quickly and accurately as possible.

[0046] Optionally, the batch transmission of the plurality of to-be-processed tasks to the processing platform for batch processing includes: aggregating the plurality of to-be-processed tasks into a task array; generating a corresponding virtual resource processing instruction according to the task array; and sending the virtual resource processing instruction to the processing platform, wherein the processing platform performs batch processing on the virtual resources of the plurality of to-be-processed tasks according to the virtual resource processing instruction.

[0047] Specifically, if the processing platform supports batch processing, the virtual resource instances in the to-be-processed tasks are aggregated to form an instance array φ = {v1, v2,..., v n} and the resource processing instruction is sent asynchronously to process the virtual resources of the to-be-processed tasks.

[0048] It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0049] It should be noted that the present application also provides an optional embodiment, which will be described in detail below.

[0050] The embodiment provides a consumable heterogeneous virtual resource multi-dimensional dynamic revocation method. An abnormality identification sorting mechanism is adopted to identify abnormalities in multiple dimensions and dynamically obtain a suitable resource preprocessing scheme, so that the operation and maintenance personnel can greatly save the effort of analyzing abnormal data and effectively reduce the labor cost of manual operation and maintenance. A multi-task batch processing mechanism is also adopted. The task processing engine cooperates with a timing job scheduling module to uniformly convert and process through a multi-cloud adaptation layer interface to realize batch scheduling of virtual resources. Multi-task scheduling effectively reduces the probability of interface call failure caused by network communication problems and reduces the thread pressure of the main process business of the system. Details are as follows:

[0051] 1. Abnormality identification sorting,Figure 2 This is a flowchart of system anomaly identification provided according to the embodiments of this application, such as... Figure 2 As shown, the specific steps are as follows.

[0052] I. System anomalies trigger an anomaly identification and sorting mechanism to obtain the anomaly code generated by the system anomaly;

[0053] II. The exception handler matches a suitable exception event ev from the exception event set based on the exception code (code) and the preset exception rule set R:

[0054]

[0055] In the above formula, the Event function is the exception handler matching and parsing logic; the Handle function is the callback function.

[0056] III. Event listeners listen for published exception events and generate exception event instances;

[0057] IV. Extract key information of associated cloud resource instances from abnormal event instances, encapsulate them into task units, and send them to the task processing engine.

[0058] 2. Task processing engine Figure 3 This is a flowchart of task processing provided according to the embodiments of this application, such as... Figure 3 As shown, the specific content is as follows.

[0059] I. The task unit encapsulation interface of the system call task processing engine in this embodiment encapsulates target instances of cloud resources such as computing resources, storage resources, and network resources, key information, generates corresponding type task units, and writes them into the task dataset.

[0060] II. The task processing engine maintains the lifecycle of task units and updates the status and retry count of tasks in the task set in real time based on the task execution status.

[0061] III. Scheduled jobs are scheduled at preset intervals to process task units, and the task processing engine is called to execute the task processing logic of the corresponding task unit in multiple threads.

[0062] 3. Batch processing of cloud resources, Figure 4 This is a flowchart of resource batch processing provided according to the embodiments of this application, such as... Figure 4 As shown, the specific steps are as follows.

[0063] I. Scheduled job scanning scans of eligible task units, with statuses of pending processing or failed and failure counts less than the threshold;

[0064] II. Adapt to heterogeneous multi-cloud environments through the multi-cloud adaptation interface layer. Determine whether the cloud management platform being integrated supports batch processing. If so:

[0065] 1. The virtual resource instance in the aggregation task unit forms an instance array input parameter, and the resource processing instruction is sent asynchronously;

[0066] 2. Otherwise, enable the thread pool multi-thread to send the resource processing instruction in batches.

[0067] III. If the cloud management platform processing success information is received, the corresponding task state is updated to completed; otherwise, the state is updated to failed and the failure number is updated.

[0068] The embodiment can effectively improve the fault processing efficiency: automatic fault processing of virtual resource occupation caused by various system exceptions can greatly reduce the manual operation and maintenance cost and improve the cloud resource utilization of the cloud computing system. It can also uniformly control heterogeneous cloud resources: it realizes the unified revocation processing of various heterogeneous cloud resources such as computing resources, storage resources and network resources, basically covers most of the scenes of cloud computing related businesses, and has wide applicability and practicality. Batch processing of heterogeneous cloud resources is realized: the timing job scheduling technology is adopted to cooperate with the task processing engine to realize the unified collection of virtual resources. Through the unified conversion processing of the multi-cloud adaptation layer interface, the cloud management platform receives and cooperates to execute the resource processing operation. The batch processing mechanism greatly reduces the probability of interface call failure caused by network communication problems, and reduces the thread pressure of the system main process business.

[0069] It should be noted that in the specific implementation, the following steps can be mainly included:

[0070] 1. The system exception triggers the abnormality recognition sorting mechanism of the embodiment, and obtains the abnormality code of the abnormality;

[0071] 2. The abnormality processor matches the appropriate abnormality event from the abnormality event set according to the abnormality code and the preset abnormality rule set; the event listener listens to the published abnormality event, and generates an abnormality event instance; the abnormality event instance analyzes the system abnormality data and extracts the associated virtual resource instance key information and sends it to the task processing engine;

[0072] 3. The timing job scheduling module scans at a preset time, obtains the resource instance key information contained in the task record, and encapsulates it as a to-be-processed task unit;

[0073] 4. Unified conversion processing is performed through the multi-cloud adaptation layer, and a cloud resource batch processing request instruction is initiated to the cloud management platform;

[0074] 5. If the resource processing success message returned by the cloud management platform is received, the task processing engine marks the associated task unit as completed;

[0075] 6. Otherwise, the task processing engine marks the associated task unit as failed and updates the number of failure retries, and waits for step 4 processing within a preset failure retry threshold.

[0076] The embodiment has an exception identification sorting mechanism: the automated analysis system analyzes system exception information and extracts virtual resource instance key information contained in the exception information. Without the intervention of operation and maintenance personnel, the manual operation and maintenance cost is greatly reduced. The resource recovery failure retry is supported: the task processing engine sets the number of failure retries and cooperates with the timing job timing scheduling, which greatly reduces the number of accidental execution failures of the task unit due to poor network and server call exceptions. The multi-cloud heterogeneous scenario is supported: the embodiment realizes the abstract processing of the multi-cloud heterogeneous environment through the multi-cloud adaptation layer, flexibly connects different basic cloud infrastructure management platforms, and realizes the purpose of automatic recovery of resources in the multi-cloud heterogeneous scenario. Batch processing is supported: a batch of to-be-processed task units are scheduled by the timing job, and the cloud management platform resource processing interface is called to realize the batch recovery of cloud resources, which greatly improves the utilization rate of system cloud resources. The combination of sea area exception identification sorting, timing job scheduling, task processing engine, and batch processing can greatly improve the utilization rate of virtual resources of the cloud computing system; and the multi-dimensional dynamic implementation of the abnormal revocation processing of virtual resources can be realized without the intervention of manual operation and maintenance.

[0077] The embodiment of the application further provides a virtual resource data processing device. It should be noted that the virtual resource data processing device of the embodiment of the application can be used to execute the virtual resource data processing method provided by the embodiment of the application. The virtual resource data processing device provided by the embodiment of the application is introduced below.

[0078] Figure 5 is a schematic diagram of a virtual resource data processing device provided by the embodiment of the application, as shown in the figure, the device comprises a determination module 52, a generation module 54, and a processing module 56. The device is described in detail below. Figure 5

[0079] The determination module 52 is configured to determine attribute information of an exception event generated by a target system, wherein the attribute information comprises virtual resources occupied by the exception event. The generation module 54 is connected to the determination module 52 and is configured to generate a corresponding to-be-processed task according to the attribute information, wherein the to-be-processed task comprises processing logic of the virtual resources. The processing module 56 is connected to the generation module 54 and is configured to process the virtual resources of the exception event by executing the to-be-processed task.

[0080] ​The data processing apparatus for virtual resources provided by the embodiment of the present application determines attribute information of an abnormal event generated by a target system, wherein the attribute information comprises virtual resources occupied by the abnormal event; generates a corresponding to-be-processed task according to the attribute information, wherein the to-be-processed task comprises processing logic for the virtual resources; and processes the virtual resources of the abnormal event by executing the to-be-processed task. The to-be-processed task is generated according to the virtual resource attribute information of the abnormal event, and the processing of the virtual resources of the abnormal event is realized by executing the to-be-processed task, thereby realizing the technical effect of improving the efficiency and accuracy of releasing the virtual resources of the abnormal event of the system, and further improving the resource utilization rate of the system, thereby solving the problem of low resource utilization rate caused by the heterogeneous virtual resources being crowded out due to system abnormalities in the related art.

[0081] The data processing apparatus for virtual resources comprises a processor and a memory, the determination module 52, the generation module 54, and the processing module 56 are all stored in the memory as program units, and the corresponding functions are realized by the processor executing the program units stored in the memory.

[0082] The processor comprises a core, and the core retrieves the corresponding program units from the memory. One or more than one core can be set, and the problem of low resource utilization rate caused by the heterogeneous virtual resources being crowded out due to system abnormalities in the related art is solved by adjusting the core parameters.

[0083] The memory can comprise a non-permanent memory in a computer readable medium, a random access memory (RAM), and / or a non-volatile memory such as a read-only memory (ROM) or a flash memory (flash RAM), and the memory comprises at least one memory chip.

[0084] The embodiment of the present application provides a computer readable storage medium, which stores a program, and the program is executed by a processor to realize the data processing method for virtual resources.

[0085] The embodiment of the present application provides a processor, which is used to run a program, and the program is executed to realize the data processing method for virtual resources.

[0086] Figure 6 is a schematic diagram of an electronic device according to the embodiment of the present application, as Figure 6 shown, the embodiment of the present application provides an electronic device 60, which comprises a processor, a memory, and a program stored in the memory and capable of running on the processor, and the processor executes the program to realize the steps of any one of the methods.

[0087] The device in the present application can be a server, a PC, a PAD, a mobile phone, and the like.

[0088] The application also provides a computer program product adapted to perform the program of any of the above method steps when executed on a data processing device of a virtual resource.

[0089] Those skilled in the art will appreciate that embodiments of the application can be supplied as methods, systems, or computer program products. Accordingly, the application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the application can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, magnetic disks, CD-ROMs, optical storage media, and the like) embodying computer program instructions.

[0090] The application is described in reference to the flowchart and / or block diagrams of the methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart and / or block diagrams, and combinations of blocks in the flowchart and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processing device or other programmable data processing device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing device, create means for implementing the functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0091] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0092] These computer program instructions can also be loaded onto a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that the instructions which execute on the computer or other programmable device provide steps for implementing the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0093] In one typical configuration, the computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0094] Memory can include non-persistent memory, Random Access Memory (RAM), and / or non-volatile memory such as read only memory (ROM) or flash memory, etc. in a computer readable medium. Memory is an example of computer readable media.

[0095] Computer readable media includes permanent and non-permanent, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital versatile disc (DVD), or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer readable media does not include transitory media such as modulated data signals and carrier waves.

[0096] It should also be noted that the terms "comprising", "containing", or any other similar term are intended to encompass non-exclusive inclusions such that a process, method, article, or apparatus that comprises a list of elements does not include those elements solely, but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus.

[0097] Those skilled in the art will understand that embodiments of the present application can be provided as a method, a system or a computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage devices, etc.) embodying computer readable program code.

[0098] The above merely provides an example of the present application and is not intended to limit the present application. Various modifications and changes can be made by those skilled in the art to the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the scope of claims of the present application.

Claims

1. A data processing method for virtual resources, characterized in that, include: Determine the attribute information of the abnormal events generated by the target system, wherein the attribute information includes the virtual resources occupied by the abnormal events; A corresponding task to be processed is generated based on the attribute information, wherein the task to be processed includes processing logic for the virtual resource; The virtual resources of the abnormal event are processed by executing the task to be processed; The processing of virtual resources related to the abnormal event by executing the task to be processed includes: The system periodically acquires multiple pending tasks that need to be processed in batches, wherein the multiple pending tasks are processing tasks for virtual resources of at least one abnormal event, and the virtual resources corresponding to the multiple pending tasks are of the same type. The multiple tasks to be processed are processed in batches through the corresponding processing platform, wherein the processing platform is used to process virtual resources of the same type; After batch processing the multiple tasks to be processed through the corresponding processing platform, the method further includes: The system receives processing result information for the plurality of pending tasks sent by the processing platform, wherein the processing result information includes whether the target pending task was successfully processed or failed to process. If the target task to be processed is successfully processed, the status of the target task to be processed is changed to the first status; If the target task fails to process, the number of failures of the target task is recorded. If the number of failures reaches a preset number, the status of the target task is changed to a second status. Among them, the status of the multiple tasks to be processed is pending processing, or processing failed and the number of processing failures has not reached the preset number; The method also includes adapting to heterogeneous multi-cloud environments through a multi-cloud adaptation interface layer.

2. The method according to claim 1, characterized in that, The attribute information for determining the abnormal events generated by the target system includes: When an anomaly occurs in the target system, the anomaly code is obtained; The abnormal event corresponding to the abnormal code is determined by searching in a preset set of abnormal events according to the abnormal code; Generate an exception event instance based on the exception event; The attribute information of the abnormal event is determined based on the abnormal event instance.

3. The method according to claim 2, characterized in that, Generating corresponding tasks to be processed based on the attribute information includes: The encapsulation interface is called to encapsulate the attribute information and generate the corresponding task to be processed. The method further includes: The tasks to be processed are written into a task set, wherein the task set is used to execute and record the status of the tasks to be processed in the task set.

4. The method according to claim 1, characterized in that, Batch processing of the multiple tasks to be processed through the corresponding processing platform includes: Determine whether the data interface used for data transmission with the processing platform supports batch transmission; When the data interface supports batch transmission, the multiple tasks to be processed are transmitted to the processing platform for batch processing through the data interface. If the data interface does not support batch transmission, the multiple tasks to be processed are transmitted to the processing platform for batch processing through multi-threading.

5. The method according to claim 4, characterized in that, Transmitting the multiple tasks to be processed to the processing platform for batch processing via the data interface includes: Aggregate the multiple tasks to be processed into a task array; Generate corresponding virtual resource processing instructions based on the task array; The virtual resource processing instructions are sent to the processing platform, wherein the processing platform performs batch processing on the virtual resources of the multiple tasks to be processed according to the virtual resource processing instructions.

6. A data processing device for virtual resources, characterized in that, include: The determination module is used to determine the attribute information of abnormal events generated by the target system, wherein the attribute information includes the virtual resources occupied by the abnormal event; A generation module is used to generate corresponding tasks to be processed based on the attribute information, wherein the tasks to be processed include processing logic for the virtual resources; The processing module is used to process the virtual resources of the abnormal event by executing the task to be processed; Specifically, the processing module is used for: The system periodically acquires multiple pending tasks that need to be processed in batches, wherein the multiple pending tasks are processing tasks for virtual resources of at least one abnormal event, and the virtual resources corresponding to the multiple pending tasks are of the same type. The multiple tasks to be processed are processed in batches through the corresponding processing platform, wherein the processing platform is used to process virtual resources of the same type; The processing module is further configured to: The system receives processing result information for the plurality of pending tasks sent by the processing platform, wherein the processing result information includes whether the target pending task was successfully processed or failed to process. If the target task to be processed is successfully processed, the status of the target task to be processed is changed to the first status; If the target task fails to process, the number of failures of the target task is recorded. If the number of failures reaches a preset number, the status of the target task is changed to a second status. Among them, the status of the multiple tasks to be processed is pending processing, or processing failed and the number of processing failures has not reached the preset number; The processing module is also used to: adapt to heterogeneous multi-cloud environments through the multi-cloud adaptation interface layer.

7. A computer-readable storage medium, characterized in that, The storage medium is used to store a program, wherein the program executes the data processing method for virtual resources according to any one of claims 1 to 5.

8. An electronic device, characterized in that, It includes one or more processors and a memory, the memory being used to store one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors cause the one or more processors to implement the data processing method for virtual resources according to any one of claims 1 to 5.

Images