Task processing method and device, equipment, medium and product

Abstract

The embodiment of the invention discloses a task processing method and device, equipment, a medium and a product. The task processing method comprises the steps that a task request sent by a target object during the period that an introduced new tape library is in a verification state is received; obtaining attribute information of the task request, and determining an abnormal degree corresponding to the task request according to the attribute information; selecting a target task scheduling node corresponding to the task request from at least two task scheduling nodes according to the corresponding relationship between the abnormal degree of the task request and the tape libraries in different states, wherein the different task scheduling nodes are associated with the tape libraries in different states; and sending the task request to a target task scheduling node, and sending a processing task corresponding to the task request to a corresponding target working node through the target task scheduling node, so that the target working node interacts with an associated tape library to execute the processing task. According to the technical scheme provided by the embodiment of the invention, the influence of a hardware stability problem possibly existing in a new tape library on data security is avoided.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a task processing method, a task processing apparatus, an electronic device, a computer readable storage medium and a computer program product. BACKGROUND

[0002] At present, in order to further reduce the hardware cost of the tape library, different tape library models of multiple tape library manufacturers need to be introduced to realize the price competition of different hardware; wherein, each tape library manages a multi-disc tape hardware container, and the reading and writing of data in the tape can be realized. Generally, the reading and writing of data is realized by task scheduling nodes distributing tasks to different working nodes, and the working nodes interact with the tape library and execute specific reading and writing tasks. However, the task scheduling nodes schedule tasks according to the remaining capacity of the tape library, and after introducing new tape libraries, the new tape libraries may have abnormal hardware stability, the execution of tasks may be affected, resulting in abnormal task execution, thereby affecting the data security of the tape library. SUMMARY

[0003] Embodiments of the present application provide a task processing method, a task processing apparatus, an electronic device, a computer readable storage medium and a computer program product, which avoid the influence of the possible hardware stability problem of the new tape library on data security, ensure the smooth progress of data security and task execution, and further improve the data security of the tape library.

[0004] Other characteristics and advantages of the present application will become apparent from the following detailed description, or will be learned by practice of the present application.

[0005] According to an aspect of an embodiment of the present application, a task processing method is provided, comprising: receiving a task request sent by a target object during a period when the new tape library is in a verification state; obtaining attribute information of the task request, and determining an abnormality degree corresponding to the task request according to the attribute information; selecting a target task scheduling node corresponding to the task request from at least two task scheduling nodes according to a corresponding relationship between the abnormality degree of the task request and tape libraries in different states, wherein different task scheduling nodes are associated with tape libraries in different states; sending the task request to the target task scheduling node, and sending a processing task corresponding to the task request to a corresponding target working node through the target task scheduling node, so that the target working node interacts with the associated tape library to execute the processing task.

[0006] According to an aspect of an embodiment of the present application, a task processing apparatus is provided, which comprises: a receiving module configured to receive a task request sent by a target object during a period when a newly introduced tape library is in a verification state; a determining module configured to acquire attribute information of the task request, and determine an abnormality degree corresponding to the task request according to the attribute information; the determining module is further configured to select a target task scheduling node corresponding to the task request from at least two task scheduling nodes according to a corresponding relationship between the abnormality degree of the task request and tape libraries in different states, wherein different task scheduling nodes are associated with tape libraries in different states; and a sending module configured to send the task request to the target task scheduling node, and send a processing task corresponding to the task request to a corresponding target working node through the target task scheduling node, so that the target working node interacts with an associated tape library to execute the processing task.

[0007] In an embodiment of the present application, the apparatus further comprises a deploying module configured to deploy a stable task scheduling node for carrying tasks of an existing tape library currently in a stable state; and deploy a non-stable task scheduling node when the new tape library is introduced, and configure a preset security label for the non-stable task scheduling node to indicate that the non-stable task scheduling node carries tasks of the new tape library.

[0008] In an embodiment of the present application, the deploying module is further configured to acquire hardware performance of the existing tape library, and update stability of the existing tape library according to the hardware performance to obtain a target stability of the existing tape library; and divide an existing tape library with a target stability less than a preset stability threshold to a tape library corresponding to the non-stable task scheduling node.

[0009] In an embodiment of the present application, the determining module is further configured to, if the abnormality degree of the task request is lower than a preset abnormality degree threshold, determine, according to the corresponding relationship, that a tape library corresponding to the task request is the new tape library in the verification state, so as to select the non-stable task scheduling node configured with the preset security label as the target task scheduling node from the stable task scheduling node and the non-stable task scheduling node; and if the abnormality degree of the task request is higher than the preset abnormality degree threshold, determine, according to the corresponding relationship, that a tape library corresponding to the task request is an existing tape library in the stable state, so as to select the stable task scheduling node as the target task scheduling node from the stable task scheduling node and the non-stable task scheduling node.

[0010] In an embodiment of the present application, the sending module is further configured to, if the target task scheduling node is the unstable task scheduling node, determine a worker node configured with the preset security label; acquire task load information of the worker node configured with the preset security label and a task priority of the task request; and select the target worker node from the worker nodes configured with the preset security label according to the task load information and the task priority.

[0011] In an embodiment of the present application, the target worker node is configured with the preset security label; and the device further comprises an offline module configured to, if it is detected that the new tape library enters a stable state from the verification state, configure an offline label for the unstable task scheduling node, so that the unstable task scheduling node rejects new task requests; remove the preset security label of any target worker node, so that the target worker node from which the preset security label is removed extracts specified normal tasks from the stable task scheduling node; acquire a processing result of the specified normal tasks obtained by the target worker node from which the preset security label is removed through interaction with the new tape library; and determine whether to offline the unstable task scheduling node configured with the offline label according to the processing result.

[0012] In an embodiment of the present application, the offline module is further configured to, if the processing result indicates that the target worker node from which the preset security label is removed works normally, remove the preset security label of the remaining target worker nodes, so that each target worker node extracts a target normal task from the stable task scheduling node; acquire each processing result of the target normal tasks obtained by each target worker node through interaction with the new tape library, to obtain a processing result set; and offline the unstable task scheduling node if the processing result set indicates that each target worker node works normally.

[0013] In an embodiment of the present application, the offline module is further configured to, if the processing result set indicates that there is an abnormal target worker node, determine an abnormal reason according to a work log of the abnormal target worker node; isolate the abnormal target worker node from each target worker node and offline the unstable task scheduling node when the abnormal reason indicates that the abnormal target worker node itself is abnormal; and remove the offline label of the unstable task scheduling node and continue to retain the unstable task scheduling node when the abnormal reason indicates that the new tape library interacted by the abnormal target worker node is abnormal.

[0014] In an embodiment of the present application, the offline module is further configured to acquire an existing task request to be processed in the non-stable task scheduling node before the new tape library enters a stable state; and if the existing task request to be processed is a reheat or deletion request, the existing task request to be processed is re-delivered to the stable task scheduling node.

[0015] In an embodiment of the present application, the determining module is further configured to acquire label information corresponding to a storage space of the target object to which the task request belongs; if the label information matches a preset security label, it is determined that the abnormality degree corresponding to the task request is a first abnormality degree; and if the label information does not match the preset security label, it is determined that the abnormality degree corresponding to the task request is a second abnormality degree, where the second abnormality degree is higher than the first abnormality degree.

[0016] In an embodiment of the present application, the determining module is further configured to acquire a business type corresponding to stored data in a storage space of the target object; acquire an operation mode of the target object for the storage space according to historical requests of the target object; and configure label information of the storage space of the target object according to the business type and the operation mode of the target object for the storage space.

[0017] In an embodiment of the present application, the determining module is further configured to acquire a data operation type corresponding to the task request; if the data operation type is a preset data scheduling type, it is determined that the abnormality degree corresponding to the task request is a first abnormality degree; and if the data operation type is not the preset data scheduling type, it is determined that the abnormality degree corresponding to the task request is a second abnormality degree, where the second abnormality degree is higher than the first abnormality degree.

[0018] According to an aspect of an embodiment of the present application, an electronic device is provided, including one or more processors; a storage device configured to store one or more computer programs, which, when executed by the one or more processors, cause the electronic device to implement the task processing method as described above.

[0019] According to an aspect of an embodiment of the present application, a computer readable storage medium is provided, which stores a computer program, which, when executed by a processor of an electronic device, causes the electronic device to perform the task processing method as described above.

[0020] According to an aspect of an embodiment of the present application, a computer program product is provided, including a computer program stored in a computer readable storage medium, and a processor of an electronic device reads and executes the computer program from the computer readable storage medium, so that the electronic device performs the task processing method as described above.

[0021] In the technical solution provided in the embodiments of the present application, for a task request sent by a target object during a period when a newly introduced tape library is in a verification state, attribute information of the task request is acquired to determine an abnormality degree of the task request, a target task scheduling node corresponding to the task request is selected from at least two task scheduling nodes according to a corresponding relationship between the abnormality degree of the task request and tape libraries in different states, wherein different task scheduling nodes are associated with tape libraries in different states, so that the tape libraries in different states are isolated from each other, the target task scheduling node corresponding to the task request can be accurately determined in combination of the abnormality degree of the task request and the corresponding relationship between the tape libraries, and then the task request is sent to the target task scheduling node, and a processing task corresponding to the task request is sent to a corresponding target working node through the target task scheduling node, so that the target working node interacts with the associated tape library to execute the processing task. That is, the technical solution provided in the present application dynamically adjusts task scheduling according to the abnormality degree of the task request during the period when the newly introduced tape library is in the verification state, and different task scheduling nodes guide tasks with different abnormality degrees to tape libraries in different states through target working nodes. On the one hand, tasks with higher abnormality degrees can be guided to tape libraries with higher stability, thereby avoiding the influence of possible hardware stability problems of the new tape library on data security. On the other hand, by reasonably allocating tasks to tape libraries in different states, the isolation between the tape libraries is achieved. When the new tape library is in the verification state, the stability of the entire tape library is not affected, data security and smooth execution of tasks are ensured, and the data security of the tape library is improved.

[0022] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. BRIEF DESCRIPTION OF DRAWINGS

[0023] The drawings incorporated into the specification and forming a part thereof, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the application. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can also be obtained from these drawings without creative labor for those skilled in the art. In the drawings:

[0024] Figure 1 is a schematic diagram of an implementation environment related to the present application;

[0025] Figure 2 is a flowchart of a task processing method according to an exemplary embodiment of the present application;

[0026] Figure 3 is a flowchart of a task processing method according to an exemplary embodiment of the present application;

[0027] Figure 4 is a flow chart of a task processing method according to an example embodiment of the present application;

[0028] Figure 5 is a flow chart of another task processing method according to an example embodiment of the present application;

[0029] Figure 6 is a flow chart of another task processing method according to an example embodiment of the present application;

[0030] Figure 7 is a flow chart of another task processing method according to an example embodiment of the present application;

[0031] Figure 8 is a flow chart of another task processing method according to an example embodiment of the present application;

[0032] Figure 9 is a flow chart of a task processing method according to another example embodiment of the present application;

[0033] Figure 10 is a flow chart of a task processing method according to another example embodiment of the present application;

[0034] Figure 11 is a flow chart of a task processing method according to another example embodiment of the present application;

[0035] Figure 12 is a software architecture diagram of Berg Global according to an example embodiment of the present application;

[0036] Figure 13 is a flow chart of traffic scheduling during tape library verification according to an example embodiment of the present application;

[0037] Figure 14 is a structural block diagram of a task processing apparatus according to another example embodiment of the present application;

[0038] Figure 15 shows a structural diagram of a computer system of an electronic device suitable for implementing embodiments of the present application. DETAILED DESCRIPTION

[0039] The example embodiments will now be described in detail with reference to the drawings. Like reference numerals in different drawings denote like or similar elements. The following description of the example embodiments is not representative of all embodiments consistent with the present application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the present application as detailed in the appended claims.

[0040] The block diagrams illustrated in the drawings are merely functional entities, and do not necessarily have to correspond to physically independent entities. That is, the functional entities can be implemented in the form of software, or implemented in one or more hardware modules or integrated circuits, or implemented in different network and / or processor devices and / or microcontroller devices.

[0041] The flowcharts illustrated in the drawings are merely exemplary illustrations, and do not necessarily include all contents and operations / steps, nor necessarily executed in the described order. For example, some operations / steps can be further decomposed, and some operations / steps can be combined or partially combined, so that the actual execution order can be changed according to actual conditions.

[0042] It should also be noted that "multiple" in the present application refers to two or more than two. The association relationship of "and / or" describes the associated objects, which means that there can be three relationships, for example, A and / or B can represent the three cases of A alone, A and B together, and B alone. The character " / " generally represents that the associated objects before and after are in an "or" relationship.

[0043] The technical solutions of the embodiments of the present application relate to the field of cloud technology. Before introducing the technical solutions of the embodiments of the present application, the cloud technology is briefly introduced.

[0044] Cloud technology refers to a series of resources such as hardware, software, network, etc. unified in a wide area network or local area network to realize data calculation, storage, processing and sharing. Cloud computing is a computing mode that distributes computing tasks on a resource pool composed of a large number of computers, so that various application systems can obtain computing power, storage space and information services according to needs. The network providing resources is called "cloud". The resources in the "cloud" are infinitely expandable to users, and can be obtained at any time, used on demand, expanded at any time, and paid according to use.

[0045] And cloud storage is a new concept extended and developed on the basis of cloud computing. Distributed cloud storage system (hereinafter referred to as storage system) refers to a storage system that cooperates and works together to provide data storage and business access functions by collecting a large number of various types of storage devices (storage nodes) in the network through cluster application, grid technology and distributed storage file system functions, etc.

[0046] At present, the storage method of the storage system is: creating a logical volume, and allocating a physical storage space for each logical volume when creating the logical volume, which may be a certain storage device or a disk group composed of several storage devices. The client stores data on a certain logical volume, that is, stores data on the file system, the file system divides the data into many parts, each part is an object, the object contains not only data but also additional information such as data identification (ID, ID entity), and the file system writes each object to the physical storage space of the logical volume, and the file system records the storage location information of each object, so that when the client requests to access the data, the file system can enable the client to access the data according to the storage location information of each object.

[0047] The process of allocating a physical storage space for a logical volume by the storage system is: according to the capacity estimation of the object stored in the logical volume (the estimation often has a large margin relative to the actual capacity of the object to be stored) and the group of the redundant array of independent disk (RAID, Redundant Array of Independent Disk), the physical storage space is divided into a strip in advance, and a logical volume can be understood as a strip, so that the logical volume is allocated with a physical storage space.

[0048] Based on the above cloud storage, the tape library in the embodiment of the application can be a storage node in the cloud storage, and the task processing method provided in the embodiment of the application is to process the data of the cloud storage through a task request.

[0049] The technical solutions of the embodiments of the application will be described in detail in combination with the above-mentioned technologies:

[0050] Please refer to Figure 1 , Figure 1 is a schematic diagram of an implementation environment related to the application. The implementation environment includes a task processing system, which includes a cloud object storage (COS) 10, at least one task scheduling node (Captain) 20, a plurality of working nodes (IceWorker) 30 and a plurality of tape libraries (TapeLibrary) 40, wherein the working nodes are bound to the tape libraries, wherein the COS includes a task scheduling end (CaptainClient), and in an example, a plurality of tape libraries can form a tape library group (TapeLibraryGroup).

[0051] The task scheduler is used to receive task requests sent by the target object while the newly introduced tape library is in the verification state; obtain the attribute information of the task request and determine the degree of abnormality corresponding to the task request based on the attribute information; select the target task scheduler node corresponding to the task request from at least two task scheduler nodes according to the correspondence between the degree of abnormality of the task request and tape libraries in different states, wherein different task scheduler nodes are associated with tape libraries in different states; and send the task request to the target task scheduler node.

[0052] The task scheduler distributes tasks to the corresponding target worker nodes through the target task scheduler node. The target task scheduler node is used to send the processing task corresponding to the task request to the corresponding target worker node, so that the target worker node can interact with the associated tape library to execute the processing task.

[0053] The task processing system can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. This document does not impose any restrictions on this.

[0054] It should be noted that in the specific implementation of this application, if the task request involves objects, then when the embodiments of this application are applied to specific products or technologies, permission or consent from the objects is required, and the collection, use and processing of related data must comply with the relevant regulations and standards of the relevant countries and regions.

[0055] The following details the various implementation details of the technical solutions in the embodiments of this application:

[0056] like Figure 2 As shown, Figure 2 This is a flowchart illustrating a task processing method according to an embodiment of this application, which can be applied to... Figure 1 The implementation environment shown indicates that this method can be implemented by Figure 1 The task processing method, executed by the task scheduler in the COS shown, may include steps S210 to S240, as detailed below:

[0057] S210. Receive a task request sent by the target object while the newly introduced tape library is in the verification state.

[0058] In the embodiment of the present application, the introduced new tape library refers to a newly introduced tape library on the basis of an existing tape library. The new tape library can not be suitable for the current system and can be unstable. Therefore, the stability of the new tape library needs to be verified, and the new tape library is in a verification state during the verification. The verification period of the new tape library can be flexibly adjusted according to actual conditions, such as being different according to different models or manufacturers of the new tape library. For example, the new tape library has a verification period of 3-6 months, that is, the new tape library is in a verification state within 3-6 months after the new tape library is introduced.

[0059] During the period when the introduced new tape library is in the verification state, the task scheduling end receives a task request sent by a target object. The task request is used to indicate corresponding processing of data in the tape library, such as data reading, data storage, data deletion, etc. It can be understood that the task request can be one or more, which is not limited here.

[0060] S220, attribute information of the task request is obtained, and the abnormality degree corresponding to the task request is determined according to the attribute information.

[0061] In the embodiment of the present application, in order to avoid abnormal problems caused by the online of the new tape library, the task request needs to be distinguished to determine the abnormality degree corresponding to the task request, and then the task request is diverted to different tape libraries according to the abnormality degree.

[0062] The attribute information of the task request is used to describe various characteristics and detailed data of the request, including request description, type, request source, and resources related to the request. The attribute information can be carried in the task request.

[0063] In an example, the abnormality degree corresponding to the task request can be determined by comparing the attribute information with preset attribute information, wherein the preset attribute information is attribute information corresponding to requests of different abnormality degrees. For example, a large-scale task request can occupy a large amount of resources or cause a high system load, and the abnormality degree is high. For another example, the behavior of the initiator of the task request does not conform to historical data, such as frequent requests, abnormal time period requests, etc., indicating that the abnormality degree of the task request is high.

[0064] S230, according to the corresponding relationship between the abnormality degree of the task request and the tape library in different states, a target task scheduling node corresponding to the task request is selected from at least two task scheduling nodes, wherein different task scheduling nodes are associated with tape libraries in different states.

[0065] It should be noted that the embodiments of the present application include at least two task scheduling nodes, and different task scheduling nodes are associated with tape libraries in different states, for example, including task scheduling node 1 and task scheduling node 3, and the task scheduling node 1 is associated with the tape library in the stable state, and the task scheduling node 3 is associated with the tape library in the verification state.

[0066] The correspondence between different abnormal degrees of task requests and different states of the tape library can be established in advance, and different task scheduling nodes are associated with the tape library in different states. Through the correspondence combined with the association between the task scheduling node and the tape library, a target task scheduling node corresponding to the task request can be selected from each task scheduling node, and then the task requests with different abnormal degrees are guided to the tape library in different states through the corresponding task scheduling node; in the above example, the task request with low abnormal degree is associated with the tape library in the verification state, and the task scheduling node 3 can be selected, and the task request with high abnormal degree is associated with the tape library in the stable state, and the task scheduling node 1 can be selected, and the task request with high abnormal degree is guided to the tape library in the stable state through the task scheduling node 1; for example, the task scheduling node 2 is also included, and the task scheduling node 2 is associated with the tape library in the intermediate transition state, and the intermediate transition state is the intermediate state of the verification state and the stable state, and then the task request with general abnormal degree is guided to the tape library in the intermediate transition state through the task scheduling node 2.

[0067] S240, send the task request to the target task scheduling node, and send the processing task corresponding to the task request to the corresponding target working node through the target task scheduling node, so that the target working node interacts with the associated tape library to execute the processing task.

[0068] In the embodiments of the present application, a plurality of working nodes are included, the task request is sent to the target task scheduling node, the target task scheduling node generates one or more processing tasks based on the request content of the task request, for example, the task request is to delete long-time unused data and store new data, and the processing task 1 of deleting data and the processing task 2 of storing data are generated, and the number of target working nodes can be determined according to the data of the processing task, for example, for two processing tasks, the number of target working nodes is two.

[0069] In an example, the target task scheduling node sends the processing task to the target working node, and the target task scheduling node is associated with the corresponding tape library, and then the target working node can interact with the tape library associated with the target task scheduling node, and then execute the received processing task, wherein the target working node can be a specified working node or a randomly selected working node.

[0070] In another example, different work nodes are bound to different tape libraries, and different task scheduling nodes are associated with different states of the tape libraries, so that an association relationship of the task scheduling node-task node-tape library can be established, and then after the task request is sent to the target task scheduling node, the target task scheduling node can send the processing request to the target task node in the association relationship, and then the target task node interacts with the tape library in the association relationship, and then processes the task.

[0071] In the embodiments of the present application, for the task request sent by the target object during the period when the introduced new tape library is in the verification state, the attribute information of the task request is acquired to determine the abnormality degree of the task request, and according to the corresponding relationship between the abnormality degree of the task request and the tape libraries in different states, a target task scheduling node corresponding to the task request is selected from at least two task scheduling nodes, wherein different task scheduling nodes are associated with tape libraries in different states, so that the tape libraries in different states are isolated from each other. The corresponding target task scheduling node of the task request can be accurately determined by combining the abnormality degree of the task request and the corresponding relationship of the tape libraries, and then the task request is sent to the target task scheduling node, and the target task scheduling node sends the processing task corresponding to the task request to the corresponding target work node, so that the target work node interacts with the associated tape library to execute the processing task. That is, the technical solution provided by the present application dynamically adjusts the task scheduling according to the abnormality degree of the task request during the period when the introduced new tape library is in the verification state. Different task scheduling nodes guide different abnormality degrees of tasks to tape libraries in different states through target work nodes. On the one hand, tasks with higher abnormality degrees can be guided to tape libraries with higher stability, avoiding the influence of possible hardware stability problems of the new tape library on data security. On the other hand, by reasonably allocating tasks to tape libraries in different states, the isolation between the tape libraries is achieved. When the new tape library is in the verification state, the stability of the entire tape library is not affected, ensuring the smooth progress of data security and task execution, and thus improving the data security of the tape library.

[0072] In an embodiment of the present application, another task processing method is provided, which can be applied to Figure 1 the implementation environment shown in the figure, which can be executed by Figure 1 the task scheduling end in the COS shown in the figure, as Figure 3 shown, the task processing method adds S310-S320 before S210 based on Figure 2 . Steps S310-S320 are described in detail as follows:

[0073] S310, deploy a stable task scheduling node for carrying tasks of an existing tape library currently in a stable state.

[0074] S320, when a new tape library is introduced, deploying a non-stable task scheduling node, and configuring a preset security label for the non-stable task scheduling node to indicate that the non-stable task scheduling node carries tasks of the new tape library.

[0075] In the embodiments of the present application, only two task scheduling nodes are deployed, which are a stable task scheduling node and a non-stable task scheduling node. The stable task scheduling node is used to carry tasks of an existing tape library in a stable state, and the existing tape library is relative to a new tape library, that is, the existing tape library exists before the new tape library is introduced.

[0076] When the new tape library is introduced, the non-stable task scheduling node is deployed, which is marked with a preset security label. The preset security label is used to indicate that the non-stable task scheduling node carries tasks of the new tape library. The stable task scheduling node can not be configured with the preset security label, and the non-stable task scheduling node and the stable task scheduling node can be distinguished by the preset security label.

[0077] In an example, before the new tape library is introduced, only the stable task scheduling node is deployed. When the new tape library 1 is introduced at the first time, the non-stable task scheduling node is deployed. When the new tape library 2 is introduced at the second time, if the new tape library 1 is still in a verification state, the non-stable task scheduling node does not need to be deployed again, and the non-stable task scheduling node carries tasks of the new tape library 1 and the new tape library 2. If the new tape library 1 is in a stable state at this time, and there is no non-stable task scheduling node at present, the non-stable task scheduling node is deployed again.

[0078] In another example, after the non-stable task scheduling node is deployed, the configuration of the non-stable task scheduling node can also be adjusted according to the stability of the existing tape library, including obtaining the hardware performance of the existing tape library, and updating the stability of the existing tape library according to the hardware performance to obtain the target stability of the existing tape library. The existing tape library with a target stability less than a preset stability threshold is divided into the tape library corresponding to the non-stable task scheduling node.

[0079] Firstly, the hardware performance information of the existing tape library needs to be collected, including but not limited to the processor performance, memory capacity, storage capacity, network bandwidth, etc. of the tape library, wherein the information can be obtained by system resource utilization, hardware running state and fault log, etc.

[0080] According to the hardware performance information of the existing tape library, the target stability of the tape library is evaluated, wherein the target stability can comprehensively consider various aspects of hardware performance, such as processing capability, storage capability, network bandwidth, etc., to ensure that the tape library can stably run under the current configuration and meet the business requirements; for example, whether the hardware has a fault, whether the performance meets the expectation, whether there is a performance bottleneck, and the evaluation result can be classified according to the preset stability standard to determine the stability level of the hardware.

[0081] For example, according to the hardware performance information of the existing tape library and the historical interaction between the work node and the existing tape library, the target stability of the tape library is evaluated; assuming that the existing tape library, the hardware performance information includes: the tape library uses a 2.5GHz quad-core processor, each core can process 4 threads at the same time; the tape library is equipped with 16GB of memory; the existing tape library has high processor performance and large enough memory capacity, but the historical interaction between the work node and the existing tape library is fast, and the task processing accuracy has a first error, so the stability level of the existing tape library is determined as the first level; but the historical interaction between the work node and the existing tape library is slow, and the task processing accuracy has a second error, which is greater than the first error, so the stability level of the existing tape library is determined as the second level; assuming that the hardware performance information includes that the tape library is built-in 4TB of disk storage space, and uses RAID5 array to ensure data redundancy and performance; the tape library is connected to the network with a bandwidth of 1Gbps, wherein the storage capacity is small or the network bandwidth is limited, and the historical interaction between the work node and the existing tape library is slow, and the task processing has a second or third error, and the third error is greater than the second error, so the stability level of the existing tape library is determined as the third level.

[0082] The target stability is compared with the preset stability threshold, if the target stability is less than the preset stability threshold, such as the stability level of the target stability is less than the first level, it indicates that the corresponding existing tape library is unstable, therefore, the existing tape library is divided into the magnetic tape library corresponding to the non-stable task scheduling node, so that the magnetic tape library with poor performance or low configuration can be removed from the stable task scheduling node, and the stability of the whole system is avoided.

[0083] In other embodiments of the present application, multiple task scheduling nodes can be deployed, and different labels can be configured for each task scheduling node to indicate that the task scheduling node carries tasks of different tape libraries.

[0084] It should be noted that, Figure 3 For other detailed introduction of steps S210-S240 shown in Figure 2 The steps S210-S240 shown in the above embodiment are not repeated here.

[0085] In the embodiments of the present application, the partitioned deployment task scheduling nodes are used, one is a stable task scheduling node without a label, mainly used for stable task bearing of the tape library hardware, and the other is a stable task scheduling node configured with a security label, used for task bearing of unstable new tape libraries in a verification state, so that the tape libraries in different states are isolated through the two task scheduling nodes, which not only realizes simplicity, but also has higher security.

[0086] The embodiments of the present application provide another task processing method, which can be applied to Figure 1 the implementation environment shown in the figure, the method can be executed by Figure 1 the task scheduling end in the COS shown in the figure, as Figure 4 shown, the task processing method extends step S230 to steps S410-S420 on the basis of Figure 3 . Steps S410-S420 are described in detail as follows:

[0087] S410, if the abnormality degree of the task request is lower than the preset abnormality degree threshold, determining the tape library corresponding to the task request as a new tape library in a verification state according to the correspondence relationship, and selecting a non-stable task scheduling node configured with a preset security label from the stable task scheduling node and the non-stable task scheduling node as the target task scheduling node.

[0088] In the embodiments of the present application, if the abnormality degree of the task request is lower than the preset abnormality degree threshold, it means that the task request is less likely to have adverse effects on the system, and the task request can be diverted to the new tape library according to the correspondence relationship, and the non-stable task scheduling node configured with the preset security label bears the task of the new tape library, so the non-stable task scheduling node configured with the preset security label can be selected as the target task scheduling node; wherein the preset abnormality degree threshold can be flexibly adjusted according to actual conditions, such as Figure 5 the first abnormality degree in the embodiments, i.e., the abnormality degree is equal to or less than the first abnormality degree, the non-stable task adjustment node is selected.

[0089] S420, if the abnormality degree of the task request is higher than the preset abnormality degree threshold, determining the tape library corresponding to the task request as an existing tape library in a stable state according to the correspondence relationship, and selecting a stable task scheduling node from the stable task scheduling node and the non-stable task scheduling node as the target task scheduling node.

[0090] If the anomaly level of a task request exceeds the preset anomaly level threshold, it indicates that the task request is likely to have a negative impact on the system. In order to avoid this negative impact as much as possible, the task request needs to be imported into a more stable tape library according to the corresponding relationship. Since the stable task scheduling node carries the tasks of the stable tape library, the stable task scheduling node is selected as the target task scheduling node.

[0091] In other embodiments, a transition task scheduling node is also included for carrying tasks of the tape library in the intermediate transition state. If the abnormality level of the task request is equal to a preset abnormality level threshold, it indicates that the task request is of moderate possibility of causing adverse effects on the system. In this case, the task request needs to be imported into the tape library in the intermediate transition state according to the corresponding relationship, and the transition task scheduling node is selected as the target task scheduling node.

[0092] It should be noted that, Figure 4 For a detailed description of steps S310-S320, S210-S220, and S240 shown in the diagram, please refer to [link to relevant documentation]. Figure 3 Steps S310-S320, S210-S220, and S240 shown will not be repeated here.

[0093] In this embodiment, when a new tape library is launched, task requests with low anomaly levels are sent to unstable task scheduling nodes, thereby diverting tasks with low anomaly levels to the new tape library with questionable stability, while tasks with medium to high anomaly levels are diverted to the more stable tape library, thus ensuring data security and improving service quality.

[0094] This application also provides another task processing method, which can be applied to... Figure 1 The implementation environment shown indicates that this method can be implemented by Figure 1 The task scheduler in COS shown is used to execute the task, such as... Figure 5 As shown, this task processing method is in Figure 2 Based on the above, S220 is extended to S510 to S530. Steps S510 to S530 are described in detail below:

[0095] S510. Obtain the tag information corresponding to the storage space of the target object to which the task request belongs.

[0096] In this embodiment of the application, the attribute information of the task request includes the request source, that is, the storage space of the target object that initiated the task request. Therefore, the tag information corresponding to the storage space of the target object can be obtained. The tag information can be pre-configured by the task scheduler through a configuration file. Therefore, the unique space identifier of the storage space of the target object can be matched with the pre-established mapping table of space identifier and tag information to determine whether there is tag information corresponding to the storage space of the target object.

[0097] In an example, if the tag information of the storage space of the target object does not exist in the mapping table, or whether the mapping table is established, the tag information of the storage space of the target object can be generated according to the task request. For example: obtaining the business type corresponding to the data stored in the storage space of the target object; obtaining the operation mode of the target object for the storage space according to the historical request of the target object; configuring the tag information of the storage space of the target object according to the business type and the operation mode for the storage space.

[0098] Among them, the business type is determined by analyzing and identifying the content, format, structure and the like of the stored data. For example, the business type to which the data belongs can be judged according to the keyword, characteristic value, metadata and the like in the data, such as video, audio, document, picture and the like.

[0099] The system needs to analyze the operation mode of the target object for the storage space according to the historical request record of the target object, which includes but is not limited to the read-write operation frequency of the target object for the storage space, the data access mode, the data access period and the like.

[0100] In the embodiment of the application, the behavior characteristics of the target object on the storage space can be determined through the operation mode of the target object, such as whether the target object is frequently used; the situation that the storage space is affected by the hardware stability can be determined through the business type of the stored data, such as the storage space storing documents is relatively not easy to be affected by the hardware stability; therefore, the tag information of the storage space can be accurately configured by combining the operation mode of the target object and the business type of the stored data.

[0101] In an example, for example, if the data stored in the storage space corresponds to a stable business or the stored data is not easy to be affected by the hardware stability, the storage space is configured with a preset security tag; if the data corresponding to the storage space has a higher requirement for the hardware stability, the storage space is configured with a first abnormal tag; the second abnormal tag is configured for the frequently used storage space; in another example, if the data stored in the storage space has a higher requirement for the hardware stability, or the storage space is frequently used, the storage space does not need to be configured with a tag, that is, the tag information is empty, and then only the task request whether the security tag is configured is distinguished in the subsequent, the processing speed is improved.

[0102] S520, if the tag information matches the preset security tag, it is determined that the abnormal degree corresponding to the task request is the first abnormal degree.

[0103] In the embodiment of the application, if the tag information of the storage space of the target object is the preset security tag, and the preset security tag matches, it means that the possibility of the task request causing adverse effects on the system is low, and the abnormal degree corresponding to the task request is determined as the first abnormal degree.

[0104] S530, if the tag information does not match the preset security tag, determining that the abnormal degree corresponding to the task request is a second abnormal degree, wherein the second abnormal degree is higher than the first abnormal degree.

[0105] If the tag information of the storage space of the target object does not match the preset security tag, such as the tag information being the first abnormal tag or the second abnormal tag, or the tag information being empty, it indicates that the task request has a higher possibility of causing adverse effects on the system, and the abnormal degree corresponding to the task request is determined to be the second abnormal degree, and the second abnormal degree is higher than the first abnormal degree.

[0106] It should be noted that Figure 5 For other detailed descriptions of steps S210, S230-S240 shown in Figure 2 For other detailed descriptions of steps S210, S230-S240 shown in

[0107] In the embodiments of the present application, the tag information of the storage space of the target object is configured by the business type corresponding to the data stored in the storage space and the operation mode of the storage space, and then the low abnormal task request is distinguished based on the tag information, thereby ensuring the accuracy of the abnormality distinction of the task request.

[0108] In an embodiment of the present application, another task processing method is also provided, which can be applied to the implementation environment shown in Figure 1 The method can be executed by the task scheduling end in the COS shown in Figure 1 As shown in Figure 6 The task processing method extends S220 to S610-S630 on the basis shown in Figure 2 S610-S630 are described in detail as follows:

[0109] S610, obtaining a data operation type corresponding to the task request.

[0110] S620, if the data operation type is a preset data scheduling type, determining that the abnormal degree corresponding to the task request is a first abnormal degree.

[0111] S630, if the data operation type is not the preset data scheduling type, determining that the abnormal degree corresponding to the task request is a second abnormal degree, and the second abnormal degree is higher than the first abnormal degree.

[0112] In the embodiment of the present application, the task request is for data in the tape library, and therefore, the data operation type corresponding to the task request can be determined according to the request description or the request type of the task request, where the data operation type refers to an operation type for data in the tape library; and the preset data scheduling type can be flexibly adjusted according to actual conditions, such as the data scheduling type including at least one of settling, reheating, and deleting, where settling refers to a process in which data is transferred from an active state to a more static storage state, and in this process, the data is no longer frequently accessed or modified; and when cold data (data that is rarely accessed) needs to become active again and be frequently accessed, it will undergo a reheating process.

[0113] If the data operation type of the task request is the preset data scheduling type, it indicates that the task request is less likely to cause adverse effects on the system, and the abnormality degree corresponding to the task request is determined as a first abnormality degree; if the data operation type of the task request is not the preset data scheduling type, such as data writing or modification, it indicates that the task request is more likely to cause adverse effects on the system, and the abnormality degree corresponding to the task request is determined as a second abnormality degree, and the second abnormality degree is higher than the first abnormality degree.

[0114] It should be noted that Figure 6 For other detailed descriptions of steps S210, S230-S240 shown in FIG. 2, please refer to Figure 2 For other detailed descriptions of steps S210, S230-S240 shown in FIG. 2, please refer to

[0115] In the embodiment of the present application, the data operation type corresponding to the task request is used to distinguish low-abnormality task requests, thereby improving the accuracy and diversity of abnormality distinction of the task request.

[0116] In the embodiment of the present application, Figure 6 The embodiments shown in FIG. 2 and Figure 5 The embodiments shown in FIG. 2 can be combined to determine the abnormality degree of the task request, for example, the label information corresponding to the storage space of the target object does not match the preset security label, and then the abnormality degree corresponding to the task request is further determined according to the data operation type corresponding to the task request; or the data operation type corresponding to the task request is not the preset data scheduling type, and then the abnormality degree corresponding to the task request is further determined according to the label information corresponding to the storage space of the target object.

[0117] The embodiment of the present application provides a task processing method, which can be applied to Figure 1 The implementation environment shown in FIG. 2, and the method can be executed by Figure 1 The task scheduling end in the COS shown in FIG. 2, such as Figure 7 The task processing method in theFigure 3 On the basis shown in S240, S240 is extended to S710-S740. Steps S710-S740 are described in detail as follows:

[0118] S710, send a task request to a target task scheduling node, and if the target task scheduling node is a non-stable task scheduling node, determine a work node configured with a preset security label.

[0119] It is worth noting that the embodiments of the present application include multiple work nodes, in order to facilitate the work nodes to accurately obtain tasks from the corresponding task scheduling nodes, a preset security label is configured for part of the work nodes, wherein the number of the work nodes configured with the preset security label can be determined according to the number of the tape libraries in the verification state, for example, the more the number of the tape libraries in the verification state, the more the number of the work nodes configured with the preset security label.

[0120] Among them, the work node configured with the preset security label can only obtain tasks from the non-stable task scheduling node configured with the preset security label, therefore, when it is determined that the target task scheduling node is a non-stable task scheduling node, the work node configured with the preset security label needs to be determined from multiple work nodes.

[0121] S720, obtain the task load information of the work node configured with the preset security label and the task priority of the task request.

[0122] In the embodiments of the present application, there are multiple work nodes configured with the preset security label, and the task request may only need part of the work nodes, therefore, the target work node needs to be selected from multiple work nodes configured with the preset security label.

[0123] Firstly, the task load information of each work node configured with the preset security label and the task priority of the task request are obtained, wherein the task load information includes the task data currently to be processed by the node and the available resources of the node, such as CPU usage, memory availability; the task priority of the task request can be determined according to the type, urgency or importance of the task request, for example, if the task type of the task request is a video stream processing task with higher real-time performance, it indicates that the task priority is high; while for background batch processing tasks, such as offline tasks, it indicates that the task priority is low, and different task priorities require different resources.

[0124] S730, select a target work node from the work nodes configured with the preset security label according to the task load information and the task priority.

[0125] S740, sending, by the target task scheduling node, a processing task corresponding to the task request to a corresponding target worker node, so that the target worker node interacts with the associated tape library to perform the processing task.

[0126] In the embodiments of the present application, the load conditions of the worker nodes and the priorities of the tasks are comprehensively considered to select appropriate target worker nodes to execute the tasks; for example, if the load of a certain worker node is low and the resource requirements of the priority of the task are met, the node can be selected as the target worker node.

[0127] When selecting the target worker node, network delays, data transmission speeds, and other factors between nodes can also be considered to ensure that the task can be executed on the most appropriate node. If the task requires a large amount of data transmission, it may be more appropriate to select a worker node that is closer and has lower network delay, which can reduce the time of data transmission and network delay; in addition, if the task needs to cooperate with other nodes or rely on the results of other nodes, the network connection between these nodes also needs to be considered to ensure that the task can be executed smoothly.

[0128] Suppose there are three worker nodes configured with preset security labels: Node A, Node B, and Node C. Node A has low load, but due to poor network connection, the transmission speed is slow; Node B has moderate load, good network connection, and fast transmission speed; Node C has high load, but good network connection. If the priority of the task request is high and needs to be completed within a short time; according to the priority of the task, the load condition of the node, and the network characteristics, Node B can be selected as the target worker node because it has moderate load, good network connection, and fast transmission speed, and the performance of the node can meet the requirements of the task.

[0129] It should be noted that, Figure 7 For other detailed descriptions of steps S310-S320, S210-S230 shown in Figure 3 For other detailed descriptions of steps S310-S320, S210-S230 shown in

[0130] In the embodiments of the present application, different worker nodes are distinguished by configuring security labels, and when determining the non-stable task scheduling node, the target worker node is selected from the worker nodes configured with the preset security labels according to the task load information and the task priority, so that the worker nodes configured with the security labels can accurately obtain the tasks, and the performance of the selected target worker node can meet the requirements of the task.

[0131] The embodiments of the present application provide another task processing method, which can be applied to Figure 1The method can be executed by a task scheduling end in the COS as shown in the implementation environment Figure 1 The task processing method can be executed by a task scheduling end in the COS as shown in the implementation environment Figure 8 The task processing method can be executed by a task scheduling end in the COS as shown in the implementation environment Figure 3 The task processing method can be executed by a task scheduling end in the COS as shown in the implementation environment

[0132] S810, if it is detected that the new tape library enters the stable state from the verification state, the offline label is configured for the unstable task scheduling node, so that the unstable task scheduling node rejects new task requests.

[0133] In the embodiment of the application, the new tape library enters the stable state from the verification state, and the new tape library is the same as the existing tape library and is no longer distinguished. At this time, the new tape library needs to enter the normal task processing mode.

[0134] Firstly, it is needed to detect whether the new tape library enters the stable state from the verification state. In an example, the time when the new tape library is in the verification state can be used for determination. For example, if the time when the new tape library is in the verification state reaches a first preset time, it is determined that the new tape library enters the stable state. In another example, the task result of the task processed by the new tape library when the new tape library is in the verification state can be used for determination. For example, if the task result of the task processed by the new tape library when the new tape library is in the verification state has no error all the time, and the time when the new tape library is in the verification state reaches a second preset time, the second preset time is shorter than the first preset time, it is determined that the new tape library enters the stable state.

[0135] If it is detected that the new tape library enters the stable state, the offline label is configured for the unstable task scheduling node, so that the unstable task scheduling node rejects all new task requests. The new task request is a request received by the unstable task scheduling node after the offline label is configured, including a request containing an upper-layer service and a request for a work node to acquire a task.

[0136] S820, the preset security label of any target work node is removed, so that the target work node with the removed preset security label extracts the specified normal task from the stable task scheduling node.

[0137] As described above, the target work node with the preset security label needs to access the unstable task scheduling node to acquire a correct task. After the offline label is configured for the unstable task scheduling node, the target work node with the preset security label cannot work normally because it cannot acquire the task from the unstable task scheduling node.

[0138] While in a conventional case, the worker nodes can access all the task scheduling nodes, after the offline label is configured on the unstable task scheduling node, the preset security label of any target worker node is removed, and the worker node after the label removal can obtain tasks from any task scheduling node without a label, that is, the target worker node subsequently extracts the specified normal task from the stable task scheduling node.

[0139] S830, obtaining a processing result of the specified normal task obtained by the target worker node after the preset security label is removed by interacting with the new tape library.

[0140] After the target worker node after the preset security label is removed pulls the specified normal task from the stable task scheduling node, the target worker node interacts with the new tape library to execute the specified normal task, and thus the processing result of the target worker node executing the specified normal task can be obtained.

[0141] S840, determining whether to offline the unstable task scheduling node configured with the offline label according to the processing result.

[0142] In the embodiment of the present application, the processing result of the target worker node after the preset security label is removed can be used to determine whether the target worker node is working normally; wherein the processing result includes execution status, execution time, execution result, and the normally working worker node can execute tasks as expected and complete within a specified time, and by comparing the processing result with the expected processing result, it can be determined whether the node is working normally.

[0143] In an example, on the basis of determining whether the node is working normally according to the processing result, the resource utilization of the target worker node can also be detected, including CPU usage, memory usage, network bandwidth utilization, etc., and the normally working worker node can reasonably utilize system resources and keep within an acceptable range.

[0144] In the embodiment of the present application, the target worker node after the label removal can execute tasks as expected and complete within a specified time, indicating that the new tape library has sufficient task processing capacity and can meet business requirements, and is in a stable running state, and thus whether to offline the unstable task scheduling node configured with the preset offline label can be determined according to whether the target worker node after the label removal is working normally, such as the target worker node after the label removal is working normally, and the unstable task scheduling node is offline; or such as the target worker node after the label removal is working normally, and other target worker nodes configured with labels are removed, and whether the new tape library is stable is determined again in combination with the task processing result of the other target worker nodes.

[0145] It should be noted that, Figure 8For further details of the steps S310-S320, S210-S240 shown in FIG. 10, please refer to the description of the steps S310-S320, S210-S240 shown in FIG. 10. Figure 3 For further details of the steps S310-S320, S210-S240 shown in FIG. 10, please refer to the description of the steps S310-S320, S210-S240 shown in FIG. 10.

[0146] In the embodiment of the present application, when the new tape library enters the stable state, the offline label is configured for the unstable task scheduling node, and the preset security label of any target worker node is removed, so that the target worker node extracts the specified normal task from the stable task scheduling node, and whether the node works normally is observed to determine whether the unstable task scheduling node is offline, so as to ensure that the system can be smoothly and accurately restored to the normal operating state.

[0147] The embodiment of the present application provides another task processing method, which can be applied to Figure 1 The implementation environment shown in FIG. 10, the method can be executed by Figure 1 The task scheduling end in the COS shown in FIG. 10, as shown in Figure 9 The task processing method shown in FIG. 10 is based on the basis shown in Figure 8 The step S840 is extended to steps S910-S930 as shown in FIG. 10. The steps S910-S930 are described in detail as follows:

[0148] S910, if the processing result indicates that the target worker node with the removed preset security label works normally, the preset security label of the remaining target worker node is removed, so that each target worker node extracts the target normal task from the stable task scheduling node.

[0149] If the processing result indicates that the target worker node with the removed preset security label works normally, in order to avoid individuality, the preset security label of the remaining target worker node needs to be removed, and each worker node can obtain the task from any one of the task scheduling nodes without label, that is, each target worker node extracts the target normal task from the stable task scheduling node subsequently; wherein the target normal task can be the same as the specified normal task described above, or can be different; the target normal tasks extracted from the stable task scheduling node by different worker nodes can be the same or different, which is not limited here.

[0150] S920, obtaining each processing result of the target normal task obtained by each target worker node through interaction with the new tape library to obtain a processing result set.

[0151] After pulling the specified normal task from the stable task scheduling node, each target worker node will interact with the new tape library to execute the target normal task, so that each processing result of the target normal task executed by the target worker node can be obtained to obtain a processing result set.

[0152] S930, if the processing result set indicates that each target worker node is normal, then the non-stable task scheduling node is offline.

[0153] If the processing result set indicates that each target worker node is normal, it can be determined according to the processing result of each target worker node and the resource utilization of each target worker node, which indicates that the new tape library maintains a stable operation state, and therefore, the non-stable task scheduling node can be offline, and all worker nodes in the system can obtain tasks from the stable task scheduling node and interact with each tape library.

[0154] It should be noted that Figure 9 For other detailed descriptions of steps S310-S320, S210-S240, S810-S830 shown in Figure 8 For other detailed descriptions of steps S310-S320, S210-S240, S810-S830 shown in

[0155] In the embodiments of the present application, when one of the worker nodes that removes the security tag is normal, the security tag of the remaining target worker node is further removed, and then all worker nodes are observed to be normal, and the non-stable task scheduling node is determined to be offline, so that the system can be smoothly, accurately and reliably restored to a normal operation state.

[0156] The embodiments of the present application provide another task processing method, which can be applied to Figure 1 The implementation environment shown in Figure 1 The method can be executed by the task scheduling end in the COS shown in Figure 10 The task processing method adds steps S1010-S1030 on the basis shown in Figure 9 The steps S1010-S1030 are described in detail as follows:

[0157] S1010, if the processing result set indicates that there is an abnormal worker node with working abnormality, then the abnormal reason is determined according to the working log of the abnormal worker node.

[0158] In the embodiments of the present application, if the processing result set indicates that there is at least one abnormal worker node with working abnormality, the target worker node with working abnormality needs to be identified, wherein each worker node has a working log when processing a task, which records all the contents of the worker node processing the task, and therefore the reason for the working abnormality of the abnormal worker node can be determined according to the working log of the abnormal worker node.

[0159] S1020, when the abnormal reason indicates that the abnormal worker node itself is abnormal, the abnormal worker node is isolated from each target worker node, and the non-stable task scheduling node is offline.

[0160] In the embodiments of the present application, the cause of the abnormal working of the working node is that the working node itself is abnormal, for example, the working node itself fails, at this time, the working node needs to be isolated from the working node cluster to prevent the failure from further expanding to affect the entire system, for example, the isolation can be achieved by stopping the service of the failed node or temporarily offline the failed node.

[0161] In an example, if the number of abnormal working nodes is less than the preset number threshold, it can be determined that the plurality of working nodes interact with the new tape library normally, and the unstable task scheduling node can be directly offline.

[0162] In an example, after isolating the abnormal working node, it needs to be repaired or replaced, repairing the failed node includes but is not limited to software upgrade, configuration adjustment, parameter optimization and the like, and replacing the failed node may need to replace the hardware device or redeploy the virtual machine instance, after repairing or replacing the failed node, the abnormal working node pulls the target normal task from the stable task scheduling node again, and executes the target normal task again, and according to the processing result of the re-execution, if the re-execution processing result indicates that the abnormal working node has worked normally, the unstable task scheduling node is offline.

[0163] S1030, when the abnormal cause indicates that the new tape library interacted by the abnormal working node is abnormal, the offline label of the unstable task scheduling node is removed, and the unstable task scheduling node is continued to be retained.

[0164] When the cause of the abnormal working of the working node includes that the new tape library interacted by the abnormal working node is abnormal, it indicates that the new tape library is still unstable, at this time, the offline label of the unstable task scheduling node needs to be removed, the unstable task scheduling node is continued to be retained, and the preset security label of the unstable task scheduling node and each target working node is recovered, and then the unstable task scheduling node guides the task request with lower abnormal degree to the new tape library through the target working node.

[0165] After retaining the unstable task scheduling node for a period of time, the offline label is configured for the unstable task scheduling node, S820-S830 and S910-S920 are executed again, if the processing result set of the re-execution indicates that each target working node works normally, the unstable task scheduling node is offline; if the processing result set of the re-execution indicates that there is still an abnormal working node, and the new tape library interacted by the abnormal working node is abnormal, at this time, the new tape library can be offline, and then the unstable task scheduling node is offline.

[0166] It should be noted that, Figure 10 For other detailed descriptions of steps S310-S320, S210-S240, S810-S830, S910-S930 shown in the method 1000, please refer to the descriptions of steps S310-S320, S210-S240, S810-S830, S910-S930 shown in the method 1000.Figure 9 The steps S310-S320, S210-S240, S810-S830, S910-S930 are not described herein again.

[0167] In the embodiments of the present application, when there is an abnormal working node, the abnormal cause is determined to distinguish whether the node itself is abnormal or the new tape library is abnormal, and then different processing modes for the non-stable task scheduling node are selected, the reliability of processing the non-stable task scheduling node is improved, and the method is suitable for various application scenarios.

[0168] The embodiments of the present application provide another task processing method, which can be applied to Figure 1 The implementation environment is shown in the figure, the method can be executed by Figure 1 the task scheduling end in the COS shown in the figure, such as Figure 11 the task processing method adds steps S1110-S1120 on the basis shown in the figure. Figure 8 The steps S1110-S1120 are described in detail as follows:

[0169] S1110, obtaining an existing task request to be processed in the non-stable task scheduling node before the new tape library enters a stable state.

[0170] As described before, the non-stable task scheduling node configured with the offline label rejects all new task requests, but before the new tape library enters a stable state, the non-stable task scheduling node has received some task requests, and the task requests have not been processed, therefore, the existing task request to be processed needs to be processed; wherein, before the new tape library enters a stable state includes that the new tape library is in a verification state, and the process that the new tape library enters a stable state from the verification state.

[0171] S1120, if the existing task request to be processed is a backheat or deletion request, the existing task request to be processed is re-delivered to the stable task scheduling node.

[0172] In the embodiments of the present application, for the existing task request to be processed, if the existing task request to be processed is a backheat or deletion request, the existing task request to be processed is re-delivered to the stable task scheduling node, and the backheat or deletion request is guided to the tape library in a stable state through the working node configured with the label by the stable task scheduling node.

[0173] In an example, if the existing task request to be processed is a backheat request, an internal error is generated, and the backheat request is successfully processed through retry, and the COS internal error is successfully processed through retry, which means that the error is processed internally, and the object is not aware.

[0174] In other embodiments of this application, if the existing task request to be processed is a request other than settling, reheating, and deletion requests, the unstable task scheduling node may not need to process it. It may wait until the unstable task scheduling node goes offline and then transfer the task to the stable scheduling node; or it may directly return a new message to the object that sent the request.

[0175] It should be noted that, Figure 11 For further details on steps S310-S320, S210-S240, and S810-S840 shown, please refer to [link to detailed description]. Figure 8 Steps S310-S320, S210-S240, and S810-S840 shown will not be repeated here.

[0176] In this embodiment of the application, when an existing task request to be processed in an unstable task scheduling node before the new tape library enters a stable state is a warm-up or deletion request, it is redeployed to a stable task scheduling node to ensure that the task request is processed in a timely manner.

[0177] For ease of understanding, the task processing method provided in the embodiments of this application will be described in detail below:

[0178] The task processing method provided in this embodiment can be applied to Berg (the ultra-cold data storage engine in YottaStore, which interacts with tape library hardware). For example... Figure 12 As shown, Berg's overall software architecture includes COS, a task scheduling node (Captain), a central management node (IceCenter), multiple worker nodes (IceWorkers), and multiple tape library groups. The central management node manages the storage space of each worker node. Each tape library group can include multiple tape libraries. COS plugins can be installed in applications or web pages, allowing objects to interact with COS through these plugins. For example, an object can initiate a settling / heat recovery / deletion request through a web or API-based COS plugin. COS then sends the object's request to Berg's Captain. Upon receiving the request (AddTask), the Captain persists the Task and distributes the task to IceWorkers. The IceWorkers interact with the tape library hardware to execute the specific task.

[0179] It should be noted that IceWorker is bound to the tape library group (TapeLibraryGroup), and Captain distributes tasks to different IceWorkers, which actually distributes tasks to different tape library groups. For the same tape library hardware, Captain schedules according to the tape library group write capability and remaining capacity. In order to further reduce the cost of tape library hardware, different tape library models of multiple tape library manufacturers need to be introduced to realize price competition of different hardware. For newly introduced tape library hardware, the possible hardware stability problem may affect data security.

[0180] Therefore, in order to avoid the abnormal influence problem brought by the online of new hardware, Berg needs to be able to distinguish the task request of the object (or the traffic generated by the task request) in a certain special time window, write the low abnormal task request (or traffic) to the new tape library device, and write the medium and high abnormal task request (or traffic) to the tape library device with stable inventory. That is, when Captain distributes tasks, for different tape library hardware, in the unstable period of new hardware, Captain should only assign low abnormal tasks to the tape library.

[0181] During the tape library verification period, because the new hardware is unstable, special scheduling of task requests (or traffic) during the verification period is required. For example, as shown in Figure 13 , the traffic generated by the task request is scheduled, wherein traffic bifurcation is required in the upstream, and Captain is deployed in the partition.

[0182] CaptainClient in COS needs to distinguish between normal traffic and abnormal traffic. In an example, the traffic generated by the task request initiated by the object can be determined by the storage space of the object. For example, CaptainClient can specify the storage space (Bucket) of the object through the configuration file, and then these low abnormal Buckets will be marked as kLowRisk (i.e. the aforementioned preset security label) inside CaptainClient. When receiving the request of the object, the request includes Bucket information (the data of the object must be contained in a certain Bucket), and then it is determined whether the Bucket corresponding to the Bucket information carries the kLowRisk label. If the kLowRisk label is carried, it indicates that the traffic generated by the request is abnormal business traffic. If the kLowRisk label is not carried, it indicates that the traffic generated by the request is normal business traffic.

[0183] In another example, the operation type of the object can also be distinguished to determine whether the traffic corresponding to the object is normal traffic or abnormal traffic. For example, when receiving a request of an object, the operation type corresponding to the request is obtained. If the operation type includes at least one of settling, back heating, and deleting, it is indicated that the traffic generated by the request is abnormal traffic. At this time, the operation type corresponding to the request can be marked as kLowRisk.

[0184] In the embodiment of the present application, when the Captain partition is deployed, the Captain is divided into two, one is a Captain without a label, mainly used for stable hardware traffic bearing; and the other is a non-stable Captain, used for non-stable hardware traffic bearing. The non-stable task scheduling node is labeled as kLowRisk.

[0185] When the CaptainClient in the COS sends a request of an object to the Captain, the request can be routed according to the label. If the Bucket of the object has a label of kLowRisk, or the operation type of the request has a label of kLowRisk, the request is sent to the non-stable Captain. If the Bucket or the operation type of the request does not have a label, the request is sent to the stable Captain.

[0186] It is worth noting that in a normal case, the IceWorker can access all Captain nodes. For example, in the standard operation mode of the Berg system or when all tape libraries are in a stable state, the IceWorker is authorized to communicate and interact with all Captains. The IceWorker can obtain tasks from any Captain node, regardless of the region or label of the tasks. In the embodiment of the present application, the non-stable IceWorker needs to access the non-stable task scheduling node to obtain the correct Task. Otherwise, the IceWorker may obtain medium or high abnormal traffic from the stable task scheduling node of another partition. Therefore, the IceWorker also needs to be labeled. The IceWorker labeled as kLowRisk can only pull tasks from the kLowRisk Captain. The IceWorker is bound to a tape library group. Therefore, the low abnormal traffic is written to a new tape library device by the Captain and the IceWorker carrying the label.

[0187] For a new manufacturer / model of tape library, there is a gray period of about 3-6 months. During the gray period, the traffic is specially scheduled as described above. After the gray period, the new hardware needs to enter the normal traffic mode. At this time, the traffic of the stable period is normally scheduled. The normal traffic scheduling of the new hardware after stabilization includes:

[0188] 1. A special label is given to the unstable Captain: kStop (the aforementioned offline label), indicating that the unstable Captain is about to go offline and no longer provide services, to inform the system that the unstable Captain is about to stop working and needs to be handled accordingly.

[0189] 2. The Captain node labeled kStop rejects all requests: requests containing upper-layer services and IceWorker task acquisition requests, to ensure that no new requests are sent to the Captain that is about to go offline during the switching process. Among them, there are several types of requests that need to be handled:

[0190] a) User's settlement request: COS internal error, which is successfully retried later and the object is unaware.

[0191] b) User's backheat request: the Captain encountering kStop can be re-deposited to the stable Captain.

[0192] c) User's delete request: the Captain encountering kStop can be re-deposited to the stable Captain.

[0193] d) IceWorker's task acquisition request: IceWorker is rejected, which is expected.

[0194] 3. At this time, the IceWorker of the unstable group cannot work normally (cannot acquire tasks from the unstable Captain), at this time, remove the kLowRisk label of an IceWorker, and the IceWorker expects to normally pull tasks from the stable Captain without a label, and observe whether the IceWorker works normally.

[0195] 4. When the IceWorker in step 3 works normally, remove the kLowRisk label of the remaining IceWorker, at this time, all IceWorkers are expected to be able to pull tasks from the stable Captain, that is, all IceWorkers are involved in the process of acquiring tasks from the stable Captain, to ensure the stable operation of the entire cluster.

[0196] 5. After confirming that all IceWorkers can normally acquire tasks from the stable Captain, the Captain labeled kStop is offline, which is done to complete the switching and completely transfer the traffic to the stable Captain.

[0197] 6. After the above steps are completed, the hardware in the entire cluster is in a stable state, the traffic has been completely migrated to the stable Captain, and the system returns to the normal running state.

[0198] The embodiment of the present application provides a task processing method, which can distinguish the traffic generated by the task request sent by an object in a certain special time window, write low-abnormal traffic into a new tape library device, and write medium-high abnormal traffic into a tape library device with stable inventory, so as to guarantee data security and improve service quality. After the special time window, it is ensured that the new hardware has been stably operated, and the transition to the normal traffic mode is smooth after the test is correct.

[0199] The device embodiment of the present application is introduced, which can be used to execute the task processing method in the above-mentioned embodiment of the present application. For details not disclosed in the device embodiment of the present application, refer to the above-mentioned embodiment of the task processing method.

[0200] The embodiment of the present application provides a task processing device, as shown in the figure, the task processing device can be configured in a task scheduling end, and the device comprises: Figure 14 The receiving module 1410 is configured to receive a task request sent by a target object during a verification state of a newly introduced tape library.

[0201] The determining module 1420 is configured to obtain attribute information of the task request, and determine an abnormal degree corresponding to the task request according to the attribute information.

[0202] The determining module 1420 is further configured to select a target task scheduling node corresponding to the task request from at least two task scheduling nodes according to a corresponding relationship between the abnormal degree of the task request and the tape library in different states, wherein different task scheduling nodes are associated with the tape library in different states.

[0203] The sending module 1430 is configured to send the task request to the target task scheduling node, and send a processing task corresponding to the task request to a corresponding target working node through the target task scheduling node, so that the target working node interacts with the associated tape library to execute the processing task.

[0204] In an embodiment of the present application, based on the foregoing scheme, the device further comprises a deployment module configured to deploy a stable task scheduling node for carrying a task of an existing tape library currently in a stable state; when the new tape library is introduced, a non-stable task scheduling node is deployed, and a preset security label is configured for the non-stable task scheduling node to indicate that the non-stable task scheduling node carries the task of the new tape library.

[0205]

[0206] ​In an embodiment of the present application, based on the foregoing scheme, the deployment module is further configured to obtain hardware performance of the existing tape library, and update stability of the existing tape library according to the hardware performance to obtain target stability of the existing tape library; and divide the existing tape library with target stability less than a preset stability threshold to the tape library corresponding to the unstable task scheduling node.

[0207] In an embodiment of the present application, based on the foregoing scheme, the determination module is further configured to, if the abnormality degree of the task request is lower than a preset abnormality degree threshold, determine, according to the correspondence, that the tape library corresponding to the task request is the new tape library in the verification state, and select, from the stable task scheduling node and the unstable task scheduling node, the unstable task scheduling node configured with the preset security label as the target task scheduling node; and if the abnormality degree of the task request is higher than the preset abnormality degree threshold, determine, according to the correspondence, that the tape library corresponding to the task request is the existing tape library in the stable state, and select, from the stable task scheduling node and the unstable task scheduling node, the stable task scheduling node as the target task scheduling node.

[0208] In an embodiment of the present application, based on the foregoing scheme, the sending module is further configured to, if the target task scheduling node is the unstable task scheduling node, determine a work node configured with the preset security label; obtain task load information of the work node configured with the preset security label and a task priority of the task request; and select, according to the task load information and the task priority, the target work node from the work node configured with the preset security label.

[0209] In an embodiment of the present application, based on the foregoing scheme, the target work node is configured with the preset security label; and the apparatus further includes an offline module configured to, if it is detected that the new tape library enters the stable state from the verification state, configure an offline label for the unstable task scheduling node, so that the unstable task scheduling node rejects a new task request; remove the preset security label of any target work node, so that the target work node from which the preset security label is removed extracts a specified normal task from the stable task scheduling node; obtain a processing result of the specified normal task obtained by the target work node from which the preset security label is removed through interaction with the new tape library; and determine, according to the processing result, whether to offline the unstable task scheduling node configured with the offline label.

[0210] In an embodiment of the present application, based on the foregoing scheme, the offline module is further configured to, if the processing result indicates that the target work node for removing the preset security label is normal, remove the preset security label of the remaining target work node, so that each target work node extracts a target normal task from the stable task scheduling node; obtain each processing result of the target normal task obtained by each target work node through interaction with the new tape library, to obtain a processing result set; and if the processing result set indicates that each target work node is normal, offline the non-stable task scheduling node.

[0211] In an embodiment of the present application, based on the foregoing scheme, the offline module is further configured to, if the processing result set indicates that there is an abnormal work node with work abnormality, determine an abnormal reason according to the work log of the abnormal work node; when the abnormal reason indicates that the abnormal work node itself is abnormal, isolate the abnormal work node from each target work node, and offline the non-stable task scheduling node; and when the abnormal reason indicates that the new tape library interacted by the abnormal work node is abnormal, remove the offline label of the non-stable task scheduling node, and continue to retain the non-stable task scheduling node.

[0212] In an embodiment of the present application, based on the foregoing scheme, the offline module is further configured to obtain an existing task request to be processed in the non-stable task scheduling node before the new tape library enters a stable state; and if the existing task request to be processed is a backheat or deletion request, re-deliver the existing task request to be processed to the stable task scheduling node.

[0213] In an embodiment of the present application, based on the foregoing scheme, the determination module is further configured to obtain label information corresponding to a storage space of the target object to which the task request belongs; if the label information matches a preset security label, determine that the abnormality degree corresponding to the task request is a first abnormality degree; and if the label information does not match the preset security label, determine that the abnormality degree corresponding to the task request is a second abnormality degree, wherein the second abnormality degree is higher than the first abnormality degree.

[0214] In an embodiment of the present application, based on the foregoing scheme, the determination module is further configured to obtain a business type corresponding to stored data in a storage space of the target object; obtain an operation mode of the target object for the storage space according to a historical request of the target object; and configure label information of the storage space of the target object according to the business type and the operation mode for the storage space.

[0215] In an embodiment of the present application, based on the foregoing scheme, the determining module further acquires a data operation type corresponding to the task request; if the data operation type is a preset data scheduling type, the determining module determines that the abnormality degree corresponding to the task request is a first abnormality degree; if the data operation type is not the preset data scheduling type, the determining module determines that the abnormality degree corresponding to the task request is a second abnormality degree, where the second abnormality degree is higher than the first abnormality degree.

[0216] It should be noted that the apparatus provided by the above-described embodiments and the method provided by the above-described embodiments belong to the same concept, wherein the specific manner in which each module and unit performs operations has been described in detail in the method embodiments, which will not be described here.

[0217] Embodiments of the present application also provide an electronic device, including one or more processors, and a storage device, wherein the storage device is configured to store one or more computer programs, and when the one or more computer programs are executed by the one or more processors, the electronic device implements the task processing method as described above.

[0218] Figure 15 A structural schematic diagram of a computer system of an electronic device suitable for implementing embodiments of the present application is shown.

[0219] It should be noted that, Figure 15 The computer system 1500 of the electronic device shown is only an example and should not impose any limitation on the functions and use range of embodiments of the present application, wherein the electronic device can be a client or a server.

[0220] As Figure 15 shown, the computer system 1500 includes a processor (CPU) 1501, which can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 1502 or programs loaded from a storage portion 1508 to a random access memory (RAM) 1503, such as performing the methods in the above-described embodiments. In the RAM 1503, various programs and data required for system operation are also stored. The CPU 1501, the ROM 1502, and the RAM 1503 are connected to each other through a bus 1504. An input / output (I / O) interface 1505 is also connected to the bus 1504.

[0221] In some embodiments, the following components are connected to the I / O interface 1505: an input part 1506 including a keyboard, a mouse, etc.; an output part 1507 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), etc., and a speaker, etc.; a storage part 1508 including a hard disk, etc.; and a communication part 1509 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication part 1509 performs communication processing via a network such as the Internet. A drive 1510 is also connected to the I / O interface 1505 as necessary. A removable media 1511 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is attached to the drive 1510 as necessary, so that a computer program read therefrom is installed in the storage part 1508 as necessary.

[0222] In particular, the processes described above with reference to the flowcharts can be implemented as a computer program according to embodiments of the present application. For example, embodiments of the present application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing a computer program for executing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via the communication part 1509, and / or installed from the removable media 1511. When the computer program is executed by the processor (CPU) 1501, various functions defined in the system of the present application are executed.

[0223] It should be noted that the computer-readable medium in the embodiments of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. The computer-readable storage medium may, for example, be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination thereof. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this application, the computer-readable signal medium can include a data signal propagated in a baseband or as a carrier wave in a propagated data signal, in which the computer-readable computer program is carried. Such a propagated data signal can take on many forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, which can send, propagate, or transmit the program for use by or in connection with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium can be transmitted in any suitable medium, including but not limited to wireless, wired, or the like, or any suitable combination thereof.

[0224] The flowcharts and block diagrams in the drawings illustrate the possible architectures, functions, and operations of apparatuses, methods, and computer program products according to various embodiments of the present application. Each block in the flowcharts or block diagrams can represent a module, a program segment, or a portion of code, which contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur in a different order than that shown in the figures. For example, two blocks noted in succession can actually be executed substantially concurrently, or they can be executed in reverse order, depending on the functionality involved. It should also be noted that each block in the flowcharts or block diagrams, and combinations of blocks in the flowcharts or block diagrams, can be implemented by a dedicated hardware-based system, or can be implemented by a combination of dedicated hardware and computer programs.

[0225] The units or modules involved in the embodiments of the present application can be implemented in software or hardware, and the described units or modules can also be arranged in a processor. In some cases, the names of the units or modules do not constitute a limitation on the units or modules themselves.

[0226] Another aspect of the present application also provides a computer readable storage medium, which stores a computer program. The computer program is executed by a processor to implement the method described above. The computer readable storage medium can be included in the electronic device described in the above embodiments, or can exist separately without being assembled into the electronic device.

[0227] Another aspect of the present application also provides a computer program product, which includes a computer program stored in a computer readable storage medium. The processor of the electronic device reads the computer program from the computer readable storage medium, and the processor executes the computer program to make the electronic device execute the method described above.

[0228] It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, such division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into several modules or units.

[0229] Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the embodiments disclosed herein. The present application is intended to cover any variations, uses, or adaptations of the application following the general principles thereof and including such departures from the present disclosure as come within known use or custom in the art.

[0230] The above is only the preferred exemplary embodiments of the present application, and is not intended to limit the embodiments of the present application. Those skilled in the art can easily make corresponding modifications or changes according to the main idea and spirit of the present application, and therefore the protection scope of the present application should be subject to the protection scope required by the claims.

Claims

1. A task processing method characterized by, The method comprises: receiving a task request sent by a target object during a verification period of a newly introduced tape library; obtaining attribute information of the task request, and determining an abnormality degree corresponding to the task request according to the attribute information; selecting a target task scheduling node corresponding to the task request from at least two task scheduling nodes according to a corresponding relationship between the abnormality degree of the task request and tape libraries in different states, wherein different task scheduling nodes are associated with tape libraries in different states; sending the task request to the target task scheduling node, and sending a processing task corresponding to the task request to a corresponding target worker node through the target task scheduling node, so that the target worker node interacts with an associated tape library to execute the processing task.

2. The method of claim 1, wherein, Before the receiving a task request sent by a target object during a verification period of a newly introduced tape library, the method further comprises: deploying a stable task scheduling node for carrying tasks of an existing tape library currently in a stable state; when the new tape library is introduced, deploying a non-stable task scheduling node and configuring a preset security label for the non-stable task scheduling node to indicate that the non-stable task scheduling node carries tasks of the new tape library.

3. The method of claim 2, wherein, After the deploying a non-stable task scheduling node for carrying tasks of the new tape library, the method further comprises: obtaining hardware performance of the existing tape library, and updating stability of the existing tape library according to the hardware performance to obtain a target stability of the existing tape library; dividing an existing tape library with a target stability less than a preset stability threshold into a tape library corresponding to the non-stable task scheduling node.

4. The method of claim 2, wherein, The selecting a target task scheduling node corresponding to the task request from at least two task scheduling nodes according to a corresponding relationship between the abnormality degree of the task request and tape libraries in different states comprises: if the abnormality degree of the task request is lower than a preset abnormality degree threshold, determining that a tape library corresponding to the task request is the new tape library in the verification state according to the corresponding relationship, so as to select the non-stable task scheduling node configured with the preset security label as the target task scheduling node from the stable task scheduling node and the non-stable task scheduling node; if the abnormality degree of the task request is higher than the preset abnormality degree threshold, determining that a tape library corresponding to the task request is an existing tape library in a stable state according to the corresponding relationship, so as to select the stable task scheduling node as the target task scheduling node from the stable task scheduling node and the non-stable task scheduling node.

5. The method of claim 2, wherein, Before the sending a processing task corresponding to the task request to a corresponding target worker node through the target task scheduling node, comprising: if the target task scheduling node is the non-stable task scheduling node, determining a worker node configured with the preset security label; obtaining task load information of the worker node configured with the preset security label and a task priority of the task request; Select the target worker node from the worker nodes configured with the preset security label according to the task load information and the task priority.

6. The method of claim 2, wherein, The target worker node is configured with the preset security label; and after the target task scheduling node sends the processing task corresponding to the task request to the corresponding target worker node, the method further includes: If it is detected that the new tape library enters the stable state from the verification state, the offline label is configured for the unstable task scheduling node, so that the unstable task scheduling node rejects new task requests; The preset security label of any target worker node is removed, so that the target worker node from which the preset security label is removed extracts the specified normal task from the stable task scheduling node; The processing result of the specified normal task obtained by the target worker node from which the preset security label is removed through interaction with the new tape library is acquired; According to the processing result, it is determined whether to offline the unstable task scheduling node configured with the offline label.

7. The method of claim 6, wherein, The method further includes: If the processing result indicates that the target worker node from which the preset security label is removed works normally, the preset security label of the remaining target worker node is removed, so that each target worker node extracts a target normal task from the stable task scheduling node; Each processing result of the target normal task obtained by each target worker node through interaction with the new tape library is acquired to obtain a processing result set; If the processing result set indicates that each target worker node works normally, the unstable task scheduling node is offline.

8. The method of claim 7, wherein, The method further includes: If the processing result set indicates that there is an abnormal target worker node that works abnormally, the abnormal reason is determined according to the working log of the abnormal target worker node; When the abnormal reason indicates that the abnormal target worker node itself is abnormal, the abnormal target worker node is isolated from each target worker node, and the unstable task scheduling node is offline; When the abnormal reason indicates that the new tape library interacted by the abnormal target worker node is abnormal, the offline label of the unstable task scheduling node is removed, and the unstable task scheduling node is continued to be retained.

9. The method of claim 6, wherein, The method further includes: The existing task request to be processed in the unstable task scheduling node before the new tape library enters the stable state is acquired; If the existing task request to be processed is a backheat or deletion request, the existing task request to be processed is re-delivered to the stable task scheduling node.

10. The method of claim 1, wherein, The attribute information of the task request is acquired, and the abnormal degree corresponding to the task request is determined according to the attribute information, including: The label information corresponding to the storage space of the target object to which the task request belongs is acquired; If the label information matches the preset security label, it is determined that the abnormal degree corresponding to the task request is a first abnormal degree; If the tag information does not match the preset security tag, it is determined that the abnormal degree corresponding to the task request is a second abnormal degree, wherein the second abnormal degree is higher than the first abnormal degree.

11. The method of claim 10, wherein, The tag information corresponding to the storage space of the target object to which the task request belongs is obtained, including: Obtaining a business type corresponding to the data stored in the storage space of the target object; Obtaining an operation mode of the target object for the storage space according to the historical request of the target object; According to the business type and the operation mode of the storage space, the tag information of the storage space of the target object is configured.

12. The method of claim 1, wherein, The attribute information of the task request is obtained, and the abnormal degree corresponding to the task request is determined according to the attribute information, including: Obtaining a data operation type corresponding to the task request; If the data operation type is a preset data scheduling type, it is determined that the abnormal degree corresponding to the task request is a first abnormal degree; If the data operation type is not a preset data scheduling type, it is determined that the abnormal degree corresponding to the task request is a second abnormal degree, wherein the second abnormal degree is higher than the first abnormal degree.

13. A task processing apparatus characterized by comprising: Including: The receiving module is configured to receive a task request sent by a target object during a verification state of an introduced new tape library; The determining module is configured to obtain attribute information of the task request, and determine an abnormal degree corresponding to the task request according to the attribute information; The determining module is further configured to select a target task scheduling node corresponding to the task request from at least two task scheduling nodes according to a corresponding relationship between the abnormal degree of the task request and the tape library in different states, wherein different task scheduling nodes are associated with the tape library in different states; The sending module is configured to send the task request to the target task scheduling node, and send a processing task corresponding to the task request to a corresponding target working node through the target task scheduling node, so that the target working node interacts with the associated tape library to execute the processing task.

14. An electronic device, comprising: Including: One or more processors; Storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the electronic device executes the method of any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that, The computer program is stored on the computer readable storage medium, and the processor of the electronic device reads and executes the computer program from the computer readable storage medium, so that the electronic device executes the method of any one of claims 1 to 12.

16. A computer program product, characterised in that, The computer program product includes a computer program stored in a computer readable storage medium, and the processor of the electronic device reads and executes the computer program from the computer readable storage medium, so that the electronic device executes the method of any one of claims 1 to 12.

Images