Batch isomorphic task rapid disposal method and device

Abstract

The application discloses a batch isomorphic task rapid processing method and device, wherein the method comprises the following steps: establishing a typical isomorphic service model, combining batch tasks into one processing task; defining time sensitivity of system service and applying the same to the isomorphic service model; constructing an isomorphic process, and setting concurrent number count control of the isomorphic process; after task initiation, judging whether the isomorphic process is triggered according to the defined time sensitivity, calling a corresponding isomorphic service model, performing task isomorphism, processing the isomorphic task, and issuing the same; and processing the isomorphic batch task according to the processing type of the isomorphic service model. The method and device can automatically identify isomorphic tasks by constructing a typical isomorphic service model, and can schedule and process the tasks after task combination, so that the data interaction concurrency of the system level is reduced, the performance consumption of the system level caused by batch tasks is reduced, and the task execution efficiency and system performance are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of batch task processing, and in particular to a batch isomorphic task rapid disposal method and device. BACKGROUND

[0002] The prior art solutions for batch task disposal mainly include the following: 1, queue disposal; 2, cache disposal; 3, thread pool concurrent disposal and distributed disposal, etc. These disposal solutions fundamentally still require individual processing for each task, and the execution efficiency is improved through hardware performance, cache mechanism and software concurrency, but the resource consumption is not reduced. For the calling of some underlying devices with performance bottlenecks, a large number of high-concurrency tasks may cause task disposal abnormalities due to the influence of protocols and the devices themselves, and tasks that are disposed relatively slowly, such as query verification, may become a blocking bottleneck for high concurrency.

[0003] For example, the management of network devices has session limitations, and operations such as configuration query, submission and saving take a long time, and new instructions cannot be processed in the operation. If there are high-concurrency tasks here, the entire task disposal period will be relatively long, and if the frequency of issuance is too high, a large number of failed tasks will occur, and adverse effects will be caused on the network devices themselves.

[0004] For example, in a multi-level business system, user-oriented business opening is submitted by users in a scattered and irregular manner, and business peaks are likely to occur. In this scenario, the disposal of high-concurrency tasks that are not sensitive to time will consume the performance of the system and affect the time-sensitive business and user experience. SUMMARY

[0005] To solve the above problems existing in the prior art solutions, the present application provides a batch isomorphic task rapid disposal method and device, which combines isomorphic batch tasks for disposal, and can dispose non-time-sensitive tasks during idle periods, thereby reducing the influence of high-concurrency batch tasks on system performance and improving task disposal efficiency.

[0006] To achieve the above-mentioned purposes, the present application adopts the following technical solutions:

[0007] In an embodiment of the present application, a batch isomorphic task rapid disposal method is provided, which includes the following steps:

[0008] A typical isomorphic business model is established, and batch tasks are combined into one disposal task;

[0009] The time sensitivity of system business is defined and applied to the isomorphic business model;

[0010] An isomorphic process is constructed, and the number of concurrent processes is set to control the count;

[0011] After the task is initiated, whether to trigger the isomorphism process according to the defined time sensitivity, call the corresponding isomorphic business model, perform task isomorphism, and handle and issue the isomorphic task;

[0012] The isomorphic batch task is processed according to the handling type of the isomorphic business model.

[0013] Further, the definition of time sensitivity includes:

[0014] Time sensitivity I represents time zero tolerance, and does not perform isomorphism directly;

[0015] Time sensitivity II represents time sensitivity, tolerates a certain time delay t, and processes tasks within t time;

[0016] Time sensitivity III represents a non-time sensitive task, offline handling business, and processing tasks within T time.

[0017] Further, the isomorphism process sets the number of concurrent controls, including:

[0018] The number of concurrent limits of each business execution efficiency is calculated through statistical analysis, and when the number of isomorphic tasks in the isomorphism process exceeds the number of concurrent limits, the isomorphic process is executed or a new isomorphic process is created.

[0019] Further, after the task is initiated, whether to trigger the isomorphism process according to the defined time sensitivity, call the corresponding isomorphic business model, perform task isomorphism, and handle and issue the isomorphic task, including:

[0020] The task initiation of time sensitivity I is executed immediately without triggering the isomorphism process;

[0021] The task initiation of time sensitivity II checks the isomorphism process, and if it does not exist, it enables the isomorphism process, calls the corresponding isomorphic business model, isomorphizes the task, and times to t; when the isomorphism process timing ends, the isomorphic task is handled and issued; each isomorphic business model corresponds to an isomorphic process;

[0022] The task initiation of time sensitivity III checks the isomorphism process, and if it does not exist, it enables the isomorphism process, calls the corresponding isomorphic business model, isomorphizes the task, and times to T; when the isomorphism process timing ends, it is judged whether the resource is idle; if it is idle, the isomorphic task is handled and issued, otherwise it is re-timed.

[0023] Further, the isomorphic batch task is processed according to the handling type of the isomorphic business model, including:

[0024] If the terminal of the isomorphic business model supports batch handling, the isomorphic batch task is executed directly at one time;

[0025] If the terminal of the same business model does not support batch processing, the same batch task is disassembled, and the subtask execution result is assembled and transmitted after disposal.

[0026] In an embodiment of the present application, a batch same task rapid disposal device is also provided, which comprises:

[0027] A same business model construction module is configured to extract business features, construct a same business model, and provide a capability base for other modules.

[0028] A task same module is configured to perform task content same according to the same business model after task initiation, and construct a same task.

[0029] A same disposal module is configured to monitor same task and subtask execution status, control same task concurrency and time, and issue the same task to an execution module.

[0030] An execution module is configured to process the same batch task according to the disposal type of the same business model.

[0031] Further, the system defines time sensitivity and applies it to the same business model.

[0032] Further, the definition of time sensitivity includes:

[0033] Time sensitivity I represents time zero tolerance, and direct execution without same is performed.

[0034] Time sensitivity II represents time sensitivity, tolerates a certain time delay t, and processes tasks within t time.

[0035] Time sensitivity III represents a non-time sensitive task, and the business is disposed offline, and tasks within T time are processed.

[0036] Further, the control of same task concurrency includes:

[0037] The execution efficiency of each business is calculated by statistical analysis to obtain the concurrency limit, and when the number of same tasks in the same process exceeds the concurrency limit, same disposal is performed or a new same process is created.

[0038] Further, after task initiation, task content same is performed according to the same business model, and a same task is constructed, including:

[0039] The task initiation of time sensitivity I is executed immediately.

[0040] The task initiation of time sensitivity II calls the corresponding same business model, performs task same, and counts to t.

[0041] The task initiation of time sensitivity III calls the corresponding isomorphic business model, isomorphizes the task, and times to T.

[0042] Further, the execution state of the isomorphic task and the subtask is monitored, the isomorphic task is issued to the execution module, and the isomorphic task includes:

[0043] When the isomorphic timing of the task of time sensitivity II ends, the isomorphic task is disposed and issued to the execution module.

[0044] When the isomorphic timing of the task of time sensitivity III ends, it is judged whether the resource is idle, if yes, the isomorphic task is disposed and issued to the execution module, otherwise, the timing is restarted.

[0045] Further, the batch task is processed according to the disposal type of the isomorphic business model, and the batch task includes:

[0046] If the terminal of the isomorphic business model supports batch disposal, the batch task is executed once.

[0047] If the terminal of the isomorphic business model does not support batch disposal, the batch task is disassembled, and the execution result of the subtask is assembled and returned to the isomorphic disposal module after disposal.

[0048] In an embodiment of the present application, a computer device is also provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the foregoing batch isomorphic task fast disposal method when executing the computer program.

[0049] In an embodiment of the present application, a computer readable storage medium is also provided, which stores a computer program for executing the batch isomorphic task fast disposal method.

[0050] Advantages:

[0051] 1. The present application can obviously solve the task execution efficiency and success rate in some scenarios by merging and processing the isomorphic batch task.

[0052] 2. The present application controls the concurrent task quantity between systems, and improves the efficiency of system coordination and task disposal. BRIEF DESCRIPTION OF DRAWINGS

[0053] Figure 1 is a batch isomorphic task fast disposal method flow diagram of an embodiment of the present application;

[0054] Figure 2 is an isomorphic and disposal example diagram of an embodiment of the present application;

[0055] Figure 3 is a task isomorphic and disposal flow diagram of an embodiment of the present application;

[0056] Figure 4 is a network device batch delivery isomorphic and disposal example diagram of an embodiment of the application;

[0057] Figure 5 is a multi-level system batch task isomorphic and disposal schematic diagram of an embodiment of the application;

[0058] Figure 6 is a batch isomorphic task rapid disposal device structure schematic diagram of an embodiment of the application;

[0059] Figure 7 is a computer device structure schematic diagram of an embodiment of the application. DETAILED DESCRIPTION

[0060] The principles and spirits of the present application will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are given only to enable those skilled in the art to better understand and implement the present application, and do not limit the scope of the present application in any way. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0061] Those skilled in the art know that the embodiments of the present application can be implemented as a system, device, apparatus, method or computer program product. Therefore, the present disclosure can be embodied in the form of a complete hardware, a complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0062] According to the embodiments of the present application, a batch isomorphic task rapid disposal method and device are proposed. By constructing a typical isomorphic business model, the system automatically identifies isomorphic tasks and schedules and disposes the tasks after merging, reduces the data interaction concurrency at the system level, reduces the performance consumption of batch tasks on the system level, and improves the task execution efficiency and system performance.

[0063] The principles and spirits of the present application will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are given only to enable those skilled in the art to better understand and implement the present application, and do not limit the scope of the present application in any way. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0064] Figure 1 is a batch isomorphic task rapid disposal method flowchart schematic diagram of an embodiment of the application. As shown in Figure 1 , the method comprises:

[0065] S1, a typical isomorphic business model is established, and batch tasks are merged into one disposal task. Two ways: (1) using expert experience to establish an isomorphic business model; (2) based on a large amount of task disposal data, using machine learning modeling, and using expert confirmation to establish an isomorphic business model.

[0066] S2, the system service defines time sensitivity and applies to the homogeneous service model. Time sensitivity I represents time zero tolerance, and no homogeneous direct execution; time sensitivity II represents time sensitivity, but batch tasks will cause the overall efficiency of the task to decrease, and a certain time delay t is tolerated, the homogeneous process handles the task within t time, t can be manually set or dynamically adjusted by the program within a certain time interval according to the task execution efficiency; time sensitivity III represents non-time sensitive tasks, which can be disposed offline and can be processed by homogeneous process within T time, T can also be set by manual or program dynamic adjustment.

[0067] S3, build a homogeneous process, and set the concurrency count control. The concurrency limit of the highest execution efficiency of each service is calculated through statistical analysis, that is, the acceptable threshold of service processing delay is defined, and the delay corresponding to different concurrency is calculated. If the average of the concurrency that reaches the delay threshold is calculated from multiple samples, it is used as the concurrency limit here. When the number of homogeneous tasks in the homogeneous process exceeds the concurrency limit, the homogeneous process is executed or a new homogeneous process is created.

[0068] S4, after the task is initiated, according to the defined time sensitivity, it is judged whether to trigger the homogeneous process, the corresponding homogeneous service model is called, the task is homogenized, and the homogenized task is disposed and issued, as shown in Figure 2 and Figure 3 .

[0069] The task initiation of time sensitivity I is executed immediately without triggering the homogeneous process;

[0070] The task initiation of time sensitivity II checks the homogeneous process, and if it does not exist, the homogeneous process is enabled, the corresponding homogeneous service model is called, the task is homogenized, and the timing is started to t; when the homogeneous process timing ends, the homogenized task is disposed and issued;

[0071] If different homogeneous service models appear at the same time, different homogeneous processes are enabled, and each homogeneous service model corresponds to a homogeneous process;

[0072] The task initiation of time sensitivity III checks the homogeneous process, and if it does not exist, the homogeneous process is enabled, the corresponding homogeneous service model is called, the task is homogenized, and the timing is started to T; when the homogeneous process timing ends, the system monitoring module is called to judge whether the resource is idle; if it is idle, the homogenized task is disposed and issued, otherwise the timing T is restarted.

[0073] S5, the homogenized batch task is processed according to the disposal type of the homogeneous service model. If the terminal of the homogeneous service model supports batch disposal, the homogenized batch task is executed once; if the terminal of the homogeneous service model does not support batch processing, the homogenized batch task is disassembled, and the subtask execution result is assembled back after disposal.

[0074] It is to be understood that even though operations of the method of the present application are described in a particular order in the above embodiments and drawings, this is not required or implied in any way as to order or sequence of the operations, or that all described operations be performed to achieve desirable results. Additionally or alternatively, certain steps can be omitted, combined into a single step, and / or split into multiple steps.

[0075] In order to more clearly explain the method for quickly generating a function configuration based on a new metropolitan area network topology described above, a specific embodiment will be described below, however, it is important to note that this embodiment is only to better illustrate the present application and does not constitute an improper limitation on the present application.

[0076] Implementation scenario one: network device batch delivery

[0077] Network device policy delivery involves pre-inspection, in-process delivery, and post-verification. Each task contains at least three operations for each device, and each operation is not equal. Network device policy has a high degree of formatting and belongs to a typical isomorphic task. According to the treatment method provided by the present application, the pre-inspection, in-process delivery, and post-verification instructions of the isomorphic task can be merged and delivered once. The program sorts the network device return information, and the interaction efficiency between network devices that can easily cause performance problems is significantly improved, as shown in Figure 4 .

[0078] Implementation scenario two: multi-level system batch task treatment

[0079] The scenario of multi-level system coordination business treatment is generally a bottom-level device that encapsulates capabilities and has a unified data interface format, which is also a typical isomorphic model. For each interface, an isomorphic business model can be constructed. The system-to-system capability interface needs to support batch task delivery.

[0080] The topmost system directly faces users, tasks are scattered and concurrent, and the bottom-level system is responsible for business capability treatment and repeated treatment of massive same business capabilities. The interface between systems can be processed by isomorphism to reduce the loss of business performance between systems, and a large number of high concurrency can be implemented within the system to treat, which can provide the efficiency and system performance of the overall system collaborative treatment, as shown in Figure 5 .

[0081] Based on the same inventive concept, the application further provides a batch same-structure task rapid processing device. The implementation of the device can refer to the implementation of the above method, and the repeated parts will not be described here. The term "module" used below can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware or a combination of software and hardware is also possible and contemplated.

[0082] Figure 6 Figure 1 is a structural schematic diagram of a batch same-structure task rapid processing device according to an embodiment of the application. As shown in the figure, the device comprises: Figure 6

[0083] A same-structure business model construction module 101 located on the business organization system side, used for extracting business features, constructing a same-structure business model, and providing a capability base for other modules.

[0084] A task same-structure module 102 located on the business organization system side, used for constructing a same-structure task according to the same-structure business model after the task is initiated;

[0085] A same-structure processing module 103 located on the business organization system side, used for monitoring the execution state of the same-structure task and subtask, controlling the concurrency and time of the same-structure task, and issuing the same-structure task to the execution module; the basic information that needs to be maintained includes: same-structure task number, business model number, same-structure task execution time, same-structure task state, same-structure subtask number, subtask state, and subtask processing time, etc.

[0086] The system defines time sensitivity of business and applies it to the same-structure business model; time sensitivity I represents time zero tolerance, and the task is directly executed without same-structure processing; time sensitivity II represents time sensitive, tolerates a certain time delay t, and processes the task within t time; time sensitivity III represents a non-time sensitive task, and processes the business offline within T time;

[0087] The task initiated by time sensitivity I is executed immediately;

[0088] The task initiated by time sensitivity II calls the corresponding same-structure business model, processes the task with same-structure, and counts time to t; when the counting ends, the same-structure task is processed and issued to the execution module;

[0089] The task initiated by time sensitivity III calls the corresponding same-structure business model, processes the task with same-structure, and counts time to T; when the counting ends, it is judged whether the resource is idle, if it is idle, the same-structure task is processed and issued to the execution module, otherwise the counting is restarted;

[0090] ​The statistical analysis calculates the concurrent number limit of the highest execution efficiency of each service, and when the isomorphic task number in the isomorphic process exceeds the concurrent number limit, the isomorphic process is executed or newly created.

[0091] The execution module 104 is located at the capability output system side, and is configured to process the isomorphic batch task according to the processing type of the isomorphic service model. If the terminal supporting batch processing of the isomorphic service model, the isomorphic batch task is executed once; if the terminal not supporting batch processing of the isomorphic service model, the isomorphic batch task is disassembled, and the subtask execution result is assembled and transmitted to the isomorphic processing module 103 after processing.

[0092] It should be noted that although several modules of the batch isomorphic task fast processing device are mentioned in the foregoing detailed description, such division is merely exemplary and not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules described above can be embodied in one module. Conversely, the features and functions of one module described above can be further divided into several modules.

[0093] Based on the foregoing inventive concept, as shown in Figure 7 The present application also proposes a computer device 200, which comprises a memory 210, a processor 220, and a computer program 230 stored in the memory 210 and executable on the processor 220, and the processor 220 implements the foregoing batch isomorphic task fast processing method when executing the computer program 230.

[0094] Based on the foregoing inventive concept, the present application also proposes a computer readable storage medium, which stores a computer program for executing the foregoing batch isomorphic task fast processing method.

[0095] The batch isomorphic task fast processing method and device proposed by the present application can very obviously solve the task execution efficiency and success rate in some scenarios by merging the isomorphic batch task, and improve the efficiency of system coordination processing tasks by controlling the concurrent task quantity between systems.

[0096] Although the spirit and principles of the present application have been described with reference to several specific embodiments, it should be understood that the present application is not limited to the disclosed specific embodiments, and the division of aspects does not mean that the features in these aspects cannot be combined for the benefit. Such division is only for the convenience of expression. The present application is intended to cover various modifications and equivalent arrangements contained in the spirit and scope of the appended claims.

[0097] The skilled in the art should understand that the modifications or changes made on the basis of the technical scheme of the present application without paying creative labor are still within the protection scope of the present application.

Claims

1. A method for rapid processing of batch isomorphic tasks, characterized in that, The method includes: Establish a typical isomorphic business model to merge batch tasks into a single processing task; The system defines time sensitivity for business operations and applies it to the homogeneous business model. The definition of time sensitivity includes: Time sensitivity I represents zero tolerance for time, and execution is performed directly without homogeneity; Time sensitivity II represents time sensitivity, tolerating a certain delay t, and homogeneously processing tasks within time t; Time sensitivity III represents non-time-sensitive tasks, which are processed offline and homogeneously processed within time T. Create isomorphic processes and set up concurrency counting control for the isomorphic processes; After a task is initiated, based on the defined time sensitivity, it is determined whether an isomorphic process is triggered. The corresponding isomorphic business model is then invoked to perform task isomorphism, and the isomorphic task is processed and distributed, including: Tasks with time sensitivity I are initiated and executed immediately without triggering isomorphic processes. When a time-sensitive II task is initiated, a isomorphic process is checked. If no isomorphic process exists, it is started, the corresponding isomorphic business model is invoked, the task is isomorphized, and the timer is set to t. When the isomorphic process timer ends, the isomorphic task is processed and distributed. Each isomorphic business model corresponds to one isomorphic process. When a time-sensitive III task is initiated, a isomorphic process is checked. If no isomorphic process exists, it is started, the corresponding isomorphic business model is called, the task is isomorphized, and the timer is set to T. When the isomorphic process timer ends, it is determined whether the resources are idle. If idle, the isomorphic task is processed and issued; otherwise, the timer is reset to T. Process homogeneous batch tasks according to the disposal type of the homogeneous business model.

2. The method for rapid processing of batch isomorphic tasks according to claim 1, characterized in that, Homogeneous processes can configure concurrency counting control, including: Statistical analysis is used to calculate the maximum concurrency limit for each business operation. When the number of homogeneous tasks in a homogeneous process exceeds the concurrency limit, homogeneous processing is performed or a new homogeneous process is created.

3. The method for rapid processing of batch isomorphic tasks according to claim 1, characterized in that, Process homogeneous batch tasks according to the disposal type of the homogeneous business model, including: If the terminal of the homogeneous business model supports batch processing, then the homogeneous batch tasks will be executed directly at once. If the terminal of the homogeneous business model does not support batch processing, the homogeneous batch tasks will be broken down, processed, and the execution results of the sub-tasks will be assembled and sent back.

4. A device for rapid processing of batch homogeneous tasks, characterized in that, The device includes: The isomorphic business model construction module is used to extract business features, construct isomorphic business models, and provide a capability foundation for other modules. The system business defines time sensitivity and applies it to the isomorphic business model. The definition of time sensitivity includes: Time sensitivity I represents zero time tolerance, and execution is performed directly without isomorphism; Time sensitivity II represents time sensitivity, tolerating a certain delay t, and isomorphically processing tasks within time t; Time sensitivity III represents non-time-sensitive tasks, handling business offline, and isomorphically processing tasks within time T. The task isomorphism module is used to construct isomorphic tasks by isomorphizing task content based on the isomorphic business model after a task is initiated, including: Tasks with time sensitivity level I are initiated and executed immediately. When a time-sensitive II task is initiated, the corresponding isomorphic business model is invoked, the task is made isomorphic, and the timer is set to t. When a time-sensitive III task is initiated, the corresponding isomorphic business model is invoked, the task isomorphic, and the timer is set to T. The isomorphic task handling module is used to monitor the execution status of isomorphic tasks and subtasks, control the concurrency and timing of isomorphic tasks, and distribute isomorphic tasks to the execution module, including: When the time-sensitive II task isomorphism timer ends, the isomorphic task is processed and sent to the execution module; When the time-sensitive III task isomorphic timing ends, determine whether the resource is idle. If it is idle, process the isomorphic task and send it to the execution module; otherwise, restart the timing. The execution module is used to process homogeneous batch tasks according to the disposal type of the homogeneous business model.

5. The rapid processing device for batch isomorphic tasks according to claim 4, characterized in that, Controlling the concurrency of homogeneous tasks includes: Statistical analysis is used to calculate the maximum concurrency limit for each business operation. When the number of homogeneous tasks in a homogeneous process exceeds the concurrency limit, homogeneous processing is performed or a new homogeneous process is created.

6. The rapid processing device for batch isomorphic tasks according to claim 4, characterized in that, Process homogeneous batch tasks according to the disposal type of the homogeneous business model, including: If the terminal of the homogeneous business model supports batch processing, then the homogeneous batch tasks will be executed directly at once. If the terminal of the homogeneous business model does not support batch processing, the homogeneous batch tasks will be broken down, processed, and the execution results of the sub-tasks will be assembled and sent back to the homogeneous processing module.

7. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method according to any one of claims 1-3.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that performs the method according to any one of claims 1-3.

Images