Unlock instant, AI-driven research and patent intelligence for your innovation.

A task sharding method based on the elastic-job framework that can elastically expand the capacity of a single machine

A task and framework technology, applied in the computer field, can solve the problem that elastic expansion cannot achieve single-machine multi-thread granularity, etc., and achieve the effect of improving efficiency and resource utilization, saving server costs, and high concurrency granularity.

Active Publication Date: 2022-04-19
JIANGSU SECURITIES
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since elastic-job can only deploy one service under one IP, there is only one instance of the same task in the native service on one machine, and its elastic expansion cannot reach the granularity of single-machine multi-threading, which has certain limitations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A task sharding method based on the elastic-job framework that can elastically expand the capacity of a single machine
  • A task sharding method based on the elastic-job framework that can elastically expand the capacity of a single machine
  • A task sharding method based on the elastic-job framework that can elastically expand the capacity of a single machine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to have a further understanding of the purpose, structure, features, and functions of the present invention, the following detailed descriptions are provided in conjunction with the embodiments.

[0031] See figure 1 , figure 2 , image 3 , Figure 4 as well as Figure 5 , an implementation case of a task sharding method based on the elastic-job elastic expansion of a single machine in the present invention, the flow chart of which is as follows figure 1 shown. In this implementation case, the account-related information is processed according to the account number in the database. Due to the large number of accounts, the service needs to support concurrent fragmentation processing. The present invention comprises the following steps:

[0032] Step 1: Create a task instance and write the task code based on the elastic-job framework; the callback entry function parameter of the elastic-job framework contains the shard items assigned by this task scheduli...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a task sharding method based on the elastic-job framework that can be elastically expanded by a single machine. It mainly includes 6 steps. The main process is to establish a task instance, write task code based on the elastic-job framework, and define a task statement (.xml); Define the task description (.properties); the task parses the sharding items at runtime and the custom parameters of the task; according to the constructed instance matrix and the business sharding strategy written by the user, decide how to process different data concurrently, or Execute concurrent programs; scale up or down services in a distributed environment. The present invention proposes a single-machine elastically expandable task sharding method, so that elastic-job can adapt to the scenario of single-machine multi-thread execution of concurrent tasks, and greatly improves the efficiency of concurrent services and resource utilization. This sharding method does not require too much additional development cost, and supports dynamic expansion and contraction.

Description

technical field [0001] The invention relates to the field of computers, in particular to a method for task sharding that can be elastically expanded on a single machine based on the elastic-job framework. Background technique [0002] In computer software systems, it is often necessary to count, summarize and save a large amount of data. The process of preparing data in advance can be performed automatically by the system at any time specified. Tasks automatically executed by the system are called background tasks; all background tasks that are executed once or periodically at a specified time are called background scheduled tasks, or scheduled tasks for short. [0003] The scheduled task scheduling framework is responsible for providing flexible and diverse timing strategies for the scheduling and execution of scheduled tasks, and monitoring the execution of scheduled tasks in real time. Some scheduling frameworks also provide certain extended functions for task deploymen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/485G06F9/5061
Inventor 高士翔
Owner JIANGSU SECURITIES