Unlock instant, AI-driven research and patent intelligence for your innovation.

Distributed job scheduling method and device and distributed system

A job scheduling, distributed technology, applied in the computer field

Pending Publication Date: 2022-01-28
NEW H3C BIG DATA TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the embodiment of the present invention provides a distributed job scheduling method, device and distributed system to solve the data consistency problem in the distributed scheduling scenario

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed job scheduling method and device and distributed system
  • Distributed job scheduling method and device and distributed system
  • Distributed job scheduling method and device and distributed system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] Embodiment 1 of the present invention provides a distributed job scheduling method, which is applied to a distributed system. The distributed system mentioned in Embodiment 1 of the present invention is a distributed software system, and the scene is transformed into the same software service program Installed and deployed on multiple computers separately, all installed software programs are completely consistent in function. For example, quartz and redis are installed and deployed on multiple computers in a distributed system. Among them, quartz is an open source scheduling framework developed in java language, which can realize various scheduling functions such as periodicity and cron expressions; redis is a key-value database based on memory, with fast read and write speed, and is mostly used for data processing cache. It can be understood that the software service program installed and deployed on multiple computers in the distributed system is not limited to the a...

Embodiment 2

[0105] Embodiment 2 of the present invention provides a distributed job scheduling method, which is applied to distributed systems, specifically the job recovery process in distributed job scheduling. The distributed system mentioned in Embodiment 2 of the present invention is distributed The software system, the scenario is that the same software service program is installed and deployed on multiple computers, and all installed software programs are completely consistent in function. For example, quartz and redis are installed and deployed on multiple computers in a distributed system. Among them, quartz is an open source scheduling framework developed in java language, which can realize various scheduling functions such as periodicity and cron expressions; redis is a memory-based key-value database with fast read and write speed, and is mostly used for data processing cache. It can be understood that the software service program installed and deployed on multiple computers ...

Embodiment 3

[0131] Corresponding to Embodiment 1 and Embodiment 2 of the present invention, Embodiment 3 of the present invention provides a distributed job scheduling apparatus. Figure 12 It is a schematic structural diagram of a job scheduling device in a job scheduling server according to Embodiment 3 of the present invention. Such as Figure 12 As shown, the job scheduling device of the job scheduling server in Embodiment 3 of the present invention includes a first receiving module 10, a issuing lock module 11, a cache module 12, a job scheduling module 13, a job scheduling lock module 14, a first acquiring module 15 and an example The server selection module 16 is executed.

[0132] Specifically, the first receiving module 10 is configured to receive the delivered job;

[0133] Issue lock module 11, after receiving the issued operation, be used for judging whether there is the issued lock of described operation; When the issued lock of described operation does not exist, the issue...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed job scheduling method and device and a distributed system.The distributed job scheduling method comprises the steps that when a server of the distributed system receives issued jobs and no issuing lock of the jobs exists in the server, the issuing lock of the jobs is set, and a first job instance is generated according to scheduling information; when the first job instance is triggered, a first job scheduling lock corresponding to the first job instance is set, the issuing lock is released after the first job scheduling lock is successfully set, and the first job instance is issued to the first execution server, so that the first job instance is issued to the first execution server before the first job instance is triggered. An issuing lock is utilized to ensure that job scheduling in the server is not executed by other servers in the distributed system; after the first job instance is triggered, a first job scheduling lock is utilized to ensure that job scheduling in the server is not executed by other servers in the distributed system; and meanwhile, job scheduling and instance scheduling are separated, so that the coupling of job scheduling and job instance scheduling execution is reduced.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a distributed job scheduling method, device and distributed system. Background technique [0002] With the rapid growth of current user volume, business volume, and data volume, software service functions and quantities also need to be expanded to meet various business needs. The traditional centralized system is a host with multiple terminals, and the terminals have no data processing capability and are only responsible for data input and output. The computing, storage, etc. are all performed on the host. Its biggest feature is that the deployment structure is very simple, and the bottom layer generally uses expensive mainframes purchased from manufacturers such as IBM and HP. Therefore, there is no need to consider how to deploy services on multiple nodes, nor does it need to consider the distributed collaboration between nodes. However, due to the single-machine d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5083
Inventor 李洪雷
Owner NEW H3C BIG DATA TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com