Dispatching method and system of distributed system

A technology of distributed system and scheduling method, applied in the field of scheduling method and system of distributed system, can solve problems such as resource waste and waste, and achieve the effects of avoiding resource waste, improving processing speed, and reducing network overhead.

Active Publication Date: 2010-06-23
CHINA MOBILE SUZHOU SOFTWARE TECH CO LTD +2
View PDF0 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] The first purpose of the present invention is to propose a scheduling method for a distributed system to avoid waste of resources in view of defects such as waste of resources in the distributed scheduling method of the prior art
[...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dispatching method and system of distributed system
  • Dispatching method and system of distributed system
  • Dispatching method and system of distributed system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] According to an embodiment of the present invention, a scheduling method for a distributed system is provided, image 3 It is a flowchart of a scheduling method for a distributed system according to an embodiment of the present invention, such as image 3 As shown, this embodiment includes:

[0053] Step S102: the data scheduler receives a scheduling request, the scheduling request includes a read operation of data, wherein the data is stored in at least one entity providing data services in the distributed system;

[0054] Step S104: The data scheduler determines the status of each data service corresponding to the scheduling request, and the status information in this embodiment includes: read, write, idle;

[0055] Step S105: Judging whether it is in an idle or reading state, if yes, execute step S106, otherwise execute step S107;

[0056] Step S106: Send a scheduling response agreeing to read each data service; each data service is at least one same data service, ...

Embodiment 2

[0060] Figure 4 It is a schematic diagram for analyzing the scheduling method of the distributed system according to Embodiment 2 of the present invention, such as Figure 4 As shown, this embodiment takes the file scheduler as a data scheduler and the distributed environment system as an example for description. The system includes a task scheduler and a file scheduler, and node 1 stores files CF1 (including CF1.1, CF1.2 two parts), node 2 and node 3 save the backup of the file, that is, each file has 3 copies (the master-slave backup can not be distinguished), which are stored on node 1, node 2 and node 3 respectively, and 3 copies The status information of the replica's data service needs to be consistent, that is, the status of the data service includes: read, write, and idle.

[0061] Assuming that the task scheduler receives a scheduling request for a task (also called an application) and needs to schedule a file CF1 (including CF1.1 and CF1.2), it sends the scheduling...

Embodiment 3

[0072] Figure 5 It is a flow chart of the dispatching method of the distributed system according to Embodiment 3 of the present invention. In this embodiment, the data scheduler includes a small table scheduler and a file scheduler, and the distributed environment system has a three-layer data structure as an example. The system includes task scheduler, small table scheduler, file scheduler, such as Figure 5 As shown, this embodiment includes:

[0073] Step S202: After receiving the task, the task scheduler determines the operation type of the task and the data service corresponding to the task, such as the name of the small table for input and output, whether it is a read or write operation, etc., and sends the scheduling request to the small table scheduler;

[0074] Step S204: After receiving the scheduling request, the small table scheduler determines the small table where each data service corresponding to the scheduling request is located. If the small table scheduler...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dispatching method and a system of a distributed system. The method comprises the following steps: a dispatching request comprising data reading operation is received by a data dispatcher, and data is stored in at least one entity providing data service in the distributed system; status of each data service corresponding to the dispatching request is determined by the data dispatcher, dispatching response consenting to conduct reading operation on each data service is sent by the data dispatcher when each data service is in an idle/reading status; and each data service is at least one same data service. The invention can effectively solve the defects of resource waste, low task processing efficiency and the like in the distributed dispatching method in the prior art, realizes reasonable resource utilization, and improves task processing efficiency.

Description

technical field [0001] The present invention relates to data service technology in the computer field, in particular to a scheduling method and system for a distributed system. Background technique [0002] Task scheduling is a key issue in Grid Computing, Distributed Database System, and Cloud Computing systems. In traditional grid computing, the cost of task scheduling is high, and the scheduling strategy is to migrate data to the computing node where the task is located. In distributed database systems and cloud computing systems, the cost of data migration is high, and most of them adopt the scheduling strategy of assigning tasks to the nodes where the data resides. [0003] Distributed environment systems, such as cloud computing systems, are characterized by: distributed storage and access of massive data; used in occasions where data is stored once and queried multiple times. figure 1 It is a schematic diagram of the layered structure of the cloud computing system i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08H04L29/06
Inventor 钱岭郭磊涛赵鹏徐萌罗治国
Owner CHINA MOBILE SUZHOU SOFTWARE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap