Distributed dispatching system and method

A scheduling system and scheduling method technology, applied in the computer field, can solve problems such as inability to meet user needs, low task processing efficiency, and information flow congestion.

Inactive Publication Date: 2018-11-16
BEIJING QIHOO TECH CO LTD
View PDF11 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this method, all scheduling tasks are completed by the central equipment, and the scheduling information of data processing tasks is centralized and summarized on the management node of the central equipment, resulting in congestion of information flow. If the management node fails, it will affect the data processing of the entire system tasks, in addition, the task processing efficiency of the current system is low and cannot meet user needs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed dispatching system and method
  • Distributed dispatching system and method
  • Distributed dispatching system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0062] In order to solve the above technical problems, an embodiment of the present invention provides a distributed scheduling system. figure 1 A schematic structural diagram of a distributed scheduling system according to an embodiment of the present invention is shown. see figure 1 , the distributed scheduling system of this embodiment includes a scheduling unit, an operating unit, and a storage unit. Wherein, the scheduling p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed dispatching system and method. The distributed dispatching system comprises a dispatching portion, an operation portion and a storage portion, wherein the dispatching portion comprises at least one dispatching unit, the operation portion comprises multiple operation units, the storage portion comprises at least one storage unit, and the dispatching units are used for extracting to-be-disposed tasks from a file system and dividing the to-be-disposed tasks into multiple subtasks, are also used for dispensing the multiple subtasks to the corresponding operation units and executing the corresponding subtasks by the operation units and are further used for recording record information in the subtask execution process and storing the record information in thestorage units. The single-point problem caused by the fact that a central device performs centralized task processing is solved, and when tasks fail or an execution device breaks down, other device nodes continue to perform execution, automatic multi-machine retrying of failed tasks is achieved, and timely and correct task operation is ensured. When other problems are caused in the task executionprocess, and an alarm notification can be also provided for a user through the system.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a distributed scheduling system and method. Background technique [0002] Heimdall is a massive data mining and analysis system with completely independent intellectual property rights, which can realize the mining and processing of massive data, and provide convenient and easy-to-use tools for data mining personnel and operational analysts to use. At present, when analysts use this system to query files, what they find is that the files are usually original logs, so the original logs need to be processed, processed, and analyzed again, which will undoubtedly increase the workload of analysts and is not conducive to improving analysis. The work efficiency of personnel, in order to provide convenience for analysts etc. at this time, it is necessary to directly realize further extraction and refinement of original logs in the Heimdall system. [0003] However, at present, when u...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48
CPCG06F9/4881
Inventor 王肖磊刘陟王志超
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products