Unlock instant, AI-driven research and patent intelligence for your innovation.

Resource scheduling method, information management method and device and task deployment system

A technology for deploying systems and resource managers, applied in the fields of information management methods and devices, task deployment systems, and resource scheduling methods, capable of solving problems such as reducing task processing delays

Active Publication Date: 2019-07-09
HUAWEI TECH CO LTD
View PDF14 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem in the prior art that a DC can only use local resources to perform tasks, an embodiment of the present invention provides a resource scheduling method, an information management method and device, and a task deployment system, so that a DC can use resources of other DCs to perform tasks. There is no need to synchronize data on other DCs to the local first, thereby reducing task processing delays

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource scheduling method, information management method and device and task deployment system
  • Resource scheduling method, information management method and device and task deployment system
  • Resource scheduling method, information management method and device and task deployment system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0062] figure 1 is a schematic structural diagram of a DC cluster provided by an embodiment of the present invention, see figure 1 , the DC cluster includes at least two DCs, figure 1 The illustrated DC cluster takes three DCs as an example for illustration, and may also include two DCs or more than four DCs in other embodiments.

[0063] like figure 1 As shown, each DC includes a resource manager (Resource Manager, RM) node 40 and a computing node 20 .

[0064] Computing nodes 20 are also called data nodes (DataNodes) or storage nodes. Computing nodes 20 are used to store data (files). A file may include multiple blocks, and multiple blocks may be stored on the same or different computing nodes 20 . At the same time, the com...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a resource scheduling method, an information management method and device and a task deployment system, and belongs to the technical field of big data. In the task deployment system, a computing node sends a position information request to a metadata server, and the position information request is used for requesting position information of data needing to be processed by atask to be executed by the computing node; a position information response returned by the metadata server is received, wherein the position information response comprises position information of data required to be processed by the to-be-executed task; a task deployment request is sent to a resource manager node, wherein the task deployment request comprises an identifier of the to-be-executed task, an identifier of a data center and an identifier of a computing node; and the resource manager node determines a data center for deploying the to-be-executed task according to the task deploymentrequest, thereby realizing cross-data-center task deployment.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a resource scheduling method, an information management method and device, and a task deployment system. Background technique [0002] In the industry, big data (big data) has multiple definitions, such as the definition given by the research institution Gartner: Big data requires a new processing model in order to have stronger decision-making power, insights and process optimization capabilities to adapt to massive, High growth rate and diverse information assets. Big data can be applied in a variety of scenarios, such as massively parallel processing databases, data mining grids, distributed file systems, distributed databases, cloud computing platforms, the Internet, and scalable storage systems, etc. The data is "processed" through technologies related to big data, thereby improving the application value of the data. [0003] With the rapid development of big d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4856G06F9/4881G06F9/5027
Inventor 瓦伦·萨克塞纳纳加奈拉西姆哈·拉梅什·加拉赵波
Owner HUAWEI TECH CO LTD