Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Resource Management Method for Big Data Framework Processing Tasks

A technology for processing tasks and resource management, which is applied in the field of resource management of big data framework processing tasks, can solve the problems of idle available resources, the inability to know the utilization rate of system resources, and increase the cost of server operation and maintenance, so as to reduce idle waste and improve Operational efficiency and workload reduction effects

Active Publication Date: 2021-10-29
福建星瑞格软件有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If the resource management system does not grasp the utilization of server resources, it will not be able to know the utilization rate of system resources, which resources are idle, and which resources have been separated from the management of the system and become zombie resources, resulting in a large number of The available resources are idle and manual intervention is required, which greatly increases the operation and maintenance costs of the server

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Resource Management Method for Big Data Framework Processing Tasks

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] Please refer to figure 1 As shown, a preferred embodiment of the resource management method of the big data frame processing task of the present invention includes the following steps:

[0028] Step S10, the resource management system creates a resource estimation table, collects server resource information from each server, and stores the resource estimation table and server resource information in the storage system; The task of applying for the number of resources is used to estimate the number of resource requirements to improve the operating efficiency of the system;

[0029] Step S20, the application end applies for server resources from the resource management system, and if the application quantity is specified, proceed to step S30; if the application quantity is not specified, proceed to step S60;

[0030] Step S30, the resource management system registers the application-side resource application flow information, and judges based on the flow information and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a resource management method for large data frame processing tasks, including the following steps: Step S1, storing server resource information in a storage system; Step S2, applying for server resources from the resource management system at the application end; Step S3, resource management The system judges whether the resource can meet the requirements of the application, and if so, allocates the resource; if not, adds the task to the waiting queue, and allocates the resource according to the set rules. The invention has the advantages of: effectively managing and dispatching server resources of the enterprise, reducing waste of resources; automatically allocating resources by the resource management system, reducing the workload of manual intervention, and improving the efficiency of operation and maintenance.

Description

technical field [0001] The invention relates to a resource management method, in particular to a resource management method for processing tasks of a big data framework. Background technique [0002] With the advancement of technology and the development of business, many enterprises need hundreds of servers to meet business needs. However, when these servers perform big data tasks, how to manage and effectively utilize server resources has become an urgent problem to be solved. If the resource management system does not grasp the utilization of server resources, it will not be able to know the utilization rate of system resources, which resources are in an idle state, and which resources have been separated from the management of the system and become zombie resources, resulting in a large number of The available resources are idle and manual intervention is required, which greatly increases the operation and maintenance cost of the server. Therefore, it is very important...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50
CPCG06F9/5005G06F2209/504
Inventor 林传文
Owner 福建星瑞格软件有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products