Cluster resource processing method and system, and resource processing cluster

A resource processing and clustering technology, applied in the computer field, can solve problems such as inflexible deployment of cluster servers, affecting enterprise deployment services, unfavorable server node deployment, etc., and achieve the effects of improving throughput, improving utilization rate, and flexible and efficient allocation

Active Publication Date: 2017-05-24
TENCENT TECH (SHENZHEN) CO LTD
View PDF6 Cites 37 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the traditional cluster resource processing method, when managing container resources, it is often necessary to update the kernel or apply for administrator privileges of the operating system. Updating the kernel will affect the services currently deployed by the enterprise, or it is necessary to apply for administrator privileges from the operation and maintenance personnel. It is beneficial to add server nodes for related deployment, resulting in inflexible deployment of cluster servers, and the average utilization rate is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cluster resource processing method and system, and resource processing cluster
  • Cluster resource processing method and system, and resource processing cluster
  • Cluster resource processing method and system, and resource processing cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] figure 1 It is an application environment diagram for the operation of the cluster resource processing method in one embodiment. Such as figure 1 As shown, the application environment includes a job submission terminal 110, a resource management server 120, a computing node 130, and a dedicated node 140, wherein the computing node 130 includes a plurality of nodes, including a node 131, ... node 13n, and the dedicated node 140 can be one or Multiple, wherein the job submission terminal 110, the resource management server 120, the computing node 130 and the dedicated node 140 form a cluster, which can communicate through the network, which can be a Hadoop cluster or a Spark cluster.

[0035] The job submission terminal 110 can be a notebook computer, a desktop computer, etc., but is not limited thereto. The number of computing nodes 130 is updated according to the computing resources occupied by the external load of the nodes. Each cluster node has a monitoring module ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a cluster resource processing method and system, and a resource processing cluster. The cluster resource processing method comprises the following steps that: monitoring node calculation resource information, and obtaining current idle calculation resources according to the node calculation resource information; receiving an operation request which carries resource configuration information, wherein the resource configuration information comprises a node label; according to the node label, obtaining a corresponding node queue, and distributing target calculation resources to the operation in the current idle calculation resources of the node in the node queue according to the resource configuration information; and on the node corresponding to the target calculation resources, starting a (User Mode Linux) resource isolation container, and executing the operation in a user space. A cluster use ratio can be improved, and operation throughput in the cluster can be improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a cluster resource processing method and system, and a resource processing cluster. Background technique [0002] A cluster is a group of independent computers interconnected by a high-speed network that form a group and are managed as a single system. The servers in the cluster work together to provide users with network application services. For users, the cluster is like a single system. For example, an enterprise purchases or rents a dedicated computer and uses a Linux-like operating system to provide access services to user groups. [0003] In the traditional cluster resource processing method, when managing container resources, it is often necessary to update the kernel or apply for administrator privileges of the operating system. Updating the kernel will affect the services currently deployed by the enterprise, or it is necessary to apply for administrator privileges f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5083
Inventor 唐祥豪
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap