A tenant priority management method and system for a multi-tenant big data platform

A technology of a big data platform and management method, applied in the field of tenant priority management method and system of a multi-tenant big data platform, to achieve the effects of ensuring reliability, fast learning convergence speed, and good generalization ability

Pending Publication Date: 2019-05-21
SOUTH CHINA UNIV OF TECH
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Compared with the traditional multi-tenant big data platform resource allocation strategy, the method propos

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A tenant priority management method and system for a multi-tenant big data platform
  • A tenant priority management method and system for a multi-tenant big data platform
  • A tenant priority management method and system for a multi-tenant big data platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] A tenant priority management method of a multi-tenant big data platform based on a radial basis neural network is realized by building a tenant priority manager on the big data platform. The function of the tenant priority manager is mainly to generate priority judgment documents to assist the system administrator in making priority judgments, and to collect unallocated resource requests outside the cluster, so that the resource manager that comes with the big data platform can focus on resource allocation. The allocation and scheduling of resources within tenants reduces the risk of cluster downtime to a certain extent. Among them, the tenant priority manager includes two components: radial basis function neural network and resource request waiting queue.

[0058] Among them, such as Figure 4 A radial basis neural network model is shown. This module assists in the generation of priority judgment documents by calculating the complex nonlinear relationship between tena...

Embodiment 2

[0075] Apply the present invention to the multi-tenant system based on the Hadoop big data platform to realize a tenant priority management method of the multi-tenant big data platform based on radial basis neural network.

[0076] Such as figure 1Shown is the working schematic diagram of the present invention. The tenant priority manager constructed by the present invention is a functional component located between the Hadoop big data platform and the system administrator. The tenant priority manager has the function of collecting some resource request information of the big data platform. By default, the resource request waiting queue in the tenant priority manager will allocate resources for blocked resource requests according to the FIFO policy. When a tenant needs to increase the priority of its resource request in order to allocate resources in time, the tenant priority manager will calculate the priority information of the tenant's related jobs to generate a judgment ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a tenant priority management method for a multi-tenant big data platform, and the method comprises the following steps: a tenant priority manager which consists of a resource request waiting queue and a radial basis neural network is initialized; When the cluster load is light, the resource request of each tenant can be met, and at the moment, the tenant priority manager isnot started; When the resource request of the tenant cannot be met, the resource request of the tenant is collected through a tenant priority manager and corresponding information is put into a resource request waiting queue; If the tenant needs to improve the resource request priority, an application is sent to the tenant priority manager, the tenant priority manager calls the radial basis neural network to calculate the tenant resource request priority, and then a judgment document is generated and sent to the system administrator for auxiliary judgment. Compared with a traditional resourceallocation strategy of the multi-tenant big data platform, the method can effectively overcome the defect of tenant priority processing of the multi-tenant big data platform.

Description

technical field [0001] The present invention relates to the field of big data platforms, in particular to a tenant priority management method and system of a multi-tenant big data platform. Background technique [0002] Today, big data platform technology has been applied to all aspects of large and small enterprises. More and more enterprises have built their own big data platforms to run big data applications within the enterprise. Traditionally, each department uses its own private cluster to meet computing or storage needs on a traditional big data platform within an enterprise. This will bring three challenges: first, the overall resource utilization of the cluster is poor; second, the enterprise The administrator has a heavy burden on the management of the entire cluster; third, the data sharing among various departments will become more complicated. [0003] Faced with the above three problems, the multi-tenant technology for Hadoop big data platform came into being...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50G06Q30/06
CPCY02D10/00
Inventor 林伟伟李毓睿
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap