Resource assessment method and device, computer equipment and storage medium

A computer program and resource technology, applied in the field of big data, can solve problems such as inaccurate evaluation methods, inability to quantitatively analyze and evaluate the usage of the entire queue or the entire cluster, etc.

Active Publication Date: 2019-05-24
亚信科技(中国)有限公司
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the traditional method, for the resource usage of big data clusters, it is often only possible to analyze and evaluate the resource usage of a single job, and cannot effectively conduct quantitative analysis and evaluation on the usage of the entire queue or the entire cluster, and the evaluation method is not accurate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource assessment method and device, computer equipment and storage medium
  • Resource assessment method and device, computer equipment and storage medium
  • Resource assessment method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0164] As an optional implementation manner, the resource evaluation device further includes: a second input module and an iteration module, specifically:

[0165] The second input module is used to input the measured cluster index information in the fourth preset period into the initial deep learning model;

[0166] The iteration module is used to iteratively execute the forward derivation and backpropagation algorithm of the initial deep learning model to obtain the deep learning model.

[0167] For the specific limitations of the resource evaluation device, refer to the above-mentioned definition of the resource evaluation method, which will not be repeated here. Each module in the above-mentioned resource evaluation device can be fully or partially realized by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a resource assessment method and system, computer equipment and a storage medium. The method comprises the following steps: obtaining cluster index information to be evaluated, determining cluster job average delay and a cluster resource utilization rate according to the to-be-evaluated cluster index information; according to the cluster index information to be evaluated,trunking operation average delay and trunking resource utilization rate are increased; determining a queue operation average delay standard deviation and a queue resource utilization rate standard deviation; According to at least one of the cluster job average delay, the cluster resource utilization rate, the queue job average delay standard deviation and the queue resource utilization rate standard deviation, resource assessment is carried out, so that quantitative analysis on the use condition of the whole queue or the whole cluster is realized, and the assessment method is more accurate.

Description

technical field [0001] The present application relates to the technical field of big data, in particular to a resource evaluation method, device, computer equipment and storage medium. Background technique [0002] In the field of big data processing, with the increase of data and servers in the data center, there are higher requirements for the allocation of data and resources. Due to the increase in cluster size and the increase in program resource utilization requirements, the ability to monitor the cluster status in real time and provide timely feedback on the cluster and running jobs will greatly affect the overall functions and jobs of the entire big data platform. efficiency. [0003] In the traditional method, for the resource usage of big data clusters, it is often only possible to analyze and evaluate the resource usage of a single job, and cannot effectively conduct quantitative analysis and evaluation of the usage of the entire queue or the entire cluster, and t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/06
Inventor 王庚马松杨光明子张百军
Owner 亚信科技(中国)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products