Cluster resource scheduling method and device, computer equipment and storage medium

A resource scheduling and computer technology, applied in the field of artificial intelligence, can solve the problem of low utilization of cluster resources

Pending Publication Date: 2021-02-05
CHINA PING AN PROPERTY INSURANCE CO LTD
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] This application provides a cluster resource scheduling method, device, computer equipment and storage media to solve the problem of low utilization of cluster resources in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cluster resource scheduling method and device, computer equipment and storage medium
  • Cluster resource scheduling method and device, computer equipment and storage medium
  • Cluster resource scheduling method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field of the application; the terms used herein in the description of the application are only to describe specific embodiments The purpose is not to limit the present application; the terms "comprising" and "having" and any variations thereof in the specification and claims of the present application and the description of the above drawings are intended to cover non-exclusive inclusion. The terms "first" and "second" in the specification and claims of the present application or the above drawings are used to distinguish different objects, rather than to describe a specific order.

[0051] Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrences of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an artificial intelligence technology, and discloses a cluster resource scheduling method and device, computer equipment and a storage medium. The method comprises the steps of receiving a task and priority setting instruction, conducting statement analysis on the tasks, and calculating task resource requirements based on the knowledge graph, based on the task and the taskresource demand, predicting a task execution time length and a calculation resource occupation proportion in a preset time period by utilizing a prediction model, judging the task according to the task execution duration, the computing resource occupation proportion in the preset time period and the priority setting instruction, when the judgment result is an emergency task and a small task, inputting the emergency task and the small task into a computing resource configuration queue, when the judgment result is a big task, determining a computing resource configuration scheme of the big taskby utilizing an operational research algorithm, configuring computing resources by utilizing the configuration scheme, and inputting the computing resources into a computing resource configuration queue, and scheduling the cluster resources according to the computing resource configuration queue. The utilization rate of cluster resources can be improved.

Description

technical field [0001] The present application relates to the technical field of artificial intelligence, and in particular to a cluster resource scheduling method, device, computer equipment and storage medium. Background technique [0002] At present, the cluster big data platform is widely used by various companies. As the scale of each company continues to expand, the data generated by it continues to increase; the traditional data platform relies on the management and intervention of experienced data administrators, but with the expansion of the data platform , it is difficult for data administrators to know the information of the overall data platform, and it is difficult to intervene effectively to maximize resource utilization. In the prior art, the data platform processes the input development tasks directly by queuing up one by one, that is, first-in-first-out or fair allocation of resources; it does not process the tasks in other aspects. The implementation of th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50G06F9/48G06F9/54G06N5/02G06N3/04
CPCG06F9/4881G06F9/5038G06F9/5066G06F9/546G06F2209/484G06F2209/5021G06F2209/548G06N3/049G06N5/02
Inventor 曾伟张旭郑越旷雄方聪
Owner CHINA PING AN PROPERTY INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap