Resource dynamic adjustment method and device, equipment and storage medium

A dynamic adjustment and resource technology, applied in the field of training resource adjustment, can solve problems such as long training time and unreasonable use of resources, and achieve the effect of achieving reasonable application and reducing training time

Inactive Publication Date: 2019-11-26
GUANGDONG INSPUR BIG DATA RES CO LTD
View PDF4 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when using container technology to perform deep learning training tasks, each resource is preset and cannot be changed during the training process. Therefore, when the training model is complex or the training data scale is large, failures due to unreasonable use of resources may occur. The problem of excessive training time caused by

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource dynamic adjustment method and device, equipment and storage medium
  • Resource dynamic adjustment method and device, equipment and storage medium
  • Resource dynamic adjustment method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0042] The embodiment of the present invention discloses a resource dynamic adjustment method, device, equipment and computer-readable storage medium based on Kubernetes clusters, so as to realize reasonable application of cluster resources and reduce the execution time of training tasks.

[0043] see figure 1 A method for dynamically adjusting resources based on a Kubernetes cluster provided by an embodiment of the present invention includes:

[0044] S101. Obtai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a resource dynamic adjustment method, device and equipment based on a Kubernetes cluster and a computer readable storage medium. In the present application, in the training process of a training task, according to the embodiment of the invention, the adjustment information can be generated according to the idle resource information of the cluster and the current resource use information of each training task, so as to recreate the container group of the training tasks through the adjustment information, thereby achieving the dynamic adjustment of the use resources of the training tasks, achieving the reasonable application of cluster resources, and greatly reducing the training time.

Description

technical field [0001] The present invention relates to the technical field of training resource adjustment, and more specifically, relates to a method, device, device and computer-readable storage medium for dynamically adjusting resources based on Kubernetes clusters. Background technique [0002] When performing deep learning training tasks, container technology can currently be used to perform deep learning training tasks. This method is a fast and effective training method that eliminates some system configuration and environment dependencies for users. In addition, Kubernetes (container cluster management technology) to manage containers, enabling containerized training for large-scale tasks. However, when using container technology to perform deep learning training tasks, each resource is preset and cannot be changed during the training process. Therefore, when the training model is complex or the training data scale is large, failures due to unreasonable use of resou...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5005G06F9/5016G06F9/5027
Inventor 王超
Owner GUANGDONG INSPUR BIG DATA RES CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap