Artificial intelligence model training method, device and equipment and storage medium

A technology of artificial intelligence and training methods, applied in computing models, neural learning methods, biological neural network models, etc., can solve problems such as hardware resource conflicts, system resource management, affecting the training efficiency of AI models, etc., to avoid resource conflicts, improve The effect of training efficiency

Pending Publication Date: 2020-10-13
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current AI model training methods do not effectively manage system resources, resulting in conflicts in hardware resources such as CPU, memory, disk, IO, and bandwidth when training different AI models. Affected the training efficiency of the AI ​​model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Artificial intelligence model training method, device and equipment and storage medium
  • Artificial intelligence model training method, device and equipment and storage medium
  • Artificial intelligence model training method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to more clearly understand the above objects, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0025] In the following description, many specific details are set forth in order to fully understand the present disclosure, but the present disclosure can also be implemented in other ways than described here; obviously, the embodiments in the description are only some of the embodiments of the present disclosure, and Not all examples.

[0026] Since the training efficiency of artificial intelligence AI models affects the implementation efficiency of AI solutions in practical application scenarios, how to improve the training efficiency of AI models is an urgent problem to be solved at present.

[0027] In the actual AI model tr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an artificial intelligence model training method and device, equipment and a storage medium. The method comprises the steps: determining a training task of a to-be-trained artificial intelligence AI model and resource demand information corresponding to the training task; based on the current resource idle information of each node, allocating a node meeting the resource demand information corresponding to the training task to the training task to serve as a training node of the training task; and scheduling the training node to execute the training task so as to complete training of the to-be-trained AI model. The nodes capable of meeting the training requirements of the AI model are allocated to the AI model before the AI model is trained, so that resource conflicts can be avoided in the training process of the AI model, and the training efficiency of the AI model is improved.

Description

technical field [0001] The present disclosure relates to the technical field of artificial intelligence, and in particular to an artificial intelligence model training method, device, equipment, and storage medium. Background technique [0002] With the rapid development of artificial intelligence (English: Artificial Intelligence; AI for short) and deep learning technology, it is particularly important to accelerate the implementation of artificial intelligence solutions in practical application scenarios. Rapid training and deployment of AI models is a critical step in the implementation of AI solutions. [0003] Therefore, in order to improve the training efficiency of the AI ​​model, it is necessary to meet the demand for system resources during the model training process. However, the current AI model training methods do not effectively manage system resources, resulting in conflicts in hardware resources such as CPU, memory, disk, IO, and bandwidth when training diffe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N20/00G06N3/08
CPCG06N3/08G06N20/00
Inventor 王森
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products