Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Task training method and device, equipment and storage medium

A training method and task technology, applied in the direction of program control device, program control design, instrument, etc., can solve the problems of inability to guarantee the normal operation of training tasks, waste of resources, etc., achieve the effect of realizing high-performance network card multiplexing and improving training efficiency

Pending Publication Date: 2022-06-21
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, for the Roce network card and Infiniband network card in the AI ​​server, due to the situation that the bond cannot be performed and the resources are wasted, two high-performance network cards are generally not bonded. When the high-performance network card is abnormal, the normal operation of the training task cannot be guaranteed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task training method and device, equipment and storage medium
  • Task training method and device, equipment and storage medium
  • Task training method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0041] In the prior art, the Roce NIC and Infiniband NIC in the AI ​​server cannot be bonded and resources are wasted. Generally, two high-performance NICs are not bonded. When the high-performance NIC is abnormal, the normal operation of the training task cannot be guaranteed. In view of the above-mentioned technical defects, the present application provides a task training scheme, which can reasonably allocate high-performance networ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a task training method and device, equipment and a storage medium, and the method comprises the steps: carrying out the virtualization processing of a plurality of physical network cards of an artificial intelligence server, so as to obtain a plurality of virtual network cards; wherein a virtual relationship exists between each physical network card and the corresponding virtual network card; all the virtual network cards are grouped, so that different resource groups are obtained; wherein the virtual relationship between the virtual network card and the physical network card in each resource group is not repeated; and providing network resources for a target task on the artificial intelligence server by using the virtual network card in a target resource group so as to train the target task. In the training process, when any network card in the resource group is abnormal, other network cards without abnormity in the resource group can be utilized to continuously provide network resources, so that high-performance network cards are reasonably allocated to the training task, high-performance network card multiplexing is realized, and the task training efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of artificial intelligence, in particular to a task training method, device, equipment and storage medium. Background technique [0002] In artificial intelligence (AI, Artificial Intelligence) training scenarios, there will be a large amount of data transmission, which is limited by the traditional operating system's mechanism for receiving and sending network data packets, which cannot meet the training tasks of downloading large data sets and transferring large amounts of training parameters. For this reason, a large number of AI training platforms have gradually begun to support high-performance networks, such as Infiniband and Roce. In the prior art, when an AI server has multiple GPU cards, in order to obtain the best training effect, sometimes a single AI server is equipped with 2, 4, or 8 ROCE network cards or Infiniband network cards. For traditional CPU servers, in order to ensure the stability an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/455H04L12/02
CPCG06F9/45558H04L12/02G06F2009/45562G06F2009/45595
Inventor 王德奎陈培
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More