Model training method, device and equipment based on pipeline parallelism
A model training and assembly line technology, applied in the field of machine learning, to achieve the effect of improving parallelism, ensuring training effect, and improving equipment utilization
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Example Embodiment
[0049] Embodiments of this specification provide a model training method, apparatus, apparatus, and storage medium based on pipeline parallel.
[0050] In order to better understand the technical solution in the present specification, the technical solutions in the present specification are clear and completely described below in conjunction with the drawings in the present specification. The embodiment is merely the embodiment of the present application, not all of the embodiments. Based on the present specification, one of ordinary skill in the art shall belong to the scope of the claims of the present application without the pre-creative labor premise.
[0051]In one or more embodiments of the present specification, the workfare means that the device, process, etc. for performing model training, etc., generally a single worker (can be referred to as a worker), or a working machine composed of a plurality of workers. Cluster (can be called Stage), etc. The model is parallel, and...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap