Model training method, device, system, equipment, medium and program product
A model training and model technology, which is applied in the computer field, can solve problems such as low model training efficiency and communication bandwidth limitations, and achieve the effects of improving execution effects, accelerating model training, and improving training efficiency
Active Publication Date: 2022-07-08
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF14 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003]Currently, cross-cluster model training is limited by the communication bandwidth between clusters, and the efficiency of model training is low
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0046] Exemplary embodiments of the present application are described below with reference to the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.
[0047] Artificial intelligence is the study of making computers to simulate certain thinking processes and intelligent behaviors of people (such as learning, reasoning, thinking, planning, etc.), both hardware-level technology and software-level technology. AI hardware technologies generally include technologies such as sensors, dedicated AI chips, cloud computi...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a model training method, device, system and equipment, a medium and a program product, and relates to the technical field of computers, in particular to the technical field of artificial intelligence, natural language processing and deep learning. In some embodiments of the application, at least one first cluster trains a sample data set to obtain training data; the second cluster is used for training a training model according to the training data; a model for generating training data and a pre-training model are deployed on different clusters respectively, cross-cluster training is carried out on the models, only the training data need to be transmitted between the first cluster and the second cluster, model parameters do not need to be transmitted, cross-cluster training of the application can be met through low-broadband communication between the clusters, and the training efficiency is improved based on training tasks of different stages. And the training data generation task and the pre-training model training task are respectively placed in different processors, so that the hardware processing speed is increased, and the model training efficiency is improved.
Description
technical field [0001] The present application relates to the field of computer technology, in particular to the technical field of artificial intelligence, natural language processing, and deep learning, and in particular, to a model training method, apparatus, system, device, medium and program product. Background technique [0002] With the vigorous development of computer technology, artificial intelligence technology has also developed rapidly. Medicine, finance, education and other fields are inseparable from artificial intelligence technology. Natural language processing technology and deep learning technology have also gained more and more extensive use. [0003] Currently, cross-cluster model training is limited by the communication bandwidth between clusters, and the model training efficiency is low. SUMMARY OF THE INVENTION [0004] The present application provides a model training method, apparatus, system, device, medium and program product. [0005] Accordi...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/08G06N3/04G06K9/62G06F9/50
CPCG06N3/08G06F9/5027G06N3/044G06N3/045G06F18/214G06N3/098G06N3/0475G06N3/094
Inventor 王硕寰巩伟宝吴志华孙宇丁思宇韩雅倩赵晏彬刘雨昂于佃海
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD