Data processing method and device and electronic equipment
A technology for data processing and training equipment, applied in the computer field
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
no. 1 example
[0083] The first embodiment of the present application provides a data processing method, which is combined below figure 1 Be explained.
[0084] Please refer to figure 1 , which is a flowchart of the data processing method provided by the first embodiment of the application.
[0085] The data processing method of the embodiment of the present application includes the following steps:
[0086] Step S101: Determine available training resources and initial training parameters for training the neural network model.
[0087] Determining available training resources for training the neural network model may be determining available training resources for each of the training devices used for training the neural network model. As a way of determining the available training resources of each training device in the training devices used for training the neural network model, it may refer to: first, determining the network topology diagram of the training device used for training ...
Embodiment approach
[0088] In this embodiment, as an implementation manner of determining the network topology diagram of the training equipment used for training the neural network model: the training equipment in the system is used as a node, and the communication bandwidth between the training equipment is used as the part of the nodes. The weights of the intermediate edges determine the network topology of the training equipment used to train the neural network model.
[0089] In this embodiment, as an implementation manner of using the minimum cut recursive sorting algorithm to analyze the network topology diagram to obtain the ordering of multiple training devices in the network topology diagram: judging whether there is only one node in the network topology diagram , if not, use the minimum cut recursive sorting algorithm to analyze the network topology diagram, and obtain the ordering of multiple training devices in the network topology diagram.
[0090] The ranking of multiple training d...
no. 2 example
[0170] Corresponding to the data processing provided by the first embodiment of the present application, the second embodiment of the present application further provides a data processing apparatus. Since the apparatus embodiment is basically similar to the first embodiment, the description is relatively simple, and reference may be made to the partial description of the first embodiment for related parts. The apparatus embodiments described below are merely illustrative.
[0171] Please refer to figure 2 , which is a schematic diagram of the data processing apparatus provided by the second embodiment of the present application.
[0172] The data processing device includes:
[0173] Resource and parameter determination unit 201, used for determining available training resources and initial training parameters for training the neural network model;
[0174] an initial segmentation unit 202, configured to perform initial segmentation on the neural network model according to...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More