Method for accelerating neural network structure selection
A technology of network structure and neural acceleration, applied in the field of neural network, can solve problems such as poor performance and wrong structure of neural network, and achieve the effects of low cost, accelerated selection, and avoiding the number of training times
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Examples
Embodiment 1
[0044] This embodiment provides a method for accelerating the selection of neural network structures, in which there are t neural network structures to be selected, which are respectively denoted as C 1 ,C 2 ,...,C t ; The currently usable stand-alone computer is equipped with g graphics cards, denoted as X 1 ,X 2 ,...,X g The number of training data is N, the batch size of training is n, N>n, the number of rounds of training is T, and described method comprises the steps:
[0045] S1: Multi-thread programming is adopted to start a main thread M. In this embodiment, any existing programming language can be selected for programming;
[0046] S2: The main thread M judges whether there is a file named global.txt for recording the performance of each neural network structure under the current folder. If it exists, execute S3; if it does not exist, create a new global.txt file; In the global.txt file, each line records the name of a neural network structure and its correspondi...
Embodiment 2
[0055] This embodiment is further optimized on the basis of Embodiment 1, specifically:
[0056] In the S6, the child thread will C i put in X j training, including the following steps:
[0057] S6.1: Initialize C randomly i The weight of , the initialization method adopted is the currently commonly used method, such as the Xavier method;
[0058] S6.2: Randomly select n training data from N training data, for C i Train and update C using gradient descent i After weighting, proceed to the next training and repeat the training T*N / n times;
[0059] S6.3: After the training is completed, use the verification data to C i Carry out performance verification, get the verification result, if the verification result is 50%, then C i The performance is "C i =50%", in this embodiment, if the verification data is provided in the current data, it will be used directly, otherwise a part of the data is randomly selected from the training data as the verification data in advance, usi...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com