Neural network structure searching method, device and equipment

A network structure and neural network technology, applied in the field of neural network structure search, can solve the problems of difficulty in the search process of neural network structure, difficult determination process, etc.

Pending Publication Date: 2020-05-08
NEUSOFT CORP
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, because the neural network structure is determined by a large number of hyperparameters, and the process of determ

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network structure searching method, device and equipment
  • Neural network structure searching method, device and equipment
  • Neural network structure searching method, device and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] In order to make the above objects, features and advantages of the present application more obvious and understandable, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0049] In the research on the search of the neural network structure, the inventor found that the search of the neural network structure can be realized by means of the current basic unit of the neural network. However, in this implementation method, it is necessary for technicians to provide structural hyperparameters such as the number of nodes in the basic unit of the neural network, the operation type of the nodes in the basic unit of the neural network, and the number of basic units of the neural network, so that the follow-up can be based on these structural hyperparameters The basic unit structure of the neural network is obtained by searching, and the neural network structure is b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a neural network structure searching method, device and equipment. After a set of hyper-parameters output by the hyper-parameter search model is obtained, structural hyper-parameters in the set of hyper-parameters are used for searching to obtain a current neural network basic unit structure, so that a first neural network model is established according tothe current neural network basic unit structure; the first neural network model is trained by using the training hyper-parameters in the group of hyper-parameters; and a second neural network model is generated, and the second neural network model is tested to obtain an evaluation result, so as to update the hyper-parameter search model based on the evaluation result and return to execute the step of obtaining a group of hyper-parameters output by the hyper-parameter search model again; and the search is repeated until a preset stop condition is reached, and the current second neural networkmodel is determined as the target neural network model. Therefore, the task execution effect of the neural network model can be effectively improved.

Description

technical field [0001] The present application relates to the technical field of automatic machine learning, in particular to a neural network structure search method, device and equipment. Background technique [0002] The neural network model is the preferred solution for realizing artificial intelligence. The construction process of the general neural network model can include: (1) preprocessing the training verification data set (wherein, the preprocessing can include data enhancement, data balance, data normalization, etc. processing means); (2) build the network structure of the neural network model (that is, determine the number of nodes in the neural network model, node operation type, and node connection relationship and other structural information); (3) use the training verification data set to analyze the neural network model Perform training and verification to obtain the final neural network model. [0003] Among them, because the network structure of the neur...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/08G06N3/045
Inventor 侯广健
Owner NEUSOFT CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap