A structure searching method and device of a depth neural network

A deep neural network and neural network technology, applied in neural learning methods, biological neural network models, neural architectures, etc., can solve the problems of cumbersome, slow process, large search time and large amount of calculation, etc.

Inactive Publication Date: 2019-01-29
BEIJING TUSEN WEILAI TECH CO LTD
View PDF0 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a deep neural network structure search method and device to solve the problem that th

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A structure searching method and device of a depth neural network
  • A structure searching method and device of a depth neural network
  • A structure searching method and device of a depth neural network

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0032] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0033] To facilitate the understanding of the present invention, the technical terms involved in the present invention are explained below:

[0034] DNN: Deep Neural Network (Deep Neural Network).

[0035] Computing unit: A unit node in a neural network used for calculations such as convolution and pooling.

[0036] Network structure search: The process of searching for the optimal network structure in a neural network.

[0037] In the process...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a structure searching method and device of a depth neural network, which relates to the technical field of artificial intelligence. The method comprises the following steps: obtaining a computing unit structure of each layer in each module serially serially connected in a depth neural network in a preset search space; the preset connection mode is adopted in each module to connect each computing unit to obtain the information flow in each module. According to the connection of the module and the computing unit in each module, the initial neural network is obtained. A sparse scaling operator is set up for the information flow in the initial neural network, in which the sparse scaling operator is used to scale the information flow. The preset training sample data is used to train the weights of the initial neural network and the sparse scaling operator of the information flow, and the intermediate neural network is obtained. The sparse scaling operator in the intermediate neural network is deleted to obtain the search result neural network in the search space. The invention can save the searching time of the network structure.

Description

technical field [0001] The invention relates to the technical field of artificial intelligence, in particular to a structure search method and device of a deep neural network. Background technique [0002] In recent years, deep neural networks have achieved great success in many fields, such as computer vision and natural language processing. Deep neural networks transform traditional hand-designed features into end-to-end learning through powerful representation capabilities. However, the structure of the current deep neural network is complicated, and there are many computing unit nodes such as convolution and pooling, so how to search for a model structure with a compact structure, fast running speed, and good effect in many computing unit nodes has become a problem. difficulty. [0003] At present, the prior art generally adopts to define a search space first, and then search for an optimal network structure in the search space. Generally, the heuristic method of netw...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/082G06N3/045
Inventor 黄泽昊张新邦王乃岩
Owner BEIJING TUSEN WEILAI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap