Super-network construction method and device, super-network use method and device and medium

A construction method and supernetwork technology, applied in neural learning methods, biological neural network models, neural architectures, etc., can solve problems such as low search speed and low evaluation efficiency, and achieve the effect of improving representation ability

Inactive Publication Date: 2019-11-22
BEIJING XIAOMI INTELLIGENT TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In neural network architecture search, multiple searches are required to generate a separate neural network and o

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Super-network construction method and device, super-network use method and device and medium
  • Super-network construction method and device, super-network use method and device and medium
  • Super-network construction method and device, super-network use method and device and medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0086] The exemplary embodiments will be described in detail here, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with this document. On the contrary, they are merely examples of devices and methods consistent with some aspects herein as detailed in the appended claims.

[0087] In order to obtain a richer sub-network structure through the super network, direct connection units are introduced into the super network to construct a variable depth network. Such as figure 2 As shown, a direct connection unit is set in the second layer of the super network, and the function of this direct connection unit is that output equals input. When this direct connection unit is...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a super-network construction method, a super-network use method, a super-network use device and a medium, and the construction method comprises the steps: setting a linear connection unit in at least one layer of a super-network, the input end of the linear connection unit being connected to the upper layer of an affiliation layer of the linear connection unit, and the output end of the linear connection unit being connected to the lower layer of the affiliation layer; wherein the output and the input of the linear connection unit form a linear relationship, and the linear relationship comprises a linear relationship except that the output is equal to the input. According to the method, the linear connection unit is used in the super network, and compared with a direct connection unit, the characterization capability of the sub-network can be effectively improved, the stability of the network indexes of the sub-network comprising the linear connection unit in the super network is maintained, and the network indexes of the sub-network are prevented from being rapidly reduced in the deep adjustment process.

Description

technical field [0001] This article relates to the technical field of data processing, and in particular relates to a hypernetwork construction method, usage method, device and medium. Background technique [0002] Neural Architecture Search (NAS) is a technology for automatically designing neural networks, which can automatically design high-performance network structures based on sample sets through algorithms. In neural network architecture search, multiple searches are required to generate a separate neural network and obtain network indicators after training, which has the problems of low evaluation efficiency and low search speed. To solve this problem, some NAS methods use a hypernetwork that contains all search networks. Such as figure 1 In the structure of an exemplary supernet (supernet) shown, the supernetwork contains a plurality of layers, and each layer contains a plurality of network units, and a network unit is selected from each layer to connect sequential...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/08G06N3/044G06N3/045G06N3/082G06N3/04G06F18/2148
Inventor 初祥祥许瑞军张勃李吉祥李庆源王斌
Owner BEIJING XIAOMI INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap