Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Hierarchical network structure search method, device and readable storage medium

A technology of network structure and search method, applied in biological neural network models, neural architectures, instruments, etc., can solve problems such as inability to determine network structure, search epoch collapse, and no parameters.

Active Publication Date: 2020-10-30
SHANGHAI JIAO TONG UNIV
View PDF3 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Secondly, the existing search method based on the DARTS search space will collapse due to the excessive number of search epochs when searching the network. This collapse phenomenon is reflected in the fact that the final structure becomes a fully connected neural network without parameters. Completely incompetent on image classification tasks
And this collapse phenomenon also makes when the network structure search is directly used for image classification or other downstream tasks, because it is impossible to determine when the network structure converges, resulting in insufficient performance of downstream tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hierarchical network structure search method, device and readable storage medium
  • Hierarchical network structure search method, device and readable storage medium
  • Hierarchical network structure search method, device and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0066] figure 1 It is a module principle diagram of the search method in an embodiment of the present invention, which shows the relationship between the network update module, the structure update module, the structure reservation module and the downstream task processing module.

[0067] refer to figure 1 As shown, in one embodiment of the present invention, the hierarchical network structure search method for image processing includes the following steps:

[0068] S1, using basic units to bui...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a hierarchical network structure search method, a device and a readable storage medium. The method comprises the steps of S1, constructing a super network; S2, acquiring image data and taking the image data as training data of network parameters and structure parameters of the super network; S3, generating a feature map, calculating a cross entropy loss function of the network parameters, and updating the network parameters of the super network; S4, generating a feature map and a KL divergence loss function, calculating a cross entropy loss function of the structure parameters to obtain a semi-implicit variational discard loss function, training and updating the structure parameters of the super network and obtaining a discard probability; s5, updating the basic unitby using the discard probability, and updating the annealing parameter; s3 to S5 are repeated, and the network parameters and the structure parameters are updated; s6, obtaining a final network. Themethod greatly reduces the search time and reduces the calculation complexity while guaranteeing the higher performance, guarantees the search stability and practicality, can be used in the fields ofimage target detection and classification, and improves the image processing speed.

Description

technical field [0001] The invention relates to the technical fields of artificial intelligence and image processing, in particular to a hierarchical network structure search method, computer equipment and a readable storage medium thereof, and the application of the method in image target detection, semantic segmentation and classification. Background technique [0002] With the development of computing power and deep learning, the development of artificial intelligence is getting faster and faster. In the initial image processing, due to the low quality of the collected images, the requirements for feature extraction are relatively low, so the main technology is manual feature extraction. Later, the image quality continued to improve, and the accuracy requirements for image processing continued to increase. Some statistical pattern recognition methods such as SVM and signal processing methods such as wavelet transform have made some progress in the development of image pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/32G06K9/62G06N3/04
CPCG06V10/25G06N3/045G06F18/2415G06F18/214
Inventor 戴文睿王曜明李成林邹君妮熊红凯
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products