Unlock instant, AI-driven research and patent intelligence for your innovation.

A hierarchical network structure search method, device and readable storage medium

A technology of network structure and search method, applied in biological neural network models, neural architectures, instruments, etc., can solve the problems of search epoch collapse, inability to determine network structure, insufficient performance of downstream tasks, etc., to reduce search time and computational complexity. degree, guaranteeing interpretability and stability

Active Publication Date: 2022-05-17
SHANGHAI JIAOTONG UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Secondly, the existing search method based on the DARTS search space will collapse due to the excessive number of search epochs when searching the network. This collapse phenomenon is reflected in the fact that the final structure becomes a fully connected neural network without parameters. Completely incompetent on image classification tasks
And this collapse phenomenon also makes when the network structure search is directly used for image classification or other downstream tasks, because it is impossible to determine when the network structure converges, resulting in insufficient performance of downstream tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A hierarchical network structure search method, device and readable storage medium
  • A hierarchical network structure search method, device and readable storage medium
  • A hierarchical network structure search method, device and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0066] figure 1 It is a module principle diagram of the search method in an embodiment of the present invention, which shows the relationship between the network update module, the structure update module, the structure reservation module and the downstream task processing module.

[0067] refer to figure 1 As shown, in one embodiment of the present invention, the hierarchical network structure search method for image processing includes the following steps:

[0068] S1, using basic units to bui...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a hierarchical network structure search method, device and readable storage medium, comprising: S1, constructing a supernetwork; S2, acquiring image data and using them as training data of network parameters and structural parameters of the supernetwork respectively; S3, generating Feature map, calculate the cross-entropy loss function of the network parameters, update the network parameters of the super network; S4, generate the feature map and KL divergence loss function, calculate the cross-entropy loss function of the structural parameters, and obtain the semi-implicit variational discarding loss function, Training updates the structural parameters of the super network and obtains the discarding probability; S5, uses the discarding probability to update the basic unit, and updates the annealing parameters; repeats S3-S5, updates the network parameters and structural parameters; S6, obtains the final network. The invention greatly reduces search time and calculation complexity while ensuring high performance, ensures search stability and practicability, can be used in the fields of image target detection and classification, and improves image processing speed.

Description

technical field [0001] The invention relates to the technical fields of artificial intelligence and image processing, in particular to a hierarchical network structure search method, computer equipment and a readable storage medium thereof, and the application of the method in image target detection, semantic segmentation and classification. Background technique [0002] With the development of computing power and deep learning, the development of artificial intelligence is getting faster and faster. In the initial image processing, due to the low quality of the collected images, the requirements for feature extraction are relatively low, so the main technology is manual feature extraction. Later, the image quality continued to improve, and the accuracy requirements for image processing continued to increase. Some statistical pattern recognition methods such as SVM and signal processing methods such as wavelet transform have made some progress in the development of image pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06V10/25G06V10/764G06V10/774G06V10/82G06K9/62G06N3/04
CPCG06V10/25G06N3/045G06F18/2415G06F18/214
Inventor 戴文睿王曜明李成林邹君妮熊红凯
Owner SHANGHAI JIAOTONG UNIV