Multi-task neural network architecture searching method based on evolutionary computation

A neural network and evolutionary computing technology, applied in the field of neural networks, can solve problems affecting model performance, etc.

Active Publication Date: 2021-07-16
SICHUAN UNIV
View PDF9 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method may lead to the fusion of some useless info

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-task neural network architecture searching method based on evolutionary computation
  • Multi-task neural network architecture searching method based on evolutionary computation
  • Multi-task neural network architecture searching method based on evolutionary computation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] The specific embodiments of the present invention are described below so that those skilled in the art can understand the present invention, but it should be clear that the present invention is not limited to the scope of the specific embodiments. For those of ordinary skill in the art, as long as various changes Within the spirit and scope of the present invention defined and determined by the appended claims, these changes are obvious, and all inventions and creations using the concept of the present invention are included in the protection list.

[0060] A multi-task neural network architecture search method based on evolutionary computing, such as figure 1 shown, including the following steps:

[0061] S1. Initialize a model population with multiple multi-task neural network individuals;

[0062] Specifically, in the embodiment, in order to better represent the connection relationship of feature fusion between different backbone networks, a matrix gene encoding st...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-task neural network architecture searching method based on evolutionary computation, which comprises the following steps: firstly, initializing a population; evaluating the multi-task generalization abilities of individuals in the population; then randomly obtaining two chromosomes through a binary tournament selection algorithm; comparing the multi-task generalization performance of the two chromosomes; selecting the chromosome with better performance as a parent; then carrying out crossover and mutation operations on two parents to generating two children; evaluating the multi-task generalization performance of the children; then combining the children and the parents; carrying out environment selection according to an evaluation result; generating a new population; carrying out a new round of evolution until a predetermined termination condition is reached; and outputting the individual with the best multi-task generalization ability. According to the method, a genetic algorithm is used for optimizing the multi-task network model system structure, the neural network model suitable for multi-task learning can be automatically searched out without manual participation, and the cross-task information fusion capability of the multi-task network is improved.

Description

technical field [0001] The invention relates to the field of neural networks, in particular to a search method for a multi-task neural network architecture based on evolutionary computation. Background technique [0002] At present, related technologies for single machine vision tasks, such as image classification and target recognition, whether it is the traditional non-neural network method or the deep learning method based on the convolutional neural network, have developed relatively mature. However, in real-world scenarios, it is often necessary to process multiple tasks at the same time. For example, unmanned driving requires road target recognition and target depth estimation to ensure the safe operation of unmanned vehicles. Multi-task learning aims to make full use of the information between multiple associated tasks to improve the generalization ability of the model and the performance of a single task. [0003] Multi-task learning techniques have continuously ev...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/086G06V20/588G06N3/045G06F18/253
Inventor 孙亚楠吴杰
Owner SICHUAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products