Fine-grained bird recognition method based on cross-layer simplified bilinear network

A recognition method, bilinear technology, applied in neural learning methods, character and pattern recognition, biological neural network models, etc., can solve problems such as reducing the performance of a single network

Pending Publication Date: 2020-10-30
SICHUAN UNIV
View PDF7 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Such methods require a trade-off between localization and identification capabilities, which may degrade the performance of individual networks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fine-grained bird recognition method based on cross-layer simplified bilinear network
  • Fine-grained bird recognition method based on cross-layer simplified bilinear network
  • Fine-grained bird recognition method based on cross-layer simplified bilinear network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] The present invention will be further described below in conjunction with accompanying drawing:

[0015] figure 1 It is a bird feature image extraction network based on VGG-16. The image feature extractor of the present invention selects VGG-16, and removes the fifth pooling layer pool5 and three fully connected layers fc6, fc7, and fc8. First, preprocess the data set image and scale it to 512×S according to the aspect ratio. In the training phase, the pictures are scrambled, horizontally flipped and randomly cropped, and the input size is 448×448; in the testing phase, only the center crop of the picture is performed.

[0016] figure 2 is a schematic diagram of different high-level convolutional activation responses in the feature extraction network. Depend on figure 2 It is known that different convolutional layers have different discriminative properties for each part in the input image. Such as figure 2 In the first row of pictures, conv5_1 has a strong re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a fine-grained bird recognition method based on a cross-layer simplified bilinear network. The method comprises the following steps: firstly, preprocessing 5994 training pictures and 5794 test pictures in a CUB-200-2011 data set, and then inputting the processed images into a VGG-16 convolutional neural network to extract a feature map of a bird image; in order to considerinterlayer feature interaction, three groups of simplified bilinear feature representations are extracted from obtained feature maps of different high-level convolution, and after normalization operation is performed on the feature maps, the feature maps are sent to a softmax classifier in a cascaded mode. And finally, optimizing the whole network by using cross entropy loss and paired confusion loss. The recognition method described by the invention has the advantages of low feature dimension, small calculation amount, high recognition rate, strong robustness and the like, has a certain use value for the specific field of fine-grained image classification, and can be practically applied.

Description

technical field [0001] The invention designs a fine-grained bird recognition method based on a cross-layer simplified bilinear network, which involves deep learning and fine-grained image classification. Background technique [0002] The main purpose of fine-grained classification is to distinguish its various subcategories under the same basic category, such as different kinds of birds, flowers, etc. Compared with coarse-grained images, fine-grained images have slight differences between classes and significant intra-class differences. The acquisition of fine-grained features is often more complicated and relies more on image annotations to determine complex parameters in the model, avoiding errors caused by a small amount of data as much as possible. overfitting phenomenon. The early fine-grained recognition methods rely on the local information of manual annotation to perform strong supervised learning on the classification model. Local annotation usually requires exper...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62G06N3/08
CPCG06N3/084G06V20/00G06F18/214G06F18/24
Inventor何小海蓝洁滕奇志卿粼波任超吴小强吴晓红
OwnerSICHUAN UNIV