Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Fine-grained bird image retrieval method based on graph neural network and deep hash

A neural network and image retrieval technology, applied in digital data information retrieval, character and pattern recognition, special data processing applications, etc., can solve problems such as slow query speed, large image differences, and large differences, so as to reduce manpower management costs, The effect of improving retrieval speed and reducing storage overhead

Pending Publication Date: 2022-04-12
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

(2) There is a large difference within the class. Due to factors such as illumination and posture, different images of the same bird have great differences
However, the encoding dimension of these two methods is 1024 dimensions, and its encoding dimension is relatively high. In the actual large-scale image retrieval, it may encounter the problems of slow query speed and redundant storage.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fine-grained bird image retrieval method based on graph neural network and deep hash
  • Fine-grained bird image retrieval method based on graph neural network and deep hash
  • Fine-grained bird image retrieval method based on graph neural network and deep hash

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0078] The present invention is described in detail below in conjunction with accompanying drawing and specific embodiment:

[0079] In this example, take the bird data set CUB200-2011 as an example, such as figure 1 As shown, a fine-grained bird image retrieval method based on deep hashing and graph neural network, including the following steps:

[0080] Step 1 Data Preparation

[0081] Our method is experimented on the bird fine-grained dataset CUB200-2011, which contains 200 bird species and 11788 images, and compares them with other fine-grained retrieval methods. Among them, 5994 are used for training and 5794 are used for testing. This method uses the test images as the query set and the training images as the retrieval database for all images. All images are resized to 448*448 pixels before being sent to the network.

[0082] Step 2 Node representation based on local features

[0083] Step 2.1 Node representation based on local features

[0084] For the image X, t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a fine-grained bird image retrieval method based on a graph neural network and deep Hash, which belongs to the field of fine-grained image retrieval, and comprises the following steps: node representation based on local features, local feature enhancement, related part relation mining based on graph convolution, semantic Hash coding and loss function. The invention provides a comprehensive method suitable for large-scale bird image retrieval based on a graph neural network and a deep hash method, and fine-grained bird image retrieval can be realized in a high-efficiency, low-storage and high-precision manner.

Description

technical field [0001] The invention belongs to the field of fine-grained image retrieval, in particular to a fine-grained bird image retrieval method based on a graph neural network and deep hashing. Background technique [0002] At present, for nature reserves and national wetland areas, bird monitoring can be used as an important indicator of biodiversity and ecological environment evaluation; for farmland and airport areas, bird monitoring affects the economic income of farmers and the normal operation of the airport. In nature, there are many kinds of birds. Therefore, how to quickly and accurately retrieve the correct bird from a large-scale data set is what bird experts hope. Because the retrieval of bird images is different from general image retrieval, there are two characteristics between its database images and query images: (1) Small differences between classes: the differences between birds are small, and the differences are often subtle. For example, a bird he...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/583G06V10/40G06K9/62G06V10/80
Inventor 孙涵郎文溪
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products