Unlock instant, AI-driven research and patent intelligence for your innovation.

A Hash Image Retrieval Method Based on Deep Learning and Local Feature Fusion

A technology of local features and deep learning, applied in digital data information retrieval, computer components, special data processing applications, etc., can solve problems such as dissimilarity of local details, inconsistent results, large gap in overall outline details, etc., to achieve fast and efficient image processing Retrieve the effect of the task

Active Publication Date: 2020-03-10
HUAQIAO UNIVERSITY
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, image retrieval based on deep learning generally extracts the features of the last convolutional layer or fully connected layer to directly perform similarity calculations, resulting in that although the final retrieved results are images of the same semantics, the local details between images are not similar. , because the high-level features have lost a lot of detailed information. For example, when searching for decorative clothing bags, industrial precision devices, and plant leaves in e-commerce, the images are similar in overall outline but have a large gap in details, resulting in retrieval results. Inconsistent with what the user expects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Hash Image Retrieval Method Based on Deep Learning and Local Feature Fusion
  • A Hash Image Retrieval Method Based on Deep Learning and Local Feature Fusion
  • A Hash Image Retrieval Method Based on Deep Learning and Local Feature Fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The present invention will be further described below through specific embodiments.

[0040] figure 1 It is a schematic diagram of the deep learning network structure of the present invention. The network model framework of the present invention is a deep convolutional network based on the improvement of the GoogLeNet network structure, and the deep convolutional network structure is as follows figure 1 As shown, the network consists of five parts: input part, convolutional subnetwork part, local feature fusion part, hash layer coding part and loss function part. The input part contains images and corresponding labels, and the images are input in the form of triplets; the convolutional subnetwork part uses the convolutional part of the GoogLeNet network, and contains the original 3 loss layers; the local feature fusion module is mainly composed of convolution Layer and pooling layer, a merge layer and a fully connected layer; the coding part of the hash layer is compo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A kind of hash image retrieval method based on deep learning and local feature fusion of the present invention, described method comprises five parts: (1) the preprocessing of image; (2) carry out to the image that contains classification label with convolutional neural network Training; (3) Generate the hash code of the image by binarization and extract the 1024-dimensional floating-point local aggregation vector; (4) Use the hash code for rough retrieval; (5) Use the local aggregation vector for fine retrieval. A hash image retrieval method based on deep learning and local feature fusion of the present invention extracts two types of features and uses an approximate nearest neighbor search strategy to perform image retrieval, which has high retrieval accuracy and fast retrieval speed.

Description

technical field [0001] The invention relates to the field of content-based image retrieval, in particular to a hash image retrieval method based on deep learning and local feature fusion. Background technique [0002] How to efficiently retrieve large-scale image data to meet the needs of users is an urgent problem to be solved. The traditional method is the image retrieval of the visual bag of words model, which is to first use the scale invariant feature transformation descriptor to extract the features of the image, and then use The hard clustering algorithm (K-Means) performs local feature clustering to obtain a visual dictionary, and finally counts the frequency of each visual word to generate a visual word histogram, and then matches and calculates image similarity. Since the initial feature extracted by the visual word bag model is Traditional manual descriptors, so the extracted features are relatively low-level, and cannot describe the high-level semantic informatio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/583G06K9/62G06K9/54
CPCG06F16/583G06V10/20G06F18/214
Inventor 杜吉祥聂一亮王靖范文涛张洪博刘海建
Owner HUAQIAO UNIVERSITY