A compact deep CNN feature indexing method based on SIFT embeddings

A feature indexing and depth technology, applied in the field of image retrieval in multimedia technology, can solve the problems of low sparsity, low indexing efficiency, ignoring the underlying visual characteristics, etc., and achieve the effect of improving sparsity and retrieval accuracy.

Active Publication Date: 2018-07-03
UNIV OF SCI & TECH OF CHINA
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

First, the sparsity of such CNN features is relatively low, making the indexing efficiency (including feature storage efficiency and calculation efficiency during query) relatively low
Second, this CNN feature is closer to the semantic level, ignoring the underlying visual characteristics, thus affecting the retrieval accuracy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A compact deep CNN feature indexing method based on SIFT embeddings
  • A compact deep CNN feature indexing method based on SIFT embeddings
  • A compact deep CNN feature indexing method based on SIFT embeddings

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0048] The present invention provides a compact deep CNN feature indexing method based on SIFT embedding. The method is aimed at deep CNN features. In order to improve the sparsity, an energy-based coefficient selection method is defined; and then each dimension in the deep CNN feature is regarded as Make a visual word (Visual Word) and build an inverted list, that is, for each picture, if its eigenvalue in the corresponding dimension is not zero, t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a compact deep CNN feature indexing method based on SIFT embedding, which includes: performing energy-based sparse processing on the deep CNN features of images; adopting a distance measurement optimization method, using images in CNN features and SIFT features To update the SIFT feature of the image and the CNN feature after sparse processing, so that the CNN feature after sparse processing contains the image context information based on SIFT feature, and complete the compact deep CNN feature index based on SIFT embedding. The method disclosed by the invention is used for efficiently storing the features of pictures in a huge number of databases, and effectively reducing the time required for online retrieval.

Description

technical field [0001] The invention relates to the field of image retrieval in multimedia technology, in particular to a compact deep CNN feature index method based on SIFT embedding. Background technique [0002] In the field of image retrieval, how to reliably and efficiently store and index image features in databases is a crucial issue. In large-scale image retrieval problems, in order to provide high-quality retrieval results, a huge number of database pictures is usually required, and the pictures in the database are stored in the form of features, usually each picture has more features, Or there are a small number of high-dimensional features, so the number of features that need to be saved is very considerable. In addition, efficient storage can also effectively reduce the time required for online retrieval. In the process of image retrieval, when determining the correlation ranking between images in the database and retrieved images, it is necessary to calculate ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30G06K9/46G06K9/62G06N3/08
CPCG06F16/51G06F16/583G06N3/08G06V10/464G06F18/241
Inventor 周文罡王云峰李厚强田奇
Owner UNIV OF SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products