Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An Image Retrieval Method Combining Visual Saliency and Phrase

A visual phrase and image retrieval technology, applied in the field of image processing, can solve the problem of inaccurate semantic expression of images, and achieve good retrieval effect, high speed, and noise reduction effect.

Active Publication Date: 2017-02-22
BEIJING UNIV OF TECH
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the problem of inaccurate image semantic expression existing in the existing image retrieval technology, the present invention proposes an image retrieval method combining visual salience and phrase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An Image Retrieval Method Combining Visual Saliency and Phrase
  • An Image Retrieval Method Combining Visual Saliency and Phrase
  • An Image Retrieval Method Combining Visual Saliency and Phrase

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The present invention will be further described below in combination with specific embodiments.

[0019] The flowchart of the method of the present invention is as figure 1 shown, including the following steps:

[0020] Step 1, input a query image I with width W and height H.

[0021] Step 2, calculate the saliency map of the query image.

[0022] Step 2.1, divide the image I evenly into L non-overlapping image blocks p i , i=1,2,...,L, so that after segmentation, each row contains N image blocks, each column contains J image blocks, each image block is a square, and each image block p i vectorize to a column vector f i , and perform dimensionality reduction on all vectors through principal component analysis. After dimensionality reduction, a d×L matrix U is obtained, and its i-th column corresponds to the image block p i Reduced vector. The matrix U is formed as:

[0023] U=[X 1 x 2 …X d ] T (1)

[0024] Step 2.2, calculate each image block p i degree ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a method for retrieving a similar image based on visual saliencies and visual phrases, comprising: inputting an inquired image; calculating a saliency map of the inquired image; performing viewpoint shift on the saliency map by utilizing a viewpoint shift model, defining a saliency region as a circular region which taking a viewpoint as a center and R as a radius, and shifting the viewpoint for k times to obtain k saliency regions of the inquired image; extracting a visual word in each of the saliency regions of the inquired image, to constitute a visual phrase, and jointing k visual phrases to generate an image descriptor of the inquired image; obtaining an image descriptor for each image of an inquired image library; and calculating a similarity value between the inquired image and each image in the inquired image library depending on the image descriptors by utilizing a cosine similarity, to obtain an image similar to the inquired image from the inquired image library. Through the present invention, noise in expression of an image is reduced, so that the expression of the image in a computer may be more consistent with human understanding of the semantics of the image, presenting a better retrieving effect and a higher retrieving speed.

Description

technical field [0001] The invention belongs to the field of image processing and relates to an image representation and matching method in image retrieval, in particular to an image retrieval method combining visual salience and phrases. Background technique [0002] With the rapid development and application of computer, network and multimedia technology, the number of digital images is increasing at an alarming rate. How to quickly and efficiently find the images people need from the massive digital image collection has become an urgent problem to be solved. For this reason, image retrieval technology has emerged as the times require and has achieved great development. From the earliest retrieval based on manual annotation of images to the current retrieval based on image content, the accuracy and efficiency of image retrieval have also been significantly improved, but it is still not possible. satisfy people's demands. The crux of the problem is that there is currently ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/5838
Inventor 段立娟赵则明马伟张璇苗军乔元华
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products