Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An Image Retrieval Method Combining Visual Saliency and Phrase

A visual phrase and image retrieval technology, applied in the field of image processing, can solve the problem of inaccurate semantic expression of images, and achieve good retrieval effect, high speed, and noise reduction effect.

Active Publication Date: 2017-02-22
BEIJING UNIV OF TECH
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the problem of inaccurate image semantic expression existing in the existing image retrieval technology, the present invention proposes an image retrieval method combining visual salience and phrase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An Image Retrieval Method Combining Visual Saliency and Phrase
  • An Image Retrieval Method Combining Visual Saliency and Phrase
  • An Image Retrieval Method Combining Visual Saliency and Phrase

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The present invention will be further described below in combination with specific embodiments.

[0019] The flowchart of the method of the present invention is as figure 1 shown, including the following steps:

[0020] Step 1, input a query image I with width W and height H.

[0021] Step 2, calculate the saliency map of the query image.

[0022] Step 2.1, divide the image I evenly into L non-overlapping image blocks p i , i=1,2,...,L, so that after segmentation, each row contains N image blocks, each column contains J image blocks, each image block is a square, and each image block p i vectorize to a column vector f i , and perform dimensionality reduction on all vectors through principal component analysis. After dimensionality reduction, a d×L matrix U is obtained, and its i-th column corresponds to the image block p i Reduced vector. The matrix U is formed as:

[0023] U=[X 1 x 2 …X d ] T (1)

[0024] Step 2.2, calculate each image block p i degree ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an image retrieval method that combines visual saliency and phrases, which includes: inputting a query image; calculating the saliency map of the query image; extracting the saliency area of ​​the query image; extracting visual words in the saliency area of ​​the query image, Construct a visual phrase; obtain the image descriptor of each image; calculate the image similarity between the query image and each image in the gallery, sort all images in the gallery according to the similarity value, and return relevant images as query results as required. Based on the classic "bag of words" model, the present invention constrains the image area by introducing visual saliency, reducing the noise of image expression, making the expression of the image in the computer more consistent with human understanding of image semantics, and making the present invention have Good search results. The present invention constructs visual phrases through regional constraints between visual words, and is faster than other methods of constructing visual phrases.

Description

technical field [0001] The invention belongs to the field of image processing and relates to an image representation and matching method in image retrieval, in particular to an image retrieval method combining visual salience and phrases. Background technique [0002] With the rapid development and application of computer, network and multimedia technology, the number of digital images is increasing at an alarming rate. How to quickly and efficiently find the images people need from the massive digital image collection has become an urgent problem to be solved. For this reason, image retrieval technology has emerged as the times require and has achieved great development. From the earliest retrieval based on manual annotation of images to the current retrieval based on image content, the accuracy and efficiency of image retrieval have also been significantly improved, but it is still not possible. satisfy people's demands. The crux of the problem is that there is currently ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/5838G06F16/5854
Inventor 段立娟赵则明马伟张璇苗军乔元华
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products