Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Region based multiple features Integration and multiple-stage feedback latent semantic image retrieval method

A multi-feature fusion and image retrieval technology, which is applied in the image retrieval of integrated text and image content, and latent semantic image retrieval, can solve the problems of not considering multi-feature fusion retrieval of images, low matching accuracy, single feature selection, etc., to achieve Improve the retrieval accuracy, increase the accuracy rate, and overcome the effects of versatility

Inactive Publication Date: 2007-05-23
HUAZHONG UNIV OF SCI & TECH
View PDF0 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, there are various methods and corresponding feedback strategies trying to achieve the goal of accurate search. However, the main idea is to gradually build a feature tree model from coarse to fine according to human understanding of images. The technology used tends to two directions: one is for In a specific field, the disadvantage is that the feature selection is single and the application is limited; one is that the processing range is too wide and the matching accuracy is too low
Correspondingly, most of its feedback models are still based on the underlying features, and the query requirements are updated by improving the query vector. However, the "semantic gap" is a fatal blow to this type of technology. Toml et al. in "A Picture is Worth a Thousand Keywords : Image-Based Object Search on aMobile Platform" mentioned in the article that image content is more efficient than text in image search, but it does not consider image multi-feature fusion retrieval

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Region based multiple features Integration and multiple-stage feedback latent semantic image retrieval method
  • Region based multiple features Integration and multiple-stage feedback latent semantic image retrieval method
  • Region based multiple features Integration and multiple-stage feedback latent semantic image retrieval method

Examples

Experimental program
Comparison scheme
Effect test

example

[0039] The image database adopted by the implementation example of the present invention is 3 million images collected from the Internet, including heterogeneous images of various semantic categories, including: natural scenery, characters, animals, plants, urban buildings, vehicles, daily necessities, etc. . The feature extraction of each image is processed offline in the background. The extraction of the underlying visual features is: first use the watershed algorithm to segment the image, and then use the fuzzy C-means to achieve regional fusion to form 6 (6 are more in line with human visual characteristics. ) region (or object), and then for each region extract its L * u * The color average value (3 dimensions), co-occurrence texture (9 dimensions) and area area ratio (1 dimension) of the V space are combined into a 78-dimensional (78=13×6) comprehensive visual feature. The eigenvector is represented by a vector, T={x ij |i=1, 2, ..., M; j = 1, 2, ..., 78, where M is t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a latent semantic image retrieval method of region-oriented multi-feature integration and multi-level feedback. It uses result list returned by the initial keyword search, extracting a variety of region-oriented images characteristics, constructing attribute-image matrix, using latent semantic indexing algorithm to get the semantic space of image sets and semantic features of each image, and then using similar images by users feedback to construct or update image query vector, searching again the semantic space, calculating image semantics features and images inquiries vector similarity, getting outcome sets by descending order, and repeatable retrieval. The invention takes full advantage of image content information, making up for the deficiencies of the keyword search, and through the region-oriented multi-feature integration, enhances image content information from the bottom physical layer to the object layer, then further enhances to the semantic layer by HCI feedback, thereby reducing the gap between the image bottom features and high-level semantic, and allowing Web image retrieval to get higher retrieval accuracy.

Description

technical field [0001] The invention belongs to the field of multimedia information retrieval, and specifically relates to a latent semantic image retrieval method based on region-based multi-feature fusion and multi-level feedback. The method involves computer vision, matrix analysis, image retrieval and other fields, and can be directly used in the Web environment Image retrieval under integrated text and image content. Background technique [0002] The development of multimedia technology and network technology has led to the explosive growth of the number of images in the WWW. How to obtain the images that users need from the "rich" and "miscellaneous" Web image data makes it necessary to seek an accurate, comprehensive, concise, Flexible and intelligent image search technology has become an inevitable demand. The current image search engines mainly use text matching technology, which essentially transforms the image search problem into a traditional text retrieval prob...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 金海陶文兵何儒汉章勤姜文超郑然余洋陈维李娟
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products