Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multimode-combined image reordering method

A multimodal and reordering technology, applied in character and pattern recognition, instruments, calculations, etc., can solve problems such as unsatisfactory sorting results, and achieve the effect of improving sorting results and fast convergence speed

Inactive Publication Date: 2011-07-20
SHANDONG UNIV
View PDF4 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The above image sorting algorithms usually only consider image unimodality, and the sorting results are unsatisfactory

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multimode-combined image reordering method
  • Multimode-combined image reordering method
  • Multimode-combined image reordering method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] Below in conjunction with accompanying drawing and embodiment the present invention will be further described:

[0039] Such as figure 1 It is the algorithm flow chart of the present invention, below in conjunction with this flow chart, method implementation and specific details are described further:

[0040] A multimodal joint image reordering algorithm, the specific steps are:

[0041] (1) Propose the visual features of the image and the textual features associated with them.

[0042] (2) Retrieve intra-modality (between single modalities) and inter-modality (between multiple modalities) similarities between images. And build a multigraph based on these similarities.

[0043] (3) Process multiple graphs to degenerate into a complete graph.

[0044] (4) Perform a random walk on the complete graph and calculate the image ranking score.

[0045] (5) Reorder the images according to the score of the random walk to get the final result.

[0046] In the step (1), the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a reordering method aiming at image retrieval result, which can make full use of multimode information in the process of image ordering, can further improve the image ordering result on the basis of the current retrieval result to enhance the accuracy, and is extraordinarily suitable for the use by an image retrieval system under a network environment or on the basis of a local system. The method of the invention comprises the following steps of: (1) extracting visual and textual characteristics of images; (2) retrieving the similarity in the modes (between single modes) and the similarity between the modes (between multiple modes) between the images, and constructing a multigraph according to the similarities; (3) processing the multigraph so that the multigraph is deteriorated to a complete graph; (4) performing random walk on the complete graph and calculating image ordering scores; and (5) reordering the images according to the condition of the image ordering scores to obtain a final result.

Description

technical field [0001] The invention relates to the reordering of search results of an image search engine, in particular to an image reordering algorithm that jointly utilizes image multi-modal features. Background technique [0002] Existing image retrieval systems are mostly based on text keywords. They search for images based on how relevant the text surrounding the images on the web page is to the query keywords. However, because the webpage text often cannot reflect the content of the image correctly, or there is noise, the results of image retrieval based on text are not satisfactory. [0003] Image reordering refers to the reordering of image retrieval results by using some additional information, which includes image intrinsic features and some external assumptions. Image features generally include image visual features and image-associated text features, and each feature is called a modality. [0004] Image re-ranking algorithms can be divided into three categor...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30G06K9/62
Inventor 许信顺王刚陈竹敏彭亮
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com