Method and system for searching for two-dimensional cross-media element

A cross-media and meta-search technology, applied in the field of cross-media retrieval, can solve the problems of low retrieval accuracy, cross-media semantic analysis and fusion neglect, and achieve the effect of improving retrieval performance

Inactive Publication Date: 2011-03-30
PEKING UNIV
View PDF2 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the difficulty in establishing the connection from low-level features to high-level semantics, the accuracy of content-based retrieval is low.
[0007] There are still many deficiencies in the current multimedia retrieval, mainly for single media such as images, MP3 or video, and cross-media semantic analysis and fusion between multiple media sources are usually ignored

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for searching for two-dimensional cross-media element
  • Method and system for searching for two-dimensional cross-media element
  • Method and system for searching for two-dimensional cross-media element

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0074] Example 1 as image 3What is shown is an embodiment of the two-dimensional cross-media meta-search method according to the present invention, which includes two sub-search engines: content-based image retrieval and text-based image retrieval. In this embodiment, the present invention is used to solve the problem of large-scale multimedia document retrieval. Taking the WikipediaMM image data set as an example, the data set contains 150,000 image data, and each image has a text description. In the implementation process of this embodiment, 32 of the 75 queries are selected as initial labeling queries, and the remaining queries are used for experimental testing. Such as figure 2 Shown is the workflow diagram of the two-dimensional cross-media meta-search method according to the present invention. After all image samples are extracted from features such as color, texture, and shape, the steps of utilizing the present invention to realize image retrieval are as follows:

...

Embodiment 2

[0103] Image 6 It is a structural schematic diagram of a two-dimensional cross-media meta-search system designed according to the two-dimensional cross-media meta-search method of the present invention. In this embodiment, the two-dimensional cross-media meta-search system includes the following modules:

[0104] (1) Preprocessing module: it collects and labels existing part of multimedia query data, then clusters the data and learns the fusion weight of the cluster. The multimedia data includes text, image, panoramic animation, and online video data ;

[0105] (2) Multimedia query processing module: it is responsible for classifying and processing the query requests input by users and decomposing them into sub-retrieval engine modules;

[0106] (3) Sub-retrieval engine module: it uses at least two retrieval models to retrieve data sets, and the retrieval models include but are not limited to text retrieval models based on vector space models, text retrieval models based on...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for searching for a two-dimensional cross-media element, and belongs to the field of information search. In the element search method, fusion operation such as combining, weighing and the like are performed on a search result set provided for different sub-search models based on inquiry clustering and result set overlap analysis so as to finally obtain a single search result set. The element search method comprises a preprocessing stage, an inquiry classifying stage, a search executing stage, an infusion stage and an updating stage. The cross-media element search method provided by the invention can effectively modify search performance according to the similarity of similar inquiries in the aspects of characteristic, the similarity of research result infusion mode, search result set overlap characteristic of different sub-search models and the like at the same time, and has superior search performance than single-dimensional cross-media search methods.

Description

technical field [0001] The present invention relates to a cross-media meta-search method and system, in particular to a two-dimensional cross-media meta-search method and system based on query clustering and result set overlap analysis, belonging to the field of information retrieval, specifically to the field of cross-media retrieval. Background technique [0002] The purpose of cross-media retrieval is to use various features such as text and content to retrieve matching multimedia documents from massive data. [0003] Text-based retrieval mainly compares the text query submitted by the user with the text in the dataset, and then uses a specific model to return document similarity information to the user. Text retrieval can directly obtain the high-level semantics of multimedia documents and achieve high precision and recall, but it has some insurmountable defects: [0004] (1) The ambiguity of the text. The ambiguity of the vocabulary leads to a decrease in the precisio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 田永鸿周志黄铁军高文
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap