Cross-media searching method based on discrimination correlation analysis

A cross-media and feature data technology, applied in the field of cross-media retrieval based on discriminant correlation analysis, can solve the problems that cannot be directly applied to multi-modal cross-media retrieval, and achieve the effect of simple combination and good performance

Active Publication Date: 2012-09-12
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF4 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Some research work pointed out that although nonlinear methods have good performance in processing simulated data, they are not necessarily better than traditional principal component analysis methods for real data, and these methods mentioned above cannot be directly applied to multi-modal cross-media retrieval.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-media searching method based on discrimination correlation analysis
  • Cross-media searching method based on discrimination correlation analysis
  • Cross-media searching method based on discrimination correlation analysis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0020] figure 1 It is the realization flowchart of the method of the present invention, as figure 1 As shown, a kind of cross-media retrieval method based on discriminant correlation analysis proposed by the present invention includes training process ( figure 1 (a)) and the testing process ( figure 1 (b) and (c)), in particular, figure 1 (a) utilizes the image text in the training database in the present invention to learn projection vector a, the flowchart of b, as figure 1 Shown in (a), the training process of the present invention comprises the following steps:

[0021] Step 1: Establish a cross-media training database including one-to-one correspondence between images and text pairs and extract feature vectors of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a cross-media searching method based on discrimination correlation analysis. The method comprises the following steps of establishing a cross-media training database, carrying out feature extraction, mean-value pretreatment and linear projection transformation sequentially for different modal samples, and setting a target function according to a projection space; solving the target function to acquire a linear projection vector; establishing a cross-media test database; sequentially performing the feature extraction and mean-value pretreatment for a target to be searched; utilizing the linear projection vector to perform the linear projection transformation for the feature data after the mean-value pretreatment; and calculating an Euclidean distance between two modal data projection vectors, listing the Euclidean distance in ascending order, and acquiring a cross-media searching result. Due to the adoption of the method, dimensional reduction can be effectively performed for the feature data, so that the feature data can be widely applied to other multi-modal work, for example the multi-modal biological feature recognition.

Description

technical field [0001] The invention relates to the field of pattern recognition and machine learning, in particular to a cross-media retrieval method based on discriminant correlation analysis. Background technique [0002] In recent years, a large amount of multimedia data has shown two obvious characteristics: high dimensionality and multi-source. For example, the same semantic concept can be represented by various contents such as text, pictures, and videos on the Internet. In addition, Internet users mainly search for the information they need through text keywords. This is mainly because search engines cannot understand the relationship between different modal media, thus limiting the development of search engines. Feature dimensionality reduction reveals the manifold structure of high-dimensional data in low-dimensional space and the correlation between different modal data, and plays an important role in information retrieval, pattern classification, information visu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/64G06F17/30
Inventor 谭铁牛王亮王威
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products