Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Cross-media retrieval method based on subspace learning and semi-supervised regularization

A subspace learning and cross-media technology, applied in the field of cross-media retrieval, can solve problems such as ignoring the semantic consistency and complementary relationship of multiple media data, and cumbersome calculation of weight matrix

Active Publication Date: 2018-08-10
WUHAN UNIV OF SCI & TECH
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The disadvantages are: most of the existing cross-media retrieval methods are limited to the retrieval between two media, and there is a problem that the calculation of the weight matrix in the process of constructing the neighbor graph is too cumbersome
[0004] These traditional retrieval methods only focus on the retrieval between the same media or two media data, which ignores the semantic consistency and complementary relationship between multiple media data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-media retrieval method based on subspace learning and semi-supervised regularization
  • Cross-media retrieval method based on subspace learning and semi-supervised regularization
  • Cross-media retrieval method based on subspace learning and semi-supervised regularization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] The specific implementation manners of the present invention will be described below in conjunction with the accompanying drawings.

[0070] like figure 1 As shown, the cross-media retrieval method based on subspace learning and semi-supervised regularization includes the following steps:

[0071] Step (1) sets up the multimedia database, comprises the steps:

[0072] (1.1) Collection of multimedia raw data: A large amount of media data must be collected for each media type, and public datasets such as the Wikipedia dataset can also be used, but this dataset only has image and text data.

[0073] (1.2) Extract the features of multimedia data: use appropriate methods to extract the features of each type of media data. Features can be extracted using functions of various feature extraction classes.

[0074] (1.3) Save the feature vector and original data of multimedia data: save the feature vector and original data of each media type data respectively according to diff...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a cross-media retrieval method based on subspace learning and semi-supervised regularization, which is characterized by comprising the following steps: Step 1, establishing a multimedia database, collecting multimedia original data, extracting features of multimedia data, and storing feature vectors of the multimedia data and the original data; Step 2, acquiring a projectionmatrix of different media types, defining an optimal target function, solving the optimal target function by utilizing an iterative method, and projecting the feature vectors of the multimedia data to a public space; Step 3, carrying out cross-media retrieval, extracting features of media data submitted by a user, projecting feature vectors of the media data into the public space, calculating a similarity between the projected vectors and other vectors in the public space, and returning the media data corresponding to first k feature vectors with the largest similarity with other vectors in the public space. The cross-media retrieval method provided by the invention generates a more accurate retrieval result.

Description

technical field [0001] The invention relates to a cross-media retrieval method based on subspace learning and semi-supervised regularization, belonging to the field of data retrieval. Background technique [0002] With the rapid development of multimedia technology and network technology, unstructured heterogeneous multimedia content such as text, image, audio, video, and 3D floods into the Internet rapidly, making cross-media retrieval particularly important. Cross-media retrieval refers to the mutual retrieval between different media data, which makes the retrieval rich and colorful, and better meets the needs of users who want to submit any kind of media data to retrieve various types with the same semantics (same type or different types) of media data needs. [0003] At present, more and more domestic and foreign scholars are devoted to the study of cross-media retrieval, and the proposed methods can be roughly classified into the following categories: deep learning, pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/43G06F16/48
Inventor 张鸿代刚
Owner WUHAN UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products