Semi-supervised cross-media feature learning retrieval method

A feature learning and cross-media technology, applied in the field of retrieval, can solve the problems affecting the computational complexity and large dimensions of the algorithm, and achieve the effects of reducing computational complexity, increasing diversity, and achieving robustness.

Active Publication Date: 2022-02-15
WUHAN UNIV OF SCI & TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the dimensionality of the original features is usually large, which affects the computational complexity of the algorithm

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semi-supervised cross-media feature learning retrieval method
  • Semi-supervised cross-media feature learning retrieval method
  • Semi-supervised cross-media feature learning retrieval method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0074] The specific implementation manners of the present invention will be described below in conjunction with the accompanying drawings.

[0075] Such as figure 1 Shown is a flow chart of a semi-supervised cross-media feature learning method based on the present invention, combined below figure 1 The present invention is described further, and the concrete realization steps of the inventive method are as follows:

[0076] (1) Establish a multimedia database;

[0077] Described step (1) comprises the steps:

[0078] (1.1) Collect multimedia raw data: you can collect it yourself, or use a public data set. Here, for the accuracy of the data, use a public data set, Wikipedia data set;

[0079] (1.2) extract the feature of multimedia data: adopt appropriate method to extract the feature of every kind of media type data respectively;

[0080] (2) Obtain the projection matrix of different media types;

[0081] Described step (2) comprises the steps:

[0082] (2.1) Define the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a kind of cross-media characteristic learning retrieval method based on semi-supervised, comprises the following steps: Step 1: build multimedia database, step 2: seek the projection matrix of different media types; (2.1) define objective function: (2.2) target Function optimization: (2.3) Project the original features of the multimedia data to the public space, step 3: perform cross-media retrieval; (3.1) Extract the features of the media data submitted by the user: use pre-trained model to extract the features of the data, (3.2) project the feature vector of the media data into the common space (3.3) calculate the similarity between the projected feature vector and other vectors in the common space, (3.4) Return the top k media data with the highest similarity. The method of the invention reduces computational complexity, realizes robustness to noise, and improves retrieval accuracy.

Description

technical field [0001] The invention relates to a semi-supervised-based cross-media feature learning retrieval method, which belongs to the field of retrieval. Background technique [0002] With the development of modern computer science and technology, multimedia data such as images, texts, and videos on the Internet are increasing rapidly. Content-based multimedia retrieval has become more and more important, and a lot of research has been done on it. Traditional content-based retrieval methods usually focus on single mode retrieval, such as image retrieval, text retrieval. In this case, query and retrieval results are of the same media type. However, single-mode retrieval cannot fully exploit diverse media data. To solve this problem, cross-media retrieval has been proposed and becomes more and more important. It is designed to query one type of data as a query to retrieve related data objects of another type. For example, users can use pictures of tigers to retrieve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/43
Inventor 张鸿齐婷婷
Owner WUHAN UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap