Transmedia searching method based on content correlation

Abstract

This invention discloses a method for media-crossing searches based on content relativity, which applies the typical relativity analysis to analyze the content characters of different mode media data, maps a visual sense character vector of image data and an auditory character vector of audio data in a low dimension isomorphic sub-space simultaneously by a sub-space mapping algorithm, measures the relativities among different mode data based on a general distance function and modifies the topological structure of a multi-mode data set in the sub-space to increase the cross media search efficiency effectively.

Description

Technical field

[0001] The invention relates to multimedia retrieval, in particular to a cross-media retrieval method based on content relevance. Background technique

[0002] Content-based multimedia retrieval is a research hotspot in the field of computer vision and information retrieval. Retrieval is achieved by matching the similarity of underlying features such as vision, hearing, or geometry. As early as 1976, McGurk had revealed that the human brain's cognition of external information needs to span and synthesize different sensory information to form a holistic understanding. Recent studies in cognitive neuropsychology have further verified that the cognitive process of the human brain presents the characteristics of cross-media, and the information from different senses such as vision and hearing stimulates each other and interacts to produce cognitive results. Therefore, there is an urgent need to study a cross-media retrieval method that supports different modalities, a...

Images