Heterogeneous media similarity calculation method and retrieval method based on correlation analysis

Abstract

The invention provides a heterogeneous media similarity calculation method and heterogeneous media retrieval method based on correlation analysis. The heterogeneous media similarity calculation method includes the following steps that a heterogeneous media database including different media types is established, and the feature vector of data of each media type is extracted; based on the incidence relation inside media, the heterogeneous media similarity can be calculated through K nearest neighbor analysis; based on the incidence relation between media, the heterogeneous media similarity can be calculated through heterogeneous media constraint transmission; the content similarity inside the media and between the media can be fused through a self-adaptation sorting result fusion algorithm so that a final result can be obtained, the fusion weight is set in a self-adaptation mode, and accordingly the final heterogeneous media similarity can be obtained to be used for heterogeneous media retrieval. According to the heterogeneous media similarity calculation method and retrieval method based on correlation analysis, the class information inside the media and the constraint information between the media are fully considered, different similarity calculation methods can be fused in a self-adaptation mode, different media can be mutually promoted, the similarity calculation accuracy is improved, and therefore higher heterogeneous media retrieval accuracy can be achieved.

Description

technical field [0001] The invention relates to the technical field of multimedia retrieval, in particular to a method for calculating the similarity of heterogeneous media based on correlation analysis, and a method for retrieving heterogeneous media. Background technique [0002] In recent years, with the rapid development of Internet technology and digital equipment, a large amount of multimedia content such as text and images has appeared on the Internet. How to use computers to manage effectively so that users can quickly and accurately retrieve the desired content has become a A key problem that needs to be solved urgently. Existing retrieval methods are generally limited to single-media retrieval, such as content-based image retrieval. However, this retrieval method can only retrieve the same media results as the user's query, and the user generally needs to be able to retrieve all relevant media data at one time, including data of different media types. Therefore, ...

AI Technical Summary

Problems solved by technology

In order to make up for this deficiency and make the calculation of similarity more in line with the semantic characteristics of the media, these methods all use relevant feedback and introduce manual participation, but this reduces the degree of automation of the algorithm

Images