Cross-medial personage news searching method and system capable of fusing multi-mode information

A multi-modal, cross-media technology, applied in character and pattern recognition, special data processing applications, instruments, etc., can solve problems such as alignment

Inactive Publication Date: 2013-12-04
FUDAN UNIV
View PDF4 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0035] The purpose of the present invention is to propose a cross-media character news retrieval method that combines multi-modal information to solve the following two problems: one is to solve the alignment problem of names in network news texts and faces in news images; is to solve the news retrieval problem after alignment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cross-medial personage news searching method and system capable of fusing multi-mode information
  • Cross-medial personage news searching method and system capable of fusing multi-mode information
  • Cross-medial personage news searching method and system capable of fusing multi-mode information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0109] System framework such as figure 1 shown.

[0110] 1. Network multi-modal news acquisition

[0111] People news data should be as close as possible to the actual people news retrieval situation, involving a variety of news content and rich news figures. Comprehensive consideration, using well-known news websites to obtain multi-modal news as a data set, specifically using Yahoo! News , and after a certain screening, it will be used as the algorithm data set. Yahoo! News The news covers a wide range of fields, including politics, economy, sports, etc., and the news figures involved are also internationally renowned figures. Each filtered news has a text part and an image part. The image contains the faces of news figures, and the text contains the names of multiple news figures. This data set can well simulate the real news retrieval situation, and the data set has good diversity.

[0112] For an example of network multimodal news acquisition, see attached figu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of multi-media information searching and news searching, and particularly relates to a cross-medial personage news searching method and system capable of fusing multi-mode information. The searching method includes the steps of obtaining multi-mode news information on the internet, extracting names of news figures to obtain textural features of news, extracting facial images of the news figures to obtain image features of the news, conducting network information supplement on the rarely-seen news figures, conducting name-image alignment cluster learning on the news figures, and achieving searching for faces of the figures and searching for the names of the figures. The searching system comprises six modules corresponding to the steps of the searching method respectively. The cross-medial personage news searching method and system capable of fusing the multi-mode information can well solve the problem of network news name-face alignment and solve the problem of searching for personage news accordingly. The two problems have significance in the multi-medium information searching field and the news searching field, and the cross-medial personage news searching method and system capable of fusing the multi-mode information have wide application value.

Description

technical field [0001] The invention belongs to the technical fields of multimedia information retrieval and news retrieval, and in particular relates to a cross-media personage news retrieval method and system that integrates multimodal information. [0002] The function of this algorithm is reflected in two aspects: one is that it can align and cluster news images and text information, and calculate which news person in the text the face in the news image corresponds to; the other is that it can provide cross-media information after alignment and clustering. There are two retrieval methods for character news retrieval, retrieval by face image and retrieval by name. This algorithm can effectively solve the network multi-modal news name-face alignment problem and cross-media character news retrieval problem, and has a very wide application value. Background technique [0003] With the rapid development of computer network technology in the past ten years, a large amount of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06K9/46
Inventor 张玥杰赵昀金城薛向阳
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap