Multimedia detection method based on knowledge graph

A detection method and knowledge graph technology, which are applied in multimedia data retrieval, multimedia data indexing, multimedia data clustering/classification, etc., to achieve the effect of great practical application value and broad application prospects.

Active Publication Date: 2020-02-04
SHANGHAI DATATOM INFORMATION TECH CO LTD
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Understanding, analyzing, and exploiting large-scale knowl

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multimedia detection method based on knowledge graph
  • Multimedia detection method based on knowledge graph
  • Multimedia detection method based on knowledge graph

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The present invention will be further described below in conjunction with accompanying drawing.

[0041] see figure 1 , the multimedia detection method based on knowledge graph of the present invention, comprises the following steps:

[0042] Step S1, building a multimedia database, each user uploads shared multimedia files and custom tags to the multimedia database. Because the relevant knowledge of the current dissemination entity is no longer expressed only through a single medium, but often disseminates information in a multi-media and multi-channel manner. For the entity information of various media forms (pictures, videos, texts, users, etc.), use image classification, object detection, text classification and other technologies to analyze. Multimedia files include natural attributes (such as file upload location, time, size, file type, etc.) and social attributes (such as the classification category of the file, the identified portraits, objects, scenes, etc. i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multimedia detection method based on a knowledge graph. The multimedia detection method comprises the steps that each user uploads a shared multimedia file and a custom labelto a multimedia database; for a picture file and a video file containing portraits in the multimedia file, face detection, face recognition and face comparison are carried out to construct a portraitlibrary; for the picture file and the video file from which the portraits are removed in the multimedia file, processing is carried out through image classification and target detection, and a sceneand a real object are identified; for text files in the multimedia files, the text files are classified through a universal classifier and an educational classifier, and category labels are marked onthe text files according to classification results; a file atlas is formed for each user; a character relationship network is constructed; and retrieval is performed by the user based on the file atlas, the character library and the character relationship network. And multimedia attribute association retrieval is carried out on the basis of the knowledge graph, so that the user can use the methodconveniently.

Description

technical field [0001] The invention relates to the technical field of information retrieval, in particular to a multimedia detection method based on a knowledge map. Background technique [0002] At present, image and text retrieval mainly focus on single-modal retrieval, and the contents of query and candidate set belong to the same modality. Cross-modal retrieval (Cross-modal retrieval) completes the expression transformation of information in different morphological spaces by establishing the information mapping relationship between multiple modalities, and finally realizes the retrieval across the morphological differences of information resources. With the development and enrichment of multimedia technology, the demand for multi-modal retrieval is getting stronger and stronger. The biggest problem facing cross-modal retrieval at present is how to better realize mutual recognition and retrieval among multiple modalities such as text and images, which is also the goal a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/36G06F16/41G06F16/435G06F16/45
CPCG06F16/367G06F16/436G06F16/41G06F16/45Y02D10/00
Inventor 袁赛杰谢赟韩欣许青青
Owner SHANGHAI DATATOM INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products