Cognitive method and system based on fused multi-modal data matrix

A data matrix and multi-modal technology, applied in the field of big data analysis, can solve the problem that the information processing mode cannot meet the rapid identification of semantic information from different sources, and achieve the effect of solving heterogeneity and high computational cost, and rapid identification

Pending Publication Date: 2022-03-11
武汉东湖大数据交易中心股份有限公司
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, this application proposes a cognitive method and system based on the fusion of multi-modal data matrix to solve the problem that the existing information processing mode cannot meet the needs of rapid identification of semantic information from different sources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cognitive method and system based on fused multi-modal data matrix
  • Cognitive method and system based on fused multi-modal data matrix
  • Cognitive method and system based on fused multi-modal data matrix

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the implementation manners in the present invention, all other implementation manners obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of the present invention.

[0061] Such as figure 1 As shown, the present embodiment provides a cognitive method based on fusion multimodal data matrix, the method comprising:

[0062] S1, obtain the target multimodal data set, and obtain the cognitive target task corresponding to the target multimodal data set, and use it as the target task to be recognized;

[0063] What needs to be understood is that the target multimodal data set refers to the multimodal data set in a sp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a cognitive method and system based on a fused multi-modal data matrix, and the method comprises the steps: obtaining a target multi-modal data set, obtaining a cognitive target task corresponding to the target multi-modal data set, and taking the cognitive target task as a to-be-cognitive target task; performing feature extraction on the multi-modal data set to obtain a feature representation of each piece of single-modal data, and performing vectorization processing on the feature representation of each piece of single-modal data to obtain a word vector matrix fused with multi-modal features; and establishing a semantic network expression cognitive model, and calculating the similarity between the features in the word vector matrix fusing the multi-modal features and the to-be-cognitive target task to obtain target feature knowledge corresponding to the to-be-cognitive target task. According to the method, the problem that an existing information processing mode cannot meet the requirement for rapidly recognizing semantic information of different sources is effectively solved, and structured arrangement and fusion cognitive calculation of the multi-modal data set are achieved.

Description

technical field [0001] The present invention relates to the technical field of big data analysis, in particular to a cognitive method and system based on fusion multimodal data matrix. Background technique [0002] In the era of big data, data sources include not only traditional paper data such as materials and books, but also Internet data such as encyclopedias, web news, and multimedia. In addition to open source data, it also includes many professional fields such as electromagnetics, radar, and communications. The data types include database, text, sound, image, video, etc., and the data content includes many aspects such as society, politics, diplomacy, security, and technology. Multi-modal heterogeneous data presents a phenomenon that structured, semi-structured and unstructured formats coexist. The mixture of structured data and unstructured data leads to difficulties in the fusion and cognition of multi-modal data. Therefore, the research on the unified integration...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/30G06F40/284G06N3/04G06N3/08
CPCG06F40/30G06F40/284G06N3/08G06N3/045
Inventor 杜登斌杜小军杜乐
Owner 武汉东湖大数据交易中心股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap