Unlock instant, AI-driven research and patent intelligence for your innovation.

Method for local multi-modal sparse code completion through adaptive similar structure regularization

A sparse coding, multimodal technology, applied in the field of sparse coding completion, can solve the problem of lack of special attention to local multimodal data

Inactive Publication Date: 2018-05-15
ZHEJIANG UNIV
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to solve the problems in the prior art. In order to overcome the lack of special attention to local multimodal data in the prior art, the present invention provides a local multimodal sparse coding using adaptive similar structure regularization Complementary method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for local multi-modal sparse code completion through adaptive similar structure regularization
  • Method for local multi-modal sparse code completion through adaptive similar structure regularization
  • Method for local multi-modal sparse code completion through adaptive similar structure regularization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0120] The present invention is verified experimentally on two data sets of Wiki Text-Image and NUS-WIDE. The WikiText-Image dataset contains 2866 text image pairs belonging to different categories, and the NUS-WIDE dataset contains 12072 text image pairs belonging to 31 different categories. The present invention uses a SIFT-based visual bag of words to extract 500-dimensional features of each picture, and uses a bag of words to extract 100-dimensional features of each text.

[0121] In order to objectively evaluate the performance of the algorithm of the present invention, the present invention uses NMI, AC to evaluate the effect of the present invention in the selected test set. According to the steps described in the specific implementation method, the experimental results obtained on the NMI and AC standards for the Wiki Text-Image and NUS-WIDE datasets are shown in Table 1. The results show that when performing local multimodal sparse coding completion Task aspect, the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for local multi-modal sparse code completion through adaptive similar structure regularization. The method mainly comprises the following steps that firstly, accordingto existing local multi-modal data with the combination of a probability neighbor matrix method, a final target function for local multi-modal sparse code completion through adaptive similar structure regularization is obtained; secondly, according to the obtained target function, a corresponding optimization algorithm is employed to learn a probability neighbor P, a unified sparse code alpha anda multi-modal base vector dictionary D, and accordingly, a final sparse code is obtained. Compared with a common sparse cod solution scheme, the method can reasonably utilize the local multi-modal data, and the sparse code which better meets similarity requirements is generated. Compared with a traditional method, the effect obtained in sparse coding problems is better.

Description

technical field [0001] The invention relates to sparse coding completion, in particular to a method for local multimodal sparse coding completion using adaptive similar structure regularization. Background technique [0002] With the development of the Internet, many Internet applications begin to contain multi-modal data, such as data containing both web page images and related texts. Therefore, the multimodal sparse coding technology for multimodal data has become an important technology. The purpose of sparse coding technology is to represent multimodal data with only a few coding coefficients. [0003] Existing technology is mainly through the use of l 1 The sparse coding regularization method of the penalty term is used to reconstruct the multimodal data to complete the sparse coding and preserve the model correlation through the method of multimodal data mapping function learning. However, in practical situations, generally the data in many modalities are incomplete...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/15G06F17/16
CPCG06F17/15G06F17/16
Inventor 赵洲孟令涛高天祥蔡登何晓飞庄越挺
Owner ZHEJIANG UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More