Natural image classification method and device on basis of multi-modal matrix filling

A natural image and matrix filling technology, applied in still image data retrieval, metadata still image retrieval, character and pattern recognition, etc., can solve problems such as reducing computing efficiency, affecting classification accuracy, and dimension explosion

Inactive Publication Date: 2014-07-23
PEKING UNIV
View PDF3 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This approach will not only greatly reduce the calculation efficiency, but also lead to the problem of dimension explosion. At the same time, it lacks physical explanation and affects the classification accuracy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Natural image classification method and device on basis of multi-modal matrix filling
  • Natural image classification method and device on basis of multi-modal matrix filling
  • Natural image classification method and device on basis of multi-modal matrix filling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The present invention will be described in detail below through specific embodiments and accompanying drawings.

[0035] The image classification method based on multimodal matrix filling in this embodiment, its process is as follows figure 2 As shown, the specific steps include:

[0036] 1) Use different feature extraction algorithms (SIFT, GIST, etc.) for all natural images (including labeled data, unlabeled data, and test data) to obtain different feature representations.

[0037] In classification, the data can usually be divided into training data and test data, the training data is used to train the classifier, and the test data is used to test the performance of the classifier. Unlabeled data belongs to training data, but unlike labeled training data, they are unlabeled, and these unlabeled training data can be used to improve the performance of the classifier. In the present invention, a large amount of unlabeled data can help to mine the data structure, so a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a natural image classification method and device on basis of multi-modal matrix filling. The method comprises the steps of carrying out feature extraction on natural image data with labels, natural image data without labels and natural image data for testing, and obtaining different feature representations; adopting a matrix filling algorithm to generate estimation labels of all features of the data with the labels; carrying out linear combination on all the estimation labels to be approximate to the corresponding known true labels corresponding to the estimation labels to obtain a combination coefficient; for all features, utilizing the natural image data with the labels and adopting the matrix filling algorithm to predict the labels of the natural image data without the labels and the labels of the natural image data for testing; adopting the combination coefficient to combine the predicted labels of all the features to obtain labels combining multiple features; classifying the natural image data on the basis of the labels combining the multiple features. The natural image classification method and device on the basis of the multi-modal matrix filling are easy to achieve, high classification accuracy can be obtained, meanwhile, the advantages of image classification on the basis of matrix filling are inherited, and the natural image classification method and device on the basis of the multi-modal matrix filling are suitable for the fields of network picture summarizing and classifying, image retrieval and the like.

Description

technical field [0001] The invention belongs to the technical field of image classification and multi-modal data analysis (multi-feature fusion), relates to a multi-label classification technology based on matrix filling, and specifically relates to an image classification method and device using multi-modal matrix filling. Background technique [0002] Different from images with single content and consistent form, such as faces and fingerprints, a natural image usually contains multiple objects, each of which presents different shapes. In natural image classification, it is often necessary to assign multiple class labels to an image. Such as figure 1 As shown, (a) "person" is riding a "bicycle", (b) "sky" and "ocean" often appear together, and (c) "dog" is a kind of "animal". Most of the traditional single-label classification (one sample has only one category label) algorithms cannot be directly used for multi-label classification. More feasible is the "one-to-many" str...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/58G06F18/24
Inventor 罗勇许超
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products