Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

A Fusion Method of Multi-label Image Annotation Results Based on Rank Minimization

A technology of image annotation and fusion method, applied in the field of fusion of image annotation results, which can solve the problems of different fusion effects and increase the complexity of decision-making fusion

Inactive Publication Date: 2016-08-10
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Considering that the results of different models will be in different numerical ranges, the normalization method will be different for different models, increasing the complexity of decision-level fusion
Furthermore, the fusion effects of different fusion rules are not the same, so there will be doubts about which fusion rules are the best for which model fusion.
In addition, since a single discriminative model has its own prediction error, blindly using rules to fuse the results of multiple models will also introduce their own errors at the same time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Fusion Method of Multi-label Image Annotation Results Based on Rank Minimization
  • A Fusion Method of Multi-label Image Annotation Results Based on Rank Minimization
  • A Fusion Method of Multi-label Image Annotation Results Based on Rank Minimization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] Refer to attached figure 1 And attached figure 2 , taking the color histogram, Gabor texture and local binary pattern features as examples, the multi-label result fusion method of image annotation based on rank minimization includes the following steps:

[0049] 1) Extract various feature representations of images in the training set, and each image in the training set has semantic tags given in advance;

[0050] 2) Under different feature representations, train their respective supervised learning image annotation models;

[0051] 3) For a new image without semantic tagging words, use the same method to extract multiple feature representations of the image, and use these feature representations to input to the corresponding supervised learning image tagging model to predict its multi-label tagging results;

[0052] 4) Use the rank minimization optimization algorithm to fuse the multi-label results output by multiple models: for the result vectors predicted by the mo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a multi-label image annotation result fusion method based on a rank minimization optimization algorithm. The method comprises the following steps: (1), extracting various feature representations of a training set image, wherein the training set image has a semantic annotation word which is given in advance; (2) in the various feature representations, training each supervised learning image annotation model; (3) for a new image without a semantic annotation word, using the same method for extracting various features of the image, and using the features for being respectively input to the corresponding supervised learning image annotation models to predict multi-label results; (4) utilizing the rank minimization algorithm for fusing the multi-label results output by the various models to obtain a more accurate annotation result. According to the multi-label image annotation result fusion method based on the rank minimization, the complementarity of the image annotation models under the various feature representations is fully utilized, the rank minimization algorithm is utilized for reducing the number of prediction mistakes in the fused annotation result, and therefore the final image annotation result is more accurate.

Description

technical field [0001] The invention relates to a fusion method of image labeling results, in particular to a fusion method of multi-label image labeling results based on rank minimization. Background technique [0002] With the popularization of digital cameras and social networking applications, people are more and more used to posting the images they take on the Internet. In order to manage and retrieve massive images on the Internet more conveniently, automatic image annotation is an effective tool. The basic task of an image tagging program is to model the relationship between the low-level visual features of an image and the high-level semantically tagged words. The supervised learning image tagging model uses images with semantic tagging words as training images, first extracts the underlying visual features of the training images, and then uses these feature representations and corresponding semantic tagging words as input to train a supervised learning image taggin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/00G06F17/30
Inventor 郭平姚垚辛欣
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products