Method for semantically annotating images on basis of hybrid generative and discriminative learning models

A learning model and semantic annotation technology, applied in character and pattern recognition, special data processing applications, instruments, etc., can solve problems such as inconvenient prior knowledge, achieve scalability, solve weak labeling problems, run efficiency and classification high precision effect

Inactive Publication Date: 2014-09-10
GUANGXI NORMAL UNIV
View PDF2 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This type of method treats each semantic concept as an independent category, and generally

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for semantically annotating images on basis of hybrid generative and discriminative learning models
  • Method for semantically annotating images on basis of hybrid generative and discriminative learning models
  • Method for semantically annotating images on basis of hybrid generative and discriminative learning models

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] A hybrid generative and discriminative model for automatic image annotation. In the generative learning stage, continuous PLSA is used to generate generative modeling of images, which can make full use of the prior knowledge of the training set, and can obtain the corresponding model parameters and the topic distribution of each image; then use this topic distribution as each image The intermediate representation vector of the image, then the problem of automatic image labeling is transformed into a classification problem based on multi-label learning to obtain higher labeling accuracy than the generative model. In the discriminative learning stage, the method of constructing a cluster classifier chain is used to conduct discriminative learning on the intermediate representation vector of the image. When the classifier chain is established, the context information between the labeled keywords is also integrated, so that the image can be classified At the same time, it a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for semantically annotating images on the basis of hybrid generative and discriminative learning models. The method includes generatively building models of the images by means of continuous PLSA (probabilistic latent semantic analysis) at generative learning stages, acquiring corresponding model parameters and subject distribution of each image, and utilizing the corresponding subject distribution as an intermediate representation vector of each image; constructing cluster classifier chains to discriminatively learn from the intermediate representation vectors of the images at discriminative learning stages, creating the classifier chains and integrating contextual information among annotation keywords; automatically extracting visual features of each given unknown image at annotation stages, acquiring representation of subject vectors of the given unknown images by the aid of a continuous PLSA parameter estimation algorithm, classifying the subject vectors by the aid of trained cluster classifier chains and semantically annotating the images by a plurality of semantic keywords with the highest confidence. The method has the advantage that the annotation and retrieval performance of the method are superior to the annotation and retrieval performance of most current typical methods for automatically annotating images.

Description

technical field [0001] The invention relates to the field of image retrieval, in particular to an image semantic labeling method of a hybrid generative and discriminative learning model. Background technique [0002] According to the characteristics of the machine learning methods used, the existing automatic image labeling methods can be roughly divided into labeling methods based on generative models and labeling methods based on discriminative models. [0003] The characteristics of the annotation method based on the generative model are: first learn the joint probability of image features and keywords, and then calculate the posterior probability of each keyword when the image characteristics are given by Bayesian formula, and perform image annotation according to the posterior probability . Such methods have a scalable training process and require less quality of manual annotation of the training image set. [0004] The characteristics of the labeling method based on ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/5866G06F18/2132
Inventor 李志欣张灿龙吴璟莉王金艳
Owner GUANGXI NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products