Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Automatic image semantic annotation method based on scale learning and correlated label dissemination

A technology of scale learning and label propagation, applied in special data processing applications, instruments, electrical digital data processing, etc., to achieve the effect of improving accuracy

Inactive Publication Date: 2012-07-04
SHANGHAI JIAO TONG UNIV
View PDF0 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to address the deficiencies of the existing methods, and propose an automatic image semantic labeling method based on scale learning and associated label propagation, which overcomes the problem of only using predefined distances such as Euclidean distance to measure the distance between images in the prior art. The defect of semantic similarity, while fully mining the correlation between keywords, makes the result of annotation more accurate and effective

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic image semantic annotation method based on scale learning and correlated label dissemination
  • Automatic image semantic annotation method based on scale learning and correlated label dissemination
  • Automatic image semantic annotation method based on scale learning and correlated label dissemination

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The technical scheme of the present invention is described in more detail below in conjunction with specific embodiments, and the flow chart of operation is as follows: figure 1 shown.

[0050] This embodiment takes the image annotation on the Core15k database as an example. An example image of this database is figure 2 As shown, a total of 374 keywords are included, and each image is assigned 1-5 keywords.

[0051] Below in conjunction with accompanying drawing, the embodiment of the present invention is described more specifically, as follows:

[0052] Step 1. Read the image database and extract the feature descriptor of each image.

[0053] The following three features are extracted from the images in the image library: (1) color moment feature; (2) 62-dimensional texture feature based on Gabor filter; (3) SIFT feature. The first two features are used to describe the global features of the image, and the latter are used to describe the local features of the imag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an automatic image semantic annotation method based on scale learning and correlated label dissemination, which comprises the following steps: firstly, the global and partial feature descriptor of each image is extracted after the image library is read; the feature descriptor is sent to a model based on a structured support vector machine for learning the distance scale between the images, actually the Mahalanobis distance; a model about the internal relation between key words is built; the learned Mahalanobis distance is embedded in a built label dissemination model so as to obtain the confidence degree score of each key word belonging to the image to be labeled; and a threshold value is set for the confidence degree score of each key word, and the key words of which the scores are higher than the threshold value are distributed to the images to be labeled, thereby completing labeling. The learning algorithm model based on the structured support vector machine can effectively solve the measuring problem of similarity between the images, the internal relation between the key words is fully excavated through the embedded-type correlated label dissemination model, and the accuracy of the image annotation and image retrieval is effectively improved.

Description

technical field [0001] The invention relates to the technical field of image retrieval and automatic image labeling, in particular to an automatic image semantic labeling method based on scale learning and associated label propagation. Background technique [0002] In recent years, with the rapid development of Internet technology, multimedia images, and storage devices, the number of images that users come into contact with has grown explosively. How to quickly and effectively search for the information users need from massive data is an important research topic, which is also the research content in the field of image retrieval. [0003] The initial image retrieval was based on text-based image retrieval (TBIR for short), which first described the content of each image manually with a series of keywords, and then classified the images according to these keywords. Indexing is established, so that the image retrieval problem is transformed into the matching problem of text ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 王斌肖建力刘允才
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products