Automatic image marking method based on word correlation

A technology for automatic image labeling and correlation, applied in the field of image processing, can solve the problems of inconsistent semantics of labelled words, ignoring the correlation between words, etc., and achieve the effect of reducing the impact

Active Publication Date: 2014-04-09
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In view of this, the present invention provides a kind of image automatic tagging method based on inter-word correlation, to overcome the defect that the joint media correlation model image automatic tagging algorithm thinks that different candidate tagged words are independent of each other in the tagging process, Solve the problem of semantic inconsistency between tagged words in tagging results due to ignoring inter-word correlation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic image marking method based on word correlation
  • Automatic image marking method based on word correlation
  • Automatic image marking method based on word correlation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the object, technical solution and advantages of the present invention more clearly, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0031] Technical scheme of the present invention is:

[0032] A. According to the formula Calculate the semantic vector of each labeled word w in the training set T, and express the labeled word w as a vector form w=1 ,v 2 ,...,v m >, where, c i is a contextual linking word, there are m contextual linking words, p(c i ) is the contextual linker c i The overall distribution probability of , p(c i / w) means contextual correlative word c i and the ratio of the number of co-occurrences of the tag word w in the training set T to the total number of times the tag word w appears in the training set T, that is

[0033] B. According to the formula Calculate the semantic similarity between tagged words, where ||·|| is vector modulo ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an automatic image marking method based on work correlation. A training set T comprises l images, n marking words are marked on each image of the training set T, the training set T is provided with a corresponding vision lemma, and the image to be marked is I. The method includes the steps that a semantic vector of each marking word w is calculated according to a formula, the marking word w is represented by the vector form w=<v1, v2,......, vm>, ci is an associated word in a context, and the associated words in the context total m; semantic similarity of the marking words is calculated according to a formula, and vector module calculated is achieved as is shown in the specification; p(A) is calculated according to the formula, wherein A is a marking word group in w1, w2,......wn, and n is the number of the marking word groups; the conditional probability p(I/wi) is calculated according to a formula; the marking word group A of the image I to be marked is calculated according to the formula A=arg maxAp(I/A) p(A).

Description

technical field [0001] The invention relates to the field of image processing, in particular to an image automatic labeling method based on inter-word correlation. Background technique [0002] With the rapid development of multimedia and Internet technology, people's daily life and work rely more and more on multimedia information such as images. Semantic-based image retrieval can not only accurately express the user's retrieval intention, but also facilitate the user's use. Therefore, this retrieval method has not only become an important form of image retrieval, but also has become a technical hotspot pursued by researchers. [0003] The automatic image annotation technology is an important and challenging task in image semantic retrieval. The emergence of image automatic annotation technology is to automatically obtain the semantic information contained in the visual content of the image. Build a bridge between them to support semantic retrieval at the semantic level. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/58G06F18/2155
Inventor 安震
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products