Class identification method for zero sample picture

A sample picture and recognition method technology, applied in the field of picture recognition, can solve problems such as expensive labeling of attributes, difficulty in learning implicit relationship between categories, inapplicability of large-scale zero-sample picture category recognition, etc., to achieve the effect of improving accuracy

Active Publication Date: 2019-09-10
成都澳海川科技有限公司
View PDF11 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007](1), attribute labeling is expensive and time-consuming, and attribute-based methods are not suitable for category recognition of large-scale zero-sample images;
[0008] (2), the word vector information is learned from a large corpus, which has a large error, and the relationship between categories is usually learned through word vector information Inaccurate;
[0009] (3), learn the implicit relationship between categories with the help of semantic space, however, the relationship between categories is fuzzy and uncertain, at the same time, It is very difficult to learn the implicit relationship between categories in the semantic space, resulting in low recognition accuracy of zero-shot images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Class identification method for zero sample picture
  • Class identification method for zero sample picture
  • Class identification method for zero sample picture

Examples

Experimental program
Comparison scheme
Effect test

example

[0085] The Hit@K metric is used to evaluate our model. Hit@k refers to the proportion of images with correct labels in the first k results returned by the model, and is the most commonly used classification evaluation method. In this example, k are 1, 2, 5, 10, 20, respectively.

[0086] The present invention is tested on the large-scale picture data set ImageNet 2011 21K data set. The data set contains 21841 categories, 1000 categories are selected as the training set (ImageNet 2012 1K), and the remaining 20841 categories are the test set. Divide the test set into three subsets, two hops (2-hops), three hops (3-hops) and all (All). Two hops means that the test set data is at most two nodes away from the training set, and three hops means that the test set data is at most three nodes away from the training set, all of which include all categories (20841 categories) in the ImageNet 2011 21K dataset. During the test, there are two settings to test respectively. The first is t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a class identification method for a zero sample picture. The method includes constructing a knowledge graph according to the knowledge of the human to represent explicit relationships among the categories; according to the method and the device, the problems of implicit relation learning and fuzzy and uncertain relation between categories in a semantic space are avoided, meanwhile, a residual image convolutional network is constructed and trained for migrating knowledge between the categories, and category recognition is carried out by adopting maximum inner product values, so that the category recognition accuracy of the zero sample picture is improved.

Description

technical field [0001] The invention belongs to the technical field of picture recognition, and more specifically, relates to a category recognition method of a zero-sample picture. Background technique [0002] Traditional image category recognition methods require a large amount of labeled data for training, and the trained classifier can only identify the categories of pictures participating in the training, and cannot do anything for new categories of pictures. However, the process of annotating images is time-consuming and expensive, and it is difficult to obtain a large number of annotated samples in reality. [0003] The goal of category recognition from zero-shot images is to identify the categories of images that do not appear in the training set. The existing zero-shot image category recognition methods are mainly divided into two types. [0004] The first type is to learn a common semantic space in which category knowledge acquired on the training set is transfe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04
CPCG06N3/045G06F18/2155G06F18/214
Inventor 杨阳汪政位纪伟
Owner 成都澳海川科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products