Non-supervision night image classification method based on feature amplification

A classification method and unsupervised technology, applied in the field of computer vision recognition, it can solve problems such as field gaps and night images that do not conform to the real data distribution, and achieve the effect of improving performance and facilitating feature distribution statistics and migration.

Active Publication Date: 2021-06-18
ZHEJIANG LAB
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the nighttime images generated by this method do not conform to the real data distribution, and there is also a field gap with the real nighttime data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Non-supervision night image classification method based on feature amplification
  • Non-supervision night image classification method based on feature amplification
  • Non-supervision night image classification method based on feature amplification

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In order to make the object, technical solution and technical effect of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0055] Such as Figure 1-2 As shown, a kind of unsupervised nighttime image classification method based on feature amplification of the present invention comprises the following steps:

[0056] Step 1: Build a dataset: Use the 11 categories in the open source dataset Exclusively Dark (ExDARK), which are bicycles, boats, bottles, buses, cars, cats, chairs, dogs, motorcycles, people and tables. For the above For each of the 11 categories, 800 corresponding images were selected from the Pascal VOC public dataset as the daytime image classification dataset T; in addition, the ExDARK dataset was divided into two parts: 400 images were selected from the 11 categories respectively, and an infinite Supervised nighttime image dataset A; the remaining...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of computer visual identification, and relates to an non-supervised night image classification method based on feature amplification. The method includes training a classification network by adopting a public data set with daytime image classification labels, extracting feature vectors of input images through the classification network, and calculating feature mean values and covariance matrixes of all categories; inputting a night image without a label into the classification network to obtain a pseudo label of the image, and calculating a feature mean value and a covariance matrix of each category of the night image in the feature space according to the pseudo label; carrying out weighted average on the covariance matrixes obtained by daytime and night images of the same type to obtain a final covariance matrix; performing feature sampling according to the feature mean value of each type of night images and the covariance matrix after weighted averaging; and retraining the classification network by using the sampled feature values and the original feature values. According to the invention, the feature distribution of the daytime image with the label is learned, and the night data is amplified on the feature level, so that the unsupervised classification of the night image is realized.

Description

technical field [0001] The invention belongs to the technical field of computer vision recognition, in particular to an unsupervised nighttime image classification method based on feature amplification. Background technique [0002] Image classification is the most classic task in the field of computer vision recognition, and it is also the basis of many other visual problems, which has great practical value and application prospects. Image classification is essentially a pattern classification problem, and its goal is to divide different images into different categories to achieve the smallest classification error. With the success of convolutional neural network (CNN), deep learning has been proven to be an effective solution to image classification problems. [0003] The existing large-scale public datasets involving image classification mainly include ImageNet, COCO, PascalVOC, etc. However, these datasets are basically images collected in daytime environments. Studies...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06K9/46G06N3/04G06N3/08
CPCG06N3/04G06N3/088G06V10/40G06F18/24
Inventor 章依依郑影朱岳江徐晓刚曹卫强朱亚光
Owner ZHEJIANG LAB
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products