Deep learning-based clustering method

A technology of deep learning and clustering methods, applied in the direction of neural learning methods, biological neural network models, instruments, etc., can solve problems such as incompetent clustering tasks, large memory consumption, and incompetent big data background environments, etc. The effect of memory consumption

Active Publication Date: 2014-01-22
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF4 Cites 36 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, with the increase in the amount of data and the increase in data complexity, traditional clustering algorithms are no longer competent for clustering tasks in the context of complex large-scale data.
Although some clustering algorithms have recently been proposed to solve this problem, such as spectral clustering and other algorithms, but due to the huge memory consumption of such algorithms, they are not suitable for the background environment of big data.
[0003] Ther

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep learning-based clustering method
  • Deep learning-based clustering method
  • Deep learning-based clustering method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0018] The present invention adopts the nonlinear mapping method of the deep neural network to perform clustering. Traditional clustering mainly includes three parts: spatial mapping, selecting cluster centers and grouping them, and updating cluster centers. On this basis, the present invention first uses the nonlinear mapping of the deep neural network to map the original data to the feature space, then groups in the feature space and calculates the mean value of each group as the cluster center, and on this basis, the objective function of the deep neural network Add intra-class constraints to continue training the network, and finally use the trained network to map the data to the feature space and cluster again until ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a deep learning-based clustering method. The method comprises the following steps: obtaining the initial network weight of a deep neural network; grouping samples randomly and mapping to a feature space; adding the target function of the original deep neural network into the in-class constraint function of a feature layer; updating the network weight of the deep neural network and calculating to obtain a new feature layer; distributing all the samples to the class group of the nearest clustering center and calculating a new clustering center; substituting the new clustering center for the clustering center of the in-class constraint function, and returning to the network weight updating step to perform iteration to obtain and output the final clustering classification result. According to the method, the samples are subjected to non-linear mapping of the deep neural network from the original data space, which is difficult to cluster, to obtain a height-classified feature for clustering; a better clustering effect can be achieved by continuously optimizing the network structure. The deep learning-based clustering method with lower memory consumption and higher clustering precision is superior to the conventional clustering algorithm.

Description

technical field [0001] The invention relates to the technical fields of pattern recognition and machine learning, in particular to a clustering method based on deep learning. Background technique [0002] At present, traditional clustering algorithms are only suitable for situations where the data space is linearly separable, such as the K-means algorithm. However, with the increase of the amount of data and the increase of data complexity, the traditional clustering algorithm has been unable to perform the clustering task under the background of complex large-scale data. Although some clustering algorithms have recently been proposed to solve this problem, such as spectral clustering and other algorithms, such algorithms cannot be used in the background environment of big data because they require huge memory consumption. [0003] Therefore, in view of the fact that the previous methods are difficult to meet the current needs of large-scale complex data clustering, the pre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/08G06K9/62
Inventor 谭铁牛王亮黄永祯宋纯锋
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products