Deep belief network image recognition method based on Bayesian regularization

A deep learning network and image recognition technology, which is applied in the field of recognition and classification of handwritten digital images, can solve problems that affect the results and are not easy to promote

Active Publication Date: 2014-10-01
BEIJING UNIV OF TECH
View PDF1 Cites 40 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

More and more works have shown that the correct setting of network parameters will greatly affect the results
[0004] Overfitting is one of the common problems in the training process of neural networks. In order to improve the generalization ability of the network, traditional methods include simplifying the network structure and stopping training early. These methods work to varying degrees, but are not easy to generalize.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep belief network image recognition method based on Bayesian regularization
  • Deep belief network image recognition method based on Bayesian regularization
  • Deep belief network image recognition method based on Bayesian regularization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] Below in conjunction with specific embodiment, the present invention will be further described;

[0058] see figure 1 Shown is a schematic diagram of the DBN network structure and training principle of the present invention.

[0059] The present invention obtains a DBN network training method based on Bayesian regularization. By introducing Bayesian regularization, the method controls the variation of network weights in the training process, improves the sparseness of weights, and thus improves the network generalization. purpose of capacity.

[0060] The experiment uses the MNIST handwriting database, selects 5,000 samples from the database for training, and selects another 1,000 samples without labels for testing.

[0061] The present invention adopts following technical scheme and implementation steps:

[0062] A deep neural network learning method based on Bayesian regularization, comprising the following steps:

[0063] (1 determine the input object and network...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a deep belief network image recognition method based on Bayesian regularization and belongs to the field of artificial intelligence and machine learning. The deep belief network plays a more and more important role in the field of digital detection and image recognition. The invention provides a deep belief network based on Bayesian regularization on the basis of the network sparsity characteristic and changes of connection weights to solve the problem of overfitting in the training process of the deep belief network. By applying Bayesian regularization to the network training process, balance between error decreasing and weight increasing is effectively adjusted. The classification experiment of a digital script database proves effectiveness of the improved algorithm. An experimental result shows that in the deep belief network, the deep belief network image recognition method can effectively overcome the overfitting phenomenon and improve accuracy of digital recognition.

Description

technical field [0001] The invention utilizes a Bayesian Regularization-based deep learning network (Deep BeliefNetwork, DBN) to realize recognition and classification of handwritten digital images. Neural network is an important method in the field of artificial intelligence and neural computing, and image detection and recognition is one of the important tasks in the field of machine learning, so the present invention belongs to the fields of artificial intelligence and machine learning. Background technique [0002] Digital identification technology has a place in many industries, such as education, transportation, commerce, postal services and banking. The realization and application of automatic identification of numbers provides important convenience for people's life, and is closely related to people's life. It is widely used in number detection of vehicles and roads, automatic identification of personal transcripts, etc. Compared with printed digit recognition, hand...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/08
Inventor 乔俊飞潘广源韩红桂柴伟
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products