Device and method used for executing RMSprop gradient descent algorithm

A gradient descent algorithm and direct technology, applied in machine execution devices, micro-control devices, computing, etc., can solve problems such as insufficient computing performance of general-purpose processors, high front-end decoding overhead, and reduced memory access bandwidth.

Active Publication Date: 2017-11-03
CAMBRICON TECH CO LTD
View PDF7 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of this, the main purpose of the present invention is to provide a device and method for implementing the RMSprop gradient descent algorithm, to solve the problem of insufficient general-purpose processor computing performance of data and large decoding overhead in the previous stage, and to avoid repeated reading to the memory. Fetch data and reduce the bandwidth of memory access

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Device and method used for executing RMSprop gradient descent algorithm
  • Device and method used for executing RMSprop gradient descent algorithm
  • Device and method used for executing RMSprop gradient descent algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] Other aspects, advantages and salient features of the present invention will become apparent to those skilled in the art from the following detailed description of exemplary embodiments of the present invention according to the embodiments of the present invention in conjunction with the accompanying drawings.

[0048] In the present invention, the terms "include" and "comprising" and their derivatives mean to include but not limit; the term "or" is inclusive, meaning and / or.

[0049] In this specification, the various embodiments described below to describe the principles of the present invention are illustrative only and should not be construed as limiting the scope of the invention in any way. The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of exemplary embodiments of the present invention as defined by the claims and their equivalents. The following description includes numerous specific de...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a device and a method used for executing an RMSprop gradient descent algorithm. The device includes a direct memory access unit, an instruction cache unit, a controller unit, a data cache unit and a data processing module. The method includes: firstly, reading a gradient vector and a to-be-updated value vector, and initializing a mean square vector at the same time; during each iteration, firstly, utilizing the gradient vector to update the mean square vector, then utilizing the mean square vector to calculate corresponding gradient descent quantity during updating, and updating the to-be-updated parameter vector, and repeating the process until the to-be-updated vector converges. In the whole process, the mean square vector is always stored in the data cache unit. By utilizing the device and the method, application of the RMSprop gradient descent algorithm can be realized, and the efficiency of data processing can be greatly improved.

Description

technical field [0001] The present invention relates to the technical field of RMSprop algorithm application, in particular to a device and method for executing the RMSprop gradient descent algorithm, and is related to the hardware implementation of the RMSprop gradient descent optimization algorithm. Background technique [0002] Gradient descent optimization algorithm is widely used in the fields of function approximation, optimization calculation, pattern recognition and image processing. RMSprop algorithm is one of the gradient descent optimization algorithms. Features such as good effect when processing mini-batch data sets are widely used, and using a dedicated device to implement the RMSprop algorithm can significantly increase its execution speed. [0003] Currently, one known way to implement the RMSprop gradient descent algorithm is to use a general-purpose processor. The method supports the above-mentioned algorithms by executing general-purpose instructions usin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/30G06F9/22
CPCG06F9/223G06F9/30003G06F9/30145
Inventor 刘少礼郭崎陈天石陈云霁
Owner CAMBRICON TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap