Device and method used for executing RMSprop gradient descent algorithm

A gradient descent algorithm and direct technology, applied in machine execution devices, micro-control devices, computing, etc., can solve problems such as insufficient computing performance of general-purpose processors, high front-end decoding overhead, and reduced memory access bandwidth.
CN107315569AActive Publication Date: 2017-11-03CAMBRICON TECH CO LTD
7 Cites 2 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Patent Type
Applications(China)
Current Assignee / Owner
CAMBRICON TECH CO LTD
Publication Date
2017-11-03

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a device and a method used for executing an RMSprop gradient descent algorithm. The device includes a direct memory access unit, an instruction cache unit, a controller unit, a data cache unit and a data processing module. The method includes: firstly, reading a gradient vector and a to-be-updated value vector, and initializing a mean square vector at the same time; during each iteration, firstly, utilizing the gradient vector to update the mean square vector, then utilizing the mean square vector to calculate corresponding gradient descent quantity during updating, and updating the to-be-updated parameter vector, and repeating the process until the to-be-updated vector converges. In the whole process, the mean square vector is always stored in the data cache unit. By utilizing the device and the method, application of the RMSprop gradient descent algorithm can be realized, and the efficiency of data processing can be greatly improved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present invention relates to the technical field of RMSprop algorithm application, in particular to a device and method for executing the RMSprop gradient descent algorithm, and is related to the hardware implementation of the RMSprop gradient descent optimization algorithm. Background technique

[0002] Gradient descent optimization algorithm is widely used in the fields of function approximation, optimization calculation, pattern recognition and image processing. RMSprop algorithm is one of the gradient descent optimization algorithms. Features such as good effect when processing mini-batch data sets are widely used, and using a dedicated device to implement the RMSprop algorithm can significantly increase its execution speed.

[0003] Currently, one known way to implement the RMSprop gradient descent algorithm is to use a general-purpose processor. The method supports the above-mentioned algorithms by executing general-purpose instructions usin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More