An implementation circuit, method and application of an S-shaped activation function based on ASIC

Abstract

The application discloses an implementation circuit of an S-shaped activation function based on an ASIC, comprising an input analysis module, an address generation module, a lookup table storage module and a multiplication and addition calculation module; the input analysis module is used for receiving input data in a floating-point number format and separating a sign bit, an exponent bit and a mantissa bit; the address generation module is used for converting the input data into a fixed-point number and generating a lookup table address; the lookup table storage module is used for storing the quantized values of the S-shaped function and outputting corresponding function values; the multiplication and addition calculation module completes multiplication and addition operations to obtain output values of the S-shaped activation function; and the multiplication and addition calculation module is used for outputting the activation function results to a subsequent calculation unit. The application also provides an S-shaped activation function implementation method using the above circuit, which has a wide application prospect.

Images