General fitting method and device for neural network activation function
CN113780545BActive Publication Date: 2025-09-16SHANGHAI XINZHENG ELECTRONICS TECH
Patent Information
- Application Number
- CN202111335738.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-12
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2041-11-12
Smart Images
Figure CN113780545B_ABST
Abstract
This application discloses a general fitting method and apparatus for neural network activation functions. The method comprises loading an activation layer in a neural network; generating four segmentation parameters based on a preset activation function in the activation layer; obtaining a five-segment fitting function based on the four segmentation parameters to generate a target fitting function; and resetting the activation layer based on the target fitting function. This method can fit complex activation functions into simple, piecewise linear functions, ensuring the accuracy of convolutional neural network algorithms with low hardware complexity, solving hardware implementation issues for complex activation functions, and improving the processing performance of the NPU.
Need to check novelty before this filing date? Find Prior Art
Citation Information
Patent Citations
Neural network-oriented general nonlinear activation function calculation device and method
CN110688088A
Sigmoid function fitting method based on probability distribution
CN110837885A