Deep learning model compression method and device

Abstract

The embodiment of the invention provides a compression method and device for a deep learning model. The method can comprise the steps that firstly, a deep learning model obtained through training andmultiple pieces of training data used for training the deep learning model are acquired, wherein the deep learning model is used for conducting service prediction and comprises multiple weight parameters; determining gradient values corresponding to the plurality of weight parameters according to a loss function corresponding to the deep learning model and the plurality of pieces of training data;determining importance measurement values respectively corresponding to the plurality of weight parameters; wherein the importance measurement value corresponding to one weight parameter is in positive correlation with the absolute value of the weight parameter, and is in positive correlation with the absolute value of the gradient value corresponding to the weight parameter. And performing network pruning on the deep learning model according to the importance measurement values corresponding to the plurality of weight parameters.

Description

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine

Login to view more

AI Technical Summary

Problems solved by technology

Significant redundancy exists in ma

Images