Depth model compression method for edge device multi-layer shared codebook vector quantization

Abstract

The invention relates to a deep neural network model compression method, in particular to a depth model compression method for edge device multi-layer shared codebook vector quantization, which comprises five steps of sparse training, channel pruning, weight arrangement optimization, group vector quantization and codebook fine tuning. And sparse training: carrying out sparse training on each channel evaluation factor. And channel pruning: pruning the channels with low importance from the model. And weight arrangement optimization: carrying out weight optimization arrangement on the network model with a small size after channel pruning. And group vector quantization: implementing the pruned model to generate a lightweight network model. And codebook fine tuning: the lightweight model recovers the precision of the model. The method is used for compressing a network model with a large cloud size and a complex structure to obtain a lightweight model convenient for edge deployment, and the model deployment requirement under the condition that edge equipment computing power resources and storage resources are limited is met. Requirements of the model on storage space and computing power are effectively reduced, and the utilization rate of computing power resources and storage resources of edge devices is maximized.

Description

technical field [0001] The invention relates to a network model compression method, in particular to a depth model compression method oriented to edge device multi-layer shared codebook vector quantization. Background technique [0002] Deep neural network models have been widely used in computer vision, speech recognition, natural language processing, autonomous driving and other fields, and have huge application prospects in edge devices of mobile terminals and embedded systems. As more and more artificial intelligence solutions enter the stage of implementation, due to the requirements for model calculation speed and network transmission speed in some scenarios, the emergence of edge computing provides a solution to the above problems, which directly deploys deep models in In the edge device, the edge device directly obtains the calculation result after receiving the data, without relying on the cloud environment. But running deep models requires powerful computing power...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a deep model compression method for multi-layer shared codebook vector quantization of edge devices. The present invention combines two methods of channel pruning and vector quantization to reduce the number of channels in each layer of the model through channel pruning, effectively solving the problem of The vector quantization model increases the running time in the operation, and can further compress the storage space of the model parameters

Images