1results about How to "Enable configurability" patented technology

This invention provides a neural network model compression method and system based on optimal combination compression sequences, comprising: Step 1: Training a custom student model using the intermediate output of the original model as a soft target to inherit the inference performance of the original model; Step 2: Judging and deleting specific nodes / node connections and their corresponding model parameters at each layer of the student model using a node importance index constructed by a preset standard; Step 3: Changing the number of bits of the student model parameters, converting each floating-point parameter of the original model into its corresponding integer parameter; Step 4: Dynamically adjusting the number of student model layers required for each inference, with the student model dynamically changing its own results during inference, thus dynamically achieving the compression result. This invention solves the problem of combining multiple model compression methods, achieving convenience and configurability in deploying continuous compression schemes and comprehensively verifying the performance of compressed models.