Compression method based on layer-by-layer network binarization

A compression method and binarization technology, applied in the field of image processing, can solve the problems of estimation error, detection network precision loss, error amplification, etc., achieve the effect of realizing compression and acceleration, and solving the effect of precision loss

Active Publication Date: 2018-11-06
SHANGHAI JIAO TONG UNIV
View PDF3 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, due to the rough estimation method of using binary weights to approximate floating-point weights, there are estimation errors
In a deep convolutional neural network, the parameters of all layers of the network are binarized at the same time, and the estimation error is accumulated layer by layer. After passing through the multi-layer network, the error is greatly amplified, resulting in a large loss of accuracy in the detection network.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Compression method based on layer-by-layer network binarization
  • Compression method based on layer-by-layer network binarization
  • Compression method based on layer-by-layer network binarization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0061] A kind of compression method based on layer-by-layer network binarization provided by the present invention comprises:

[0062] S1: Construct a floating-point deep convolutional neural network.

[0063] In this embodiment, the floating-point deep convolutional neural network refers to: all parameters in the convolutional neural network, namely the weight W and the bias b, are kept as floating-point values, and each value occupies 32 bits when storing the model Space.

[0064] Generally, the dee...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a compression method based on layer-by-layer network binarization. The compression method based on layer-by-layer network binarization includes the steps: constructing a floating point type deep convolutional neural network; according to the opposite sequence of the hierarchy depth of the deep convolutional neural network, performing layer-by-layer binarization on the parameters in the network from deep to shallow until binarizing all the hierarchies in the deep convolutional neural network, and obtaining a binarized deep convolutional neural network; and performing pedestrian detection through the binarized deep convolutional neural network. Therefore, the compression method based on layer-by-layer network binarization realizes compression and acceleration of the network, and can effectively solve the problem of great precision loss caused by network quantification.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a compression method based on layer-by-layer network binarization. Background technique [0002] Pedestrian detection aims to detect pedestrians in the image and accurately output the position and score of the candidate frame. Pedestrian detection has a wide range of applications in the field of computer vision: such as intelligent monitoring, vehicle assisted driving, intelligent robots and human behavior analysis. In recent years, with the popularity of deep learning methods, deep convolutional neural networks have become an advanced technology for solving many tasks such as pedestrian detection, pedestrian re-identification, and semantic segmentation. In order to improve the accuracy of detection, researchers generally tend to use deeper and wider neural networks. However, these convolutional neural network-based methods require a large number of floating-point oper...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T9/00
CPCG06T9/002
Inventor 徐奕倪冰冰庄丽学
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products