Point cloud-oriented efficient binary neural network quantization method and device

A technology of binarized neural network and neural network, which is applied in target detection device, efficient binarized neural network quantization field, can solve the problem of restricting the application prospect of point cloud neural network, limited computing power and storage capacity of in-vehicle computing equipment, and limiting point cloud. application and other issues, to meet the requirements of real-time detection and positioning, perform well, and reduce quantization loss.

Pending Publication Date: 2022-01-18
BEIHANG UNIV
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This largely limits the use of point clouds on portable devices
Especially in autonomous driving scenarios, the computing power and storage capacity of on-board computing devices are often limited, which seriously restricts the application prospects of point cloud neural networks in this scenario.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Point cloud-oriented efficient binary neural network quantization method and device
  • Point cloud-oriented efficient binary neural network quantization method and device
  • Point cloud-oriented efficient binary neural network quantization method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The technical content of the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0032] Related studies have shown that the data structure of point clouds is fundamentally different from that of 2D images. The pixels of a 2D image are arranged in a regular matrix, which enables a convolutional neural network (CNN) to encode local features between adjacent pixels using convolution kernels. In the data structure of point clouds, the order of each point does not contain any information in terms of spatial similarity, so most binarization methods for solving 2D vision tasks cannot be simply transferred to point clouds.

[0033] On the other hand, the existing point cloud feature extractors usually have two common designs: first, the CNN kernel is replaced by a multi-layer perceptron (or fully connected layer), and the features are processed in the form of "points"; secondly, , using pooling layers to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a point cloud-oriented efficient binary neural network quantization method and a device. According to the method, an entropy-maximized aggregation function and a layer-by-layer scale recovery step are used, so that the point cloud neural network can achieve information entropy maximization, network weight and activation quantization loss minimization by minimizing a loss function in a training process, thereby reducing quantization loss and improving the performance of the binary point cloud neural network. The method is completely compatible with bitwise operation, and has the advantage of quickly deducing and quantifying the neural network. The fact shows that the method has excellent performance in various network architectures, is superior to the prior art in the aspects of memory consumption, reasoning speed and accuracy, and is particularly suitable for realizing target detection in an automatic driving scene so as to meet the real-time detection positioning requirement of an automatic driving vehicle.

Description

technical field [0001] The present invention relates to a high-efficiency binarization neural network quantification method for point clouds, and also relates to a target detection device that adopts the neural network quantification method for the needs of automatic driving scenes, and belongs to the field of deep learning technology. Background technique [0002] Point cloud, especially point cloud neural network, has received more and more attention in various computer vision applications, such as autonomous driving, augmented reality, etc. Traditional point clouds usually have massive parameters and high computational completeness, and the training and inference process for a single task takes a lot of time. The main reason for this problem is that the models that currently achieve the best results on various tasks generally use neural networks with full precision, which makes these models need to use a large amount of storage resources. At the same time, many applicati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/084
Inventor 刘祥龙秦浩桐丁一芙蔡中昂张明远
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products