Check patentability & draft patents in minutes with Patsnap Eureka AI!

Method and apparatus for adapting feature data in a convolutional neural network

A convolutional neural network and feature data technology, applied in neural learning methods, biological neural network models, neural architectures, etc., can solve problems such as limited high-speed memory capacity and inability to cache data, and achieve reduced data handling and efficient convolution operations Effect

Active Publication Date: 2020-09-01
NANJING HORIZON ROBOTICS TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to constraints such as cost, the capacity of high-speed memory is usually limited, so it may not be possible to cache all the data (e.g., feature data) of multiple layers of the convolutional neural network, resulting in high-speed memory relative to the access speed. Between other lower memories (for example, a random access memory coupled to a processor through a bus, or a storage such as a hard disk coupled to a processor or a computing device containing the processor through an interface or data lines) massive data transfer

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus for adapting feature data in a convolutional neural network
  • Method and apparatus for adapting feature data in a convolutional neural network
  • Method and apparatus for adapting feature data in a convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] Convolutional neural network is a multilayer structure. In each layer of the convolutional neural network, for the input feature data of the layer, use parameters related to the layer (for example, convolution parameters, etc.) to perform operations related to the layer (for example, convolution operations, etc.) , And provide the obtained output feature data as the input feature data of the next layer to the next layer for further processing, or in the case that the layer is already the last layer of the convolutional neural network, the obtained output feature The data is output as the final processing result of the convolutional neural network. For example, in the case of a residual convolutional neural network, the operation performed on the output feature data of a certain layer can also include the output feature data of the layer and the output of another layer or layers before the layer. The feature data performs an elementwise add operation.

[0022] The feature...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method and apparatus for adapting feature data in a convolutional neural network are disclosed. The method includes: selecting a plurality of consecutive layers; determining the expected number of sub-data blocks of the output feature data of the last layer and the layout position, width and height of each sub-data block; determining each sub-data of the input feature data of each layer The layout position, width and height of the block; determine the actual position of each sub-data block of the input feature data of the first layer; and according to the actual position, width and height of each sub-data block of the input feature data of the first layer, obtain the most The expected number of input subdata of the input feature data of the first layer. Through this method, the convolution operation of feature data of any size can be efficiently realized while effectively reducing a large amount of data transfer between the external memory and the processor.

Description

Technical field [0001] The present application generally relates to the technical field of artificial neural networks, and specifically relates to methods and devices for adapting feature data in convolutional neural networks. Background technique [0002] Deep learning technology based on convolutional neural networks has been widely used in different fields such as image recognition, video analysis, natural language processing, and driving assistance. It is expected that hardware such as a general-purpose central processing unit (CPU), graphics processing unit (GPU), or a dedicated accelerator can be used to efficiently perform operations in a convolutional neural network. [0003] The access speed of data is an important factor affecting the efficiency of computing. To this end, a high-speed memory such as a cache or on-chip memory may be provided for the processor (for example, a CPU, a GPU, or a dedicated accelerator) to cache at least a part of the data. However, due to lim...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/082G06N3/045G06N3/04G06N3/048G06F12/0875G06F17/15
Inventor 李建军黄畅陈亮凌坤李德林
Owner NANJING HORIZON ROBOTICS TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More