A computing device based on Winograd convolution and a neural network processor including the same

A convolution operation and neural network technology, applied in the field of neural networks, can solve the problems of large computing resources and low computing efficiency, and achieve the effects of improving computing efficiency, reducing operating power consumption, and improving computing efficiency and resource utilization.

Active Publication Date: 2019-01-11
中科时代(深圳)计算机系统有限公司
View PDF9 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, researchers currently propose a Winograd-based convolution operation method, which can complete equivalent convolution operation tasks and greatly reduce the multiplication of the convolution operation process by performing specific matrix transformations on the input feature map and weights. However, there are differences between matrix conversion and dot multiplication in Winograd convolution. When independent dedicated computing modules are used to complete the corresponding tasks, huge computing resources are required and the computing efficiency is low.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A computing device based on Winograd convolution and a neural network processor including the same
  • A computing device based on Winograd convolution and a neural network processor including the same
  • A computing device based on Winograd convolution and a neural network processor including the same

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to make the purpose, technical solution, design method and advantages of the present invention clearer, the present invention will be further described in detail through specific embodiments in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0027] In the convolution calculation of the neural network, the Winograd convolution operation formula is:

[0028] F(m×n, r×s)=A T [[GgG T ]⊙[B T dB]]A (1)

[0029]Among them, m and n represent the side length of the neuron scale of the feature map output by a single Winograd convolution operation; r and s represent the side length of the convolution kernel; g represents the weight matrix input by a single Winograd convolution operation; d represents The feature map matrix input by a single Winograd convolution operation; A, G, and B are the corresponding transformation...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a convolution computing unit based on Winograd convolution and a neural network processor including the same. The convolution computing unit includes a multiplier, an accumulator and a first strobe, the multiplier is used for receiving an element to be multiplied by a matrix or an element to be multiplied by a matrix dot, The first strobe is configured to receive an output value from the multiplier and an element to be accumulated, and the convolution operation unit can be switched between a plurality of operating modes by controlling the first strobe to transfer the element to be accumulated or the output value of the multiplier to the accumulator. The convolution operation unit of the invention can be applied to the neural network processor to improve the calculation efficiency and reduce the running power consumption.

Description

technical field [0001] The present invention relates to the technical field of neural networks, in particular to a computing device based on Winograd convolution and a neural network processor comprising the device Background technique [0002] In recent years, deep learning technology has developed rapidly and has been widely used in solving advanced abstract cognitive problems, such as image recognition, speech recognition, natural language understanding, weather prediction, gene expression, content recommendation and intelligent robots, and has become an academic Research hotspots in the world and industry. [0003] Deep neural network is one of the perception models with the highest level of development in the field of artificial intelligence. It simulates the neural connection structure of the human brain by establishing a model, and describes the data characteristics hierarchically through multiple transformation stages, providing images, videos, audios, etc. Large-sc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/063G06N3/08G06F17/16G06F15/80
CPCG06F15/80G06F17/16G06N3/063G06N3/08G06N3/045
Inventor 韩银和闵丰许浩博王颖
Owner 中科时代(深圳)计算机系统有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products