Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for performing convolution operation on neural network based on Winograd transform

A neural network and multiplication technology, which is applied in the field of devices and methods for Winograd transform convolution operations for neural networks, and can solve problems such as processing a large number of neural network operations.

Pending Publication Date: 2020-07-31
SAMSUNG ELECTRONICS CO LTD
View PDF1 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In some cases, processing the convolution operation of a neural network may require a large number of operations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for performing convolution operation on neural network based on Winograd transform
  • Method and device for performing convolution operation on neural network based on Winograd transform
  • Method and device for performing convolution operation on neural network based on Winograd transform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Some example embodiments involve, for example, by applying a Winograd transform to each of the input feature maps and weight kernels, applying element-wise multiplication and element-wise addition, and applying the inverse Winograd transform To the sum of the additions to produce the convolution sum as the output of the convolution operation, the convolution operation in the neural network is processed in the Winograd domain. Some example embodiments using such a process can accomplish convolution operations of neural networks with a reduced number of computations compared to direct convolution of untransformed input feature maps and weight kernels, such reductions can speed up neural network convolution operations completion of and / or reducing the amount of power consumed by the completion of such operations, for example, as will be referred to image 3 as shown. Some example embodiments include device architectures and / or neural network processing circuitry that may ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Some example embodiments may involve performing a convolution operation of a neural network based on a Winograd transform. Some example embodiments may involve a device including neural network processing circuitry that is configured to generate, by the neural network processing circuitry, a transformed input feature map by performing a Winograd transform on an input feature map, the transformed input feature map having a matrix form and including a plurality of channels; to perform, by the neural network processing circuitry, element-wise multiplications between a feature vector of the transformed input feature map and a weight vector of a transformed weight kernel obtained based on the Winograd transform; and to add, by the neural network processing circuitry, element-wise multiplicationresults, the element-wise multiplications being performed channel-by-channel with respect to the feature vector including feature values on a position in the plurality of channels of the transformedinput feature map.

Description

[0001] Cross References to Related Applications [0002] This application claims the benefit of Korean Patent Application No. 10-2019-0008603 filed with the Korean Intellectual Property Office on January 23, 2019, the disclosure of which is incorporated herein by reference in its entirety. technical field [0003] Some example embodiments of some inventive concepts may include methods, apparatuses, etc. for performing neural network convolution operations. Some example embodiments may relate to a method, an apparatus, etc. for performing a convolution operation of a Winograd transform-based neural network. Background technique [0004] A neural network refers to a computational architecture that is a model of a biological brain. As neural network technology has recently been developed, there have been numerous studies on obtaining effective information from input data based on at least one neural network model in various kinds of electronic systems. In some cases, processi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/063G06N3/04
CPCG06N3/063G06N3/045G06F17/144G06N3/048G06F17/153G06F7/5443G06N3/08G06N20/10G06N3/02
Inventor 朴峻奭
Owner SAMSUNG ELECTRONICS CO LTD