Artificial neural network forward calculation apparatus and method supporting discrete data representation

A technology of artificial neural network and discrete data, which is applied in the calculation using number system representation, biological neural network model, electrical digital data processing, etc. It can solve the problems of large number of weights and precision of multi-layer neural network

Active Publication Date: 2017-10-27
CAMBRICON TECH CO LTD
View PDF7 Cites 60 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Because of the high precision and large number of multi-layer neural network weights, the representation of continuous data brings greater overhead in terms of operation and storage.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Artificial neural network forward calculation apparatus and method supporting discrete data representation
  • Artificial neural network forward calculation apparatus and method supporting discrete data representation
  • Artificial neural network forward calculation apparatus and method supporting discrete data representation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] Other aspects, advantages and salient features of the present invention will become apparent to those skilled in the art from the following detailed description of exemplary embodiments of the present invention when taken in conjunction with the accompanying drawings.

[0056] In the present invention, the terms "include" and "comprising" and their derivatives mean to include but not limit; the term "or" is inclusive, meaning and / or.

[0057] In this specification, the various embodiments described below to describe the principles of the present invention are illustrative only and should not be construed as limiting the scope of the invention in any way. The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of exemplary embodiments of the present invention as defined by the claims and their equivalents. The following description includes numerous specific details to aid in understanding, but these sh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an apparatus used for executing forward calculation of an artificial neural network and supporting discrete data representation. The apparatus comprises an instruction caching unit, a controller unit, a data access unit, an interconnection module, a master calculation module, a plurality of slave calculation modules, a discrete data calculation module and a continuous-discrete conversion module. By using the apparatus, the forward calculation of the multilayer artificial neural network supporting the discrete data representation can be realized; data such as weight values, neurons and the like in the forward calculation process can be represented in a discrete form; for example, -1, -1/2, 0, 1/2, 1 and the like are not continuous data; the module supporting discrete data calculation is provided; basic operations such as multiplication, addition and the like of the continuous data are replaced with different bit operations such as XOR operation, NOT operation and the like of the data according to discrete data values; the module for converting the continuous data into discrete data is provided; and batch normalization calculation is supported by utilizing the apparatus.

Description

technical field [0001] The present invention generally relates to artificial neural networks, and specifically relates to a device and method for performing forward operations of artificial neural networks. The data in the present invention support discrete data representation. And for discrete data, the basic operations of continuous data such as multiplication are replaced by bitwise operations such as XOR and negation. Background technique [0002] Multi-layer artificial neural networks are widely used in the fields of pattern recognition, image processing, function approximation, and optimization calculations. In recent years, multi-layer artificial networks have been favored by academic circles and researchers due to their high recognition accuracy and good parallelism. industry is getting more and more attention. [0003] A known method of supporting forward operation of multi-layer artificial neural networks is to use a general-purpose processor. The method supports...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/06
CPCG06F7/50G06F7/523G06F9/3001G06N3/061G06N3/063
Inventor 刘少礼于涌陈云霁陈天石
Owner CAMBRICON TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap