Neural network operation device and method based on HMC

A neural network and computing device technology, applied in the computing field of neural networks, can solve problems such as data storage and transmission performance requirements, and achieve the effects of saving power consumption, accelerating computing, and reducing power consumption

Inactive Publication Date: 2018-07-06
SHANGHAI CAMBRICON INFORMATION TECH CO LTD
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Commonly used architectures proposed to improve DRAM storage delay include double data rate synchronous dynamic access random access memory (DDR3) and DDR4. Although they have improved data transmission rate a

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network operation device and method based on HMC
  • Neural network operation device and method based on HMC
  • Neural network operation device and method based on HMC

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0025] It should be noted that, in the drawings or descriptions of the specification, similar or identical parts all use the same figure numbers. Implementations not shown or described in the accompanying drawings are forms known to those of ordinary skill in the art. Additionally, while illustrations of parameters including particular values ​​may be provided herein, it should be understood that the parameters need not be exactly equal to the corresponding values, but rather may approximate the corresponding values ​​within acceptable error margins or design constraints.

[0026] Embodiments of the invention are described below, the representations of which are shown in the drawings, in which identical or similar referen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a neural network operation device. The device comprises an HMC memory module, at least one neural network processor which is connected with the HMC memory module, and an external access unit. The neural network processor is used for acquiring data and instructions required for neural network operations from the HMC memory module, carrying out neural network partial operations, and writing the operation result back to the HMC memory module. The external access unit is connected with the HMC memory module, reads neural network instructions and data required for neural network operations from an external designated address, inputs the instructions and data into the HMC memory module, and outputs the neural network operation result from the HMC memory module to the external designated address space. The invention further provides a neural network operation method. According to the invention, the requirements for data transmission and storage in the operation processof the neural network operation device can be effectively met, and the device and method have the advantages of high memory utilization, low power consumption overhead, low cost and fast data transmission rate.

Description

technical field [0001] The invention relates to the field of neural network computing, in particular to high-speed data transmission and high-performance storage during neural network computing. Background technique [0002] Neural network is currently widely used in video processing, image processing, speech recognition and optimization computing and other fields. Due to the parallelism and good performance in its own structure, the neural network has received extensive attention, and it is also subtly affecting people's lives. Due to the requirement of the neural network for the operation speed, a dedicated neural network device came into being. [0003] A large amount of data is needed in the process of neural network operation, and the storage and transmission of data has become a technical barrier in the process of neural network operation. How to make the transmission and storage of huge data efficiently during the operation of the neural network and reduce the memor...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/063G06F9/38G06F1/32
CPCG06F1/3287G06F9/3885G06F9/3893G06N3/063
Inventor 郭崎陈小兵刘少礼陈天石陈云霁
Owner SHANGHAI CAMBRICON INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap