A method and system for reducing edram refresh energy consumption in a neural network chip

A technology of neural network and neural network model, which is applied in the field of reducing energy consumption of eDRAM refreshing in neural network chips. It can solve the problems of large refreshing energy consumption, weakening the energy consumption gain of external storage access, etc., and achieve the effect of reducing refreshing energy consumption.

Active Publication Date: 2021-10-19
TSINGHUA UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The invention is used to solve the defect that the eDRAM type neural network chip in the prior art has relatively large refresh energy consumption and weakens the energy consumption benefit brought by the reduction of external storage access

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for reducing edram refresh energy consumption in a neural network chip
  • A method and system for reducing edram refresh energy consumption in a neural network chip
  • A method and system for reducing edram refresh energy consumption in a neural network chip

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] In order to make the technical features and effects of the present invention more obvious, the technical solutions of the present invention will be further described below in conjunction with the accompanying drawings. The present invention can also be described or implemented in other different specific examples. The equivalent transformations done within all belong to the protection category of the present invention.

[0020] In the description of this specification, descriptions referring to the terms "an embodiment", "a specific embodiment", "some implementations", "for example" and the like mean specific features, structures, materials described in conjunction with the embodiment or example. Or features are included in at least one embodiment or example of the invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or charact...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a method and system for reducing the energy consumption of eDRAM refreshing in a neural network chip. The method includes: training the original neural network model, determining the target neural network model with maximum fault tolerance and the target neural network model corresponding to the target neural network model. The data retention time of the eDRAM; scheduling each layer of the target neural network model, determining the computing mode of each layer and the data survival time of each layer under the lowest computing energy consumption; setting the target neural network model according to the The calculation mode of the layer is executed on the neural network chip. For the storage partition of each layer, if the storage partition does not store valid data or the data lifetime of this layer is less than the data retention time, the storage partition is not refreshed . The invention can remove unnecessary refreshing operations to the greatest extent, and greatly reduce energy consumption of eDRAM refreshing in neural network chips.

Description

technical field [0001] The invention belongs to the field of neural network chip acceleration, and in particular relates to a method and system for reducing energy consumption of eDRAM refreshing in a neural network chip. Background technique [0002] With the advent of the era of artificial intelligence, intelligent tasks such as image recognition, speech recognition, and natural language processing are ubiquitous in life. Neural networks have achieved world-leading results in such intelligent tasks and are widely used in the industry. For example, Baidu image search, Microsoft speech recognition and Google online translation, etc., are all implemented based on neural networks. Due to its regular calculation and large parallelism, the neural network needs and is especially suitable for using neural network chips to accelerate its calculation. However, due to the large amount of data and the limited internal memory capacity of the chip, a large number of external memory ac...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06N3/063G11C11/406
CPCG06N3/063G11C11/406
Inventor 尹首一涂锋斌吴薇薇刘雷波魏少军
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap