Calculation optimization method and device of shallow depth model based on systolic array

An optimization method and systolic array technology are applied in the field of calculation optimization of shallow-depth models, which can solve the problem of low utilization efficiency of systolic array structure and data transfer efficiency, and achieve the effect of improving utilization efficiency and improving transfer efficiency.

Pending Publication Date: 2021-11-26
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the calculation process based on the systolic array structure, the utilization efficiency of the systolic array structure, the transfer efficiency of moving the input data to the input buffer and taking the output data calculated by the systolic array from the output buffer corres

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Calculation optimization method and device of shallow depth model based on systolic array
  • Calculation optimization method and device of shallow depth model based on systolic array
  • Calculation optimization method and device of shallow depth model based on systolic array

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to make the objects, technical solutions, and advantages of the present disclosure more apparent, exemplary embodiments according to the present disclosure will be described in detail below with reference to the accompanying drawings. Apparently, the described embodiments are only some of the embodiments of the present disclosure, rather than all the embodiments of the present disclosure, and it should be understood that the present disclosure is not limited by the exemplary embodiments described here.

[0023] In this specification and the drawings, substantially the same or similar steps and elements are denoted by the same or similar reference numerals, and repeated descriptions of these steps and elements will be omitted. Meanwhile, in the description of the present disclosure, the terms "first", "second" and the like are only used to distinguish descriptions, and cannot be understood as indicating or implying relative importance or ranking.

[0024] Deep l...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a calculation optimization method and device for a shallow depth model based on a systolic array. By determining the standard input depth/standard output depth of the systolic array and the input depth and the output depth of the shallow depth model, determining the input splicing number and the output splicing number. And according to the input splicing number and the output splicing number value, splicing the input data and/or the corresponding output data so as to obtain the input data in batches and provide the input data to the systolic array in parallel, and/or caching a plurality of output data corresponding to the input data through an output buffer and then outputting the output data in batches, therefore, the migration efficiency of the input data and/or the output data can be improved, and the utilization efficiency of the systolic array can also be improved.

Description

technical field [0001] The present disclosure relates to the field of computers, and more particularly, to a calculation optimization method and device based on a shallow depth model of a systolic array. Background technique [0002] In the field of data processing, many data processing processes, such as deep learning processes, can be processed through convolutional neural networks (CNN), which require a large number of calculation steps, most of which are multiply-accumulate operations. [0003] Systolic array structures are currently used to implement a large number of multiply-accumulate operations. The systolic array structure includes computing units set at the nodes of each row and column (denoted by PE, each PE includes a multiplication accumulator or similar computing device, or a storage unit), the advantage lies in the operands involved in internal operations or intermediate The result can be performed in a high-speed parallel pipeline, that is, each piece of in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F30/27G06N3/063
CPCG06F30/27G06N3/063G06F15/8046G06F9/544
Inventor 于潇宇陈德炜章恒
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap