Neural network compiling optimization method and system

A neural network and optimization method technology, applied in the optimization method and system of neural network compilation, compiler and compilation process, can solve the problems of increasing memory burden, increasing system burden, and not significantly improving system execution efficiency
CN112711422APending Publication Date: 2021-04-27BEIJING TSINGMICRO INTELLIGENT TECH CO LTD
0 Cites 14 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Current Assignee / Owner
BEIJING TSINGMICRO INTELLIGENT TECH CO LTD
Publication Date
2021-04-27

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a neural network compiling optimization method. The method comprises the steps of obtaining a calculation graph with a set data structure according to a to-be-compiled deep learning model; fusing the one or more preprocessing layers into a plurality of fusion layers; obtaining an operator calculation sequence in the fusion layer according to the inter-operator dependency relationship in the fusion layer; obtaining input and output calling times and a splitting strategy of an in-layer operator; obtaining corresponding system overhead values of the plurality of fusion layers on the simulation hardware platform; taking the fusion layer corresponding to the minimum value in the system overhead values of the plurality of fusion layers as the current fusion layer; and compiling the to-be-compiled deep learning model according to the current fusion layer. By fusing multiple layers of operators of the neural network, a calculated intermediate result is stored on a chip instead of being read and written through a memory, so that the memory access requirement can be effectively reduced, and the execution efficiency of the system is improved. Meanwhile, the invention further provides an optimization system for neural network compilation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical field

[0001] The present invention relates to a reconfigurable processor and application field, and is applied to a compiler and compilation process of a reconfigurable compiler. The present invention specifically relates to an optimization method and system of neural network compilation.Background technique

[0002] Depth neural networks have been applied to multiple fields, such as face recognition, machine translation, recommendation system and other fields. With the improvement of the complexity of the depth neural network model, the complexity of the calculated complexity is also increased while obtaining a better effect on the corresponding task. In order to improve the calculation efficiency of the depth neural network, it can make the corresponding task more efficiently, and it is necessary to optimize the calculation of complex neural networks based on compilation optimization techniques of neural networks.

[0003] In the current computer architecture, the execution speed ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More