Unlock instant, AI-driven research and patent intelligence for your innovation.

Deep learning model optimization method and system based on high-level synthesis tool

A high-level synthesis and deep learning technology, applied in the field of deep learning model optimization based on high-level synthesis tools, can solve problems such as low flexibility, long development cycle, and inability to change, reducing hardware power consumption and improving throughput , the effect of shortening the delay

Pending Publication Date: 2021-12-10
SUN YAT SEN UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in actual use, it is easy to find that the power consumption of the GPU is serious, and the hardware design and development cycle of the ASIC accelerator is long, the cost is high, and the hardware is usually unable to be changed after the hardware is generated, and the flexibility is not high.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep learning model optimization method and system based on high-level synthesis tool
  • Deep learning model optimization method and system based on high-level synthesis tool
  • Deep learning model optimization method and system based on high-level synthesis tool

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] This embodiment proposes a deep learning model optimization method based on high-level synthesis tools. For the flow chart, please refer to figure 1 .

[0027] In the deep learning model optimization method based on high-level synthesis tools proposed in this embodiment, the following steps are included:

[0028] Step 1: Design a deep learning model based on the target function.

[0029] In this step, the input layer, convolution layer, pooling layer, output layer and other structures in the deep learning model are designed according to the target function points, and the parameters of the deep learning model are initialized.

[0030] Step 2: Obtain training samples, input the deep learning model for training, and obtain parameter weights of the deep learning model.

[0031] In this step, the training samples are obtained from the existing data set, and the test samples for verifying the deep learning model can be obtained at the same time.

[0032] Step 3: Expressin...

Embodiment 2

[0041] In this embodiment, the high-level synthesis tool-based deep learning model optimization method proposed in Embodiment 1 is applied to the optimization of the LeNet5 network.

[0042] First, the LeNet5 network model is designed according to the target function, and the existing LeNet5 network is modified accordingly. The structure diagram of the designed LeNet5 network model is as follows figure 2 shown. It includes input layer INPUT, convolutional layer C1, pooling layer S2, convolutional layer C3, pooling layer S4 and output layer OUTPUT.

[0043] Obtain 10,000 training samples from the MNIST data set and input them into the LeNet5 network model for training, and obtain the network parameter weights that complete the training. As shown in Table 1 below, it is the LeNet5 convolutional neural network parameters applicable to the MNIST data set in this embodiment.

[0044] Table 1. LeNet5 Convolutional Neural Network Parameters for MNIST Dataset

[0045]

[0046] F...

Embodiment 3

[0069] This embodiment proposes a deep learning model optimization system based on high-level synthesis tools. For the system architecture diagram, please refer to Figure 4 .

[0070] The deep learning model optimization system based on high-level synthesis tools proposed in this embodiment includes:

[0071] The deep learning model design module is used to design the deep learning model according to the target function;

[0072] A training module, configured to input training samples into the deep learning model for training to obtain parameter weights of the deep learning model;

[0073] A high-level language representation module, configured to represent the deep learning model in a high-level language according to the parameter weights of the deep learning model;

[0074] An optimization module, configured to optimize each layer of loops in the deep learning model;

[0075] High-level synthesis tools for co-simulating optimized deep learning models.

[0076] Among the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of deep learning, and provides a deep learning model optimization method and system based on a high-level synthesis tool, and the method comprises the following steps: designing a deep learning model according to a target function; obtaining a training sample, inputting the training sample into the deep learning model for training, and obtaining a parameter weight of the deep learning model; representing the deep learning model through a high-level language according to the parameter weight of the deep learning model; optimizing each layer of loop body in the deep learning model; and performing joint simulation on the optimized deep learning model through a high-level synthesis tool. According to the method, loop expansion and pipeline processing are carried out on the loop body in the deep learning model to shorten the time delay so as to improve the throughput of the system, so that the hardware power consumption of the deep learning model is reduced, and the deep learning model is converted through a high-level synthesis tool after being constructed through a high-level language, and the development period of hardware design can be effectively shortened.

Description

technical field [0001] The present invention relates to the technical field of deep learning, and more specifically, to a deep learning model optimization method and system based on high-level comprehensive tools. Background technique [0002] Deep learning (DL, Deep Learning) is a new research direction in the field of machine learning (ML, Machine Learning). It is introduced into machine learning to make it closer to the original goal-artificial intelligence (AI, Artificial Intelligence). Convolutional Neural Networks (CNN) has important research significance and application value in the fields of image classification and processing, video surveillance and machine vision. [0003] The core of the deep learning model is data processing, which includes a large number of computing operations. For example, the GoogleNet network model contains 1.55 billion floating-point operations, and the ResNet-152 network model contains 11.3 billion floating-point operations. This is not fr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/08G06N3/04G06F30/27G06F111/06
CPCG06N3/08G06F30/27G06F2111/06G06N3/045Y02T10/40
Inventor 陈弟虎陈家荣王自鑫粟涛胡炳翔陈润明黄俊龙
Owner SUN YAT SEN UNIV