Unlock instant, AI-driven research and patent intelligence for your innovation.

Neural network model training method, device and system

A neural network model and neural network technology, applied in biological neural network models, neural learning methods, etc., can solve problems such as limited storage and computing resources, difficulty in improving convolutional neural network models, etc., and achieve the effect of increasing the number and improving performance

Active Publication Date: 2022-06-24
ALIBABA GRP HLDG LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a neural network model training method, device, and system to at least solve the problem of limited storage and computing resources of devices using convolutional neural network models in the prior art, making it difficult to improve the performance of convolutional neural network models. technical problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network model training method, device and system
  • Neural network model training method, device and system
  • Neural network model training method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0021] According to an embodiment of the present invention, an embodiment of a training method for obtaining a neural network model is also provided. It should be noted that the steps shown in the flowchart of the accompanying drawings may be implemented in a computer system such as a set of computer-executable instructions. and, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that herein.

[0022] The method embodiment provided in Embodiment 1 of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. figure 1 A block diagram of the hardware structure of a computer terminal (or mobile device) for implementing a training method for acquiring a neural network model is shown. like figure 1 As shown, the computer terminal 10 (or mobile device 10 ) may include one or more processors 102 (shown as 102a, 102b, . or a processing devic...

Embodiment 2

[0103] According to an embodiment of the present invention, there is also provided a training device for a neural network model for implementing the above training method for acquiring a neural network model, image 3 is a schematic diagram of a training device for a neural network model according to Embodiment 2 of the present application, such as image 3 As shown, the apparatus 300 includes:

[0104] The preprocessing module 302 is configured to preprocess the initial data according to different types of preprocessing models to generate multiple groups of training data, wherein the training data includes elements and labels corresponding to the elements, and each group of training data corresponds to a different probability distribution.

[0105] The expansion module 304 is configured to expand the multiple sets of training data to the neighborhood to obtain a linear neighborhood element corresponding to each element in each set of training data.

[0106] The determining m...

Embodiment 3

[0118] Embodiments of the present invention also provide a training system for a neural network model, including:

[0119] processor; and

[0120] a memory, connected to the processor, for providing instructions for the processor to perform the following processing steps:

[0121] The initial data is preprocessed according to different types of preprocessing models, and multiple sets of training data are generated, wherein the training data includes: elements and labels corresponding to the elements, and each set of training data corresponds to a different probability distribution;

[0122] Extend multiple sets of training data to the neighborhood to obtain linear neighborhood elements corresponding to each element in each set of training data;

[0123] Input the linear neighborhood elements into the neural network, and determine the loss function according to the output result of the neural network, wherein the loss function is used to characterize the degree of deviation be...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a training method, device and system of a neural network model. Wherein, the method includes: preprocessing the initial data according to different types of preprocessing models to generate multiple sets of training data, wherein the training data includes: elements and labels corresponding to the elements, and each set of training data corresponds to a different probability distribution; Expand multiple sets of training data to the neighborhood to obtain the linear neighborhood elements corresponding to each element in each set of training data; input the linear neighborhood elements into the neural network, and determine the loss function according to the output of the neural network, where, The loss function is used to represent the degree of deviation between the output result and the label corresponding to the element; based on the minimum value of the loss function, the network parameters of the neural network are obtained, wherein the network parameters of the neural network are used to represent the neural network model. The invention solves the technical problem that the devices using the convolutional neural network model have limited storage and computing resources in the prior art, which makes it difficult to upgrade the convolutional neural network model.

Description

technical field [0001] The present invention relates to the field of neural networks, and in particular, to a method, device and system for training a neural network model. Background technique [0002] Convolutional Neural Network (CNN) has been widely used in computer vision tasks, usually including data input layer, convolution calculation layer, excitation layer, pooling layer and fully connected layer. The most important layer of the convolutional neural network is to adjust the parameters of the convolutional neural network in order to improve the performance of the convolutional neural network model. [0003] However, a development trend of convolutional neural networks is to deploy to mobile embedded devices. The front-end host computer includes both embedded devices on the arm (Advanced RISC Machines, a RISC processor) platform, and FPGA (Field-Programmable Gate). Array, field programmable gate array) devices, all of which have a common feature, that is, storage an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06N3/08
CPCG06N3/08
Inventor 陈伟涛王洪彬李昊
Owner ALIBABA GRP HLDG LTD