Neural network model training method and device

A technology of neural network model and training method, which is applied in the direction of biological neural network model and neural learning method, and can solve problems such as slow learning speed, insufficient model learning features, and low generalization ability

Pending Publication Date: 2021-04-16
SHENZHEN ORBBEC CO LTD
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present application provides a training method and equipment for a neural network model, which can solve the problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network model training method and device
  • Neural network model training method and device
  • Neural network model training method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0085] In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

[0086] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude one or more other Presence or addition of features, wholes, steps, operations, elements, components and / or collections thereof.

[0087] It should...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention is suitable for the technical field of machine learning, and provides a neural network model training method, which comprises the steps of inputting a training sample set into a preset student neural network model for processing to obtain first feature information, and calculating a first loss value according to the first feature information and a first loss function; inputting the training sample set into a preset teacher neural network model for processing to obtain fourth feature information, and calculating a second loss value according to the first feature information, the fourth feature information and a second loss function; determining a target loss value according to the first loss value and the second loss value; if the target loss value does not meet the preset stopping condition, updating the preset student neural network according to the target loss value; and if the target loss value meets the preset stopping condition, outputting the trained student neural network model. According to the invention, the training convergence condition of the neural network model can be effectively improved, so that the neural network can better learn features, and the recognition precision and generalization ability of the neural network are improved.

Description

technical field [0001] The present application belongs to the technical field of machine learning, and in particular relates to a training method and equipment for a neural network model. Background technique [0002] With the development of artificial intelligence, deep learning is increasingly showing its irreplaceability. During the training process, the loss function will be set in advance, and the characteristics of the data will be extracted by passing the training data to the preset neural network for forward propagation, and then the extracted features will be substituted into the loss function to calculate the loss value, and finally according to the loss value The preset parameters of the preset neural network model are updated by using the backpropagation algorithm. [0003] However, the loss function in the prior art generally adopts a single loss function, which will lead to insufficient features learned by the trained model or slow learning speed and low gener...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/08
Inventor 辛冠希黄源浩肖振中
Owner SHENZHEN ORBBEC CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap