Trace ratio criterion-based triple loss function design method

A technology of loss function and design method, applied in neural learning methods, computing, computer components, etc., can solve problems such as insufficient model generalization ability and inability to achieve parameter self-adaptation

Active Publication Date: 2018-08-14
HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL
View PDF5 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method uses a fixed parameter α throughout the training process, which cannot achieve the adaptability of the parameters at each iteration, making the generalization ability of the final model insufficient.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Trace ratio criterion-based triple loss function design method
  • Trace ratio criterion-based triple loss function design method
  • Trace ratio criterion-based triple loss function design method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0048] The triplet loss function design method based on the trace ratio criterion of the present invention, the main innovative work is the following four parts: 1) triplet construction module; 2) triplet selection module; 3) loss function design module; 4 ) deep network training module. The first part constructs the triplet, and constructs the image data with class labels into the data form of the triplet. The second part selects triplets, uses the trace ratio criterion to limit the screening conditions, and selects an effective triplet set. The third part designs the loss function, improves the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a trace ratio criterion-based triple loss function design method. Through investigation and survey of image feature extraction, a triple loss function and a trace ratio criterion, the trace ratio criterion is used as a triple selection criterion and a loss calculation method. The method mainly comprises the steps of A, performing triple sample establishment: establishing triple samples by samples in a data set; B, performing triple sample selection: performing screening in the established triple samples, setting an effective selection mechanism, and while the precisionloss is avoided, increasing the training speed; C, performing loss function design: according to the triple samples obtained in the step B, calculating distances between current samples in triples andpositive and negative samples, and designing the loss function for calculating an error between a model prediction result and a real result; and D, performing deep network training: transmitting themodel error to a deep convolutional neural network, performing update adjustment on network parameters, and iteratively training a model until convergence.

Description

technical field [0001] The invention belongs to the field of loss function design, and in particular relates to a triplet loss function design method based on the trace ratio criterion. The method uses processed image data as the most original input. Background technique [0002] In recent years, with the rise of deep learning, computer vision technology based on convolutional neural networks has developed rapidly. The convolutional neural network is a common deep neural network, and its origin can be traced back to the proposal of the backpropagation algorithm. A conventional neural network consists of an input layer, a hidden layer, and an output layer. Each hidden layer contains several neurons, and each neuron is fully connected to the neurons in the previous layer. The convolutional neural network is different from the conventional neural network. For the case where the input is an image, the neurons in each layer of the network are arranged in three dimensions (width,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/084G06N3/045G06F18/214
Inventor 张海军赵鸣博朱理
Owner HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products