Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Parameter tuning method and system of machine learning algorithm

A machine learning and algorithm technology, applied in the field of machine learning, can solve problems such as multi-training time, high time overhead, complex genetic algorithm programming, etc., to achieve the effect of making full use of empirical data and easy operation

Inactive Publication Date: 2020-06-09
HARBIN INST OF TECH
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The disadvantage of using grid search for parameter tuning is that the candidate values ​​of the parameters are artificially set and cannot be fully "automated"; the selection of candidate values ​​depends on experience, requires users to have relevant background knowledge, and has not been fully utilized. User data sets; many models need to be trained, which takes a lot of time, especially when the number of parameters is large
[0005] The disadvantage of using genetic algorithm for parameter tuning is that because of the need to consider the solution to specific problems and the abstract relationship between chromosomes (and the process of encoding and decoding), the programming of genetic algorithm is more complicated; the genetic algorithm itself contains many hyperparameters, Such as crossover rate and mutation rate, and the selection of these parameters seriously affects the quality of the solution, and the selection of these parameters is mostly based on experience; the characteristics of the user data set cannot be used in time, so the search speed of the algorithm is relatively slow. A more accurate solution requires more training time; the algorithm is dependent on the selection of the initial population; the potential capacity of the parallel mechanism of the algorithm has not been fully utilized
[0006] Therefore, the shortcomings of the existing machine learning algorithm-related parameter tuning methods are: the user needs to set some candidate values ​​​​in advance, it cannot be "automated", and the user needs to have relevant background knowledge; the "traversal" approach is time-consuming.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Parameter tuning method and system of machine learning algorithm
  • Parameter tuning method and system of machine learning algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0038] It should be noted that, in the case of no conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other.

[0039] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments, but not as a limitation of the present invention.

[0040] Such as figure 1 As shown, the parameter tuning system of the machine learning algorithm of the present ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a parameter tuning method and system of a machine learning algorithm, which have the advantages of automation, rapidness, high efficiency and universality and belong to the field of machine learning. The method comprises the steps of S1, inputting a user data set and a to-be-adjusted parameter algorithm, and extracting features of the user data set; S2, finding a neural network of a to-be-adjusted parameter algorithm in a neural network database, inputting the features extracted in the step S1 into the neural network, and outputting parameters of the to-be-adjusted parameter algorithm by the neural network; wherein the neural network database comprises neural networks established and trained according to various machine learning algorithms, and the specific construction method comprises the following steps: constructing a knowledge base suitable for a data set of the machine learning algorithms; extracting features of each data set in the knowledge base; findingout optimal parameters for operating each machine learning algorithm on each data set; and establishing a neural network of each machine learning algorithm, and training the corresponding neural network by using the features of the data set and the corresponding optimal parameters as a training set to obtain a trained neural network.

Description

technical field [0001] The present invention belongs to the field of machine learning. Background technique [0002] Existing parameter tuning techniques related to machine learning algorithms mainly include grid search and genetic algorithm. Among them, grid search is to set some candidate values ​​for each parameter. When looking for the optimal combination of multiple parameters, each Combinations of candidate values ​​are traversed, multiple models are trained, and the combination of parameters in the model with the best performance is taken as the result. For example, the invention patent with the publication number CN107844837A "Method and System for Algorithm Parameter Tuning for Machine Learning Algorithms". [0003] The genetic algorithm selects a certain number of candidate solutions, abstracts them into chromosomes, selects some better solutions among the candidate solutions through fitness evaluation, and allows them to freely combine and mutate to generate the n...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N20/00G06N3/08G06N5/02
CPCG06N3/08G06N5/02G06N20/00
Inventor 王宏志欧龙燊张恺欣霸晨民陈泊舟
Owner HARBIN INST OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products