A hyper-parameter optimization method and device in a machine learning model

A machine learning model and hyperparameter technology, applied in the field of artificial intelligence, can solve the problems of long time consumption, low efficiency, and the inability to manually adjust the parameter adjustment process, so as to achieve the effect of dynamic adjustment and efficiency improvement

Active Publication Date: 2019-05-28
TENCENT TECH (SHENZHEN) CO LTD
View PDF6 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the hyperparameter tuning request is single. The user pre-sets the hyperparameter search range and times. During this tuning process, the user cannot interact with the parameter tuning service system to dynamically adjust the hyperparameter search...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A hyper-parameter optimization method and device in a machine learning model
  • A hyper-parameter optimization method and device in a machine learning model
  • A hyper-parameter optimization method and device in a machine learning model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0043] In order to be concise and intuitive in description, the following describes the solution of the present application by describing several representative embodiments. A large number of details in the examples are only used to help understand the solution of this application. However, it is obvious that the implementation of the technical solution of the present application may not be limited to these details. In order to avoid unnecessarily obscuring the solution of the application, some implementation manners are not described in detail, but only a framework is given. Hereinafter, "including" means "including but not limited to", and "according to..." means "at least according to..., but not limited to only according to...". When the quantity of a component is not specifically indicated in ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a hyper-parameter optimization method in a machine learning model. The method comprises the steps of sending a task configuration file to a server, wherein thetask configuration file comprises a hyper-parameter, a first algorithm type and a parameter search range, and the server runs a hyper-parameter optimization task so as to calculate a candidate valueof the hyper-parameter according to the parameter search range and a first hyper-parameter optimization algorithm corresponding to the first algorithm type; obtaining a candidate value of the hyper-parameter from the server; verifying the candidate value of the hyper-parameter, and updating the task configuration file according to a verification result; sending the updated task configuration fileto the server, wherein the server continues to run the hyper-parameter optimization task according to the updated task configuration file, and a new candidate value is obtained; and after the operation of the hyper-parameter optimization task is finished, determining an optimal value of the hyper-parameter according to a verification result of each candidate value.

Description

Technical field [0001] This application relates to the field of artificial intelligence, and in particular to a method and device for optimizing hyperparameters in a machine learning model. Background technique [0002] When using machine learning to complete tasks such as image recognition and natural language processing, the machine learning model needs to be trained first. The training process includes the process of adjusting the parameters of the machine learning model. The parameters of the machine learning model mainly include hyperparameters and ordinary parameters. Among them, hyperparameters are parameters whose values ​​are set before starting the learning process, rather than parameter data obtained through training. Hyperparameters define higher-level concepts about the machine learning model, such as network depth, learning rate, etc., and the choice of hyperparameters has a great impact on the final effect of the machine learning model. [0003] In the process of ma...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N20/00
Inventor 徐绍勇黄维东
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap