Hyper-parameter tuning method and device and storage medium

A technology of storage media and hyperparameters, applied in the field of deep learning, can solve the problems of training accuracy and computing resources, reduce the accuracy of deep learning models, etc., achieve the effect of optimization and tuning, and meet the requirements of training accuracy

Pending Publication Date: 2021-06-22
SHANDONG YINGXIN COMP TECH CO LTD
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the above process, each set of hyperparameters needs to correspond to a deep learning model, and the training results are compared, so the requirements for computing resources are put ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hyper-parameter tuning method and device and storage medium
  • Hyper-parameter tuning method and device and storage medium
  • Hyper-parameter tuning method and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0097] As a preferred implementation, the tuning module specifically includes:

[0098] The first tuning unit is configured to perform parallel tuning of all hyperparameters if the amount of currently available computing resources is not less than a first preset threshold;

[0099] The second tuning unit is used for if the amount of currently available computing resources is less than the first preset threshold and greater than the second preset threshold, the hyperparameter tuning strategy is to perform parallel tuning on all hyperparameters and optimize Adopt early stop strategy in the process;

[0100] The third tuning unit is used for if the amount of currently available computing resources is not greater than the second preset threshold, the hyperparameter tuning strategy is to reduce the dimension of all hyperparameters, and adjust the hyperparameters after dimensionality reduction excellent;

[0101] Wherein, the first preset threshold is greater than the second prese...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a hyper-parameter adjustment and optimization method and device and a storage medium, and the method comprises the steps: carrying out the adjustment and optimization of a hyper-parameter adjustment and optimization strategy when the current available calculation resource is obtained because the corresponding relation between the resource quantity of the calculation resource and the hyper-parameter adjustment and optimization strategy is stored in advance; selecting the hyper-parameter tuning strategy corresponding to the currently available computing resources according to the corresponding relationship, and then turning the hyper-parameter according to the hyper-parameter tuning strategy. By applying the technical scheme, different hyper-parameter tuning strategies are selected according to available computing resources in a specific scene, the existing computing resources can be utilized to the maximum extent, the optimal tuning effect is achieved, and the requirement of training precision is met as far as possible.

Description

technical field [0001] The present application relates to the technical field of deep learning, in particular to a hyperparameter tuning method, device and storage medium. Background technique [0002] Currently, deep learning is being applied in various fields such as big data analysis, computer vision, and natural language processing. For complex problems in reality, deep learning models are often complex in structure and require a huge amount of data to train the network, and both training and reasoning require a large amount of computing resources to run quickly. [0003] The hyperparameter tuning of the deep learning model is to replace the expert experience with computing resources, set several hyperparameters to establish the deep learning model, train the deep learning model, and set the set of hyperparameters with the best effect of the deep learning model as the final hyperparameters. In the above process, each set of hyperparameters needs to correspond to a deep...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50G06N20/00
CPCG06F9/50G06N20/00
Inventor 于彤
Owner SHANDONG YINGXIN COMP TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap