Systems and methods for implementing an intelligent application program interface for an intelligent optimization platform

Abstract

Systems and methods for implementing an application programming interface (API) that controls operations of a machine learning tuning service for tuning a machine learning model for improved accuracy and computational performance includes an API that is in control communication the tuning service that: executes a first API call function that includes an optimization work request that sets tuning parameters for tuning hyperparameters of a machine learning model; and initializes an operation of distinct tuning worker instances of the service that each execute distinct tuning tasks for tuning the hyperparameters; executes a second API call function that identifies raw values for the hyperparameters; and generates suggestions comprising proposed hyperparameter values selected from the plurality of raw values for each of the hyperparameters; and executes a third API call function that returns performance metrics relating to a real-world performance of the subscriber machine learning model executed with the proposed hyperparameter values.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]This application claims the benefit of U.S. Provisional Application No. 62 / 578,886, filed 30 Oct. 2017, which is incorporated herein in its entirety by this reference.TECHNICAL FIELDBackground[0002]Modern machine learning capabilities are rapidly changing and improving how some of the most complex and data-intensive computing problems are solved. A performance of a machine learning model is governed mainly in the manner(s) in which the machine learning model is trained and based on the hyperparameters of the machine learning model set prior to the training of the model. As referenced in passing the hyperparameters of the machine learning models are parameters whose values are set prior to the commencement of the machine learning process rather than derived by the machine learning model during training. Example include the number of trees in a random forest or the number of hidden layers in a deep neural net. Adjusting the values of the hy...

AI Technical Summary

Benefits of technology

The patent describes a system and method for improving the accuracy and performance of machine learning models by using an application programming interface (API) to control the operations of a machine learning tuning service. The system includes a distributed networked system and a host of tuning worker instances that execute various tasks to tune the hyperparameters of a machine learning model. The API receives a request to optimize the machine learning model and identifies raw values for hyperparameters generated by the tuning service. It then generates proposals for new hyperparameter values and returns performance metrics on the model's performance in a real-world setting. The technical effect of this patent is to provide a more efficient and effective way to improve the accuracy and performance of machine learning models.

Problems solved by technology

Adjusting the values of the hyperparameters of a machine learning model by any amount typically results in a large impact on a performance of the machine learning model.

However, many existing machine learning models are not implemented with optimal hyperparameters well-suited for achieving the best predictive performances.

Additionally, any existing system that enables optimization of hyperparameters of a machine learning model typically includes an extremely complex interface that may require significant coding capabilities and comprehension of the underlying software and hardware components of the system.

Thus, making it difficult to efficiently and effectively perform optimizations and subsequent improvements of the machine learning models.

Images