Model as a service based on hybrid mixture of experts (MOE) architecture

Abstract

An example operation includes one or more of executing a plurality of machine learning (ML) models on questions to generate a plurality of outputs which include a plurality of chains of thought (COT), respectively, generating a mapping between a plurality of different types of tasks and the plurality of ML models, respectively, based on the plurality of COT, receiving a request to execute a predictive process that includes a plurality of sub-tasks, executing a software as a service (SaaS) ML model on the plurality of sub-tasks and the mapping to identify a subset of ML models from among the plurality of ML models for performing the plurality of sub-tasks, respectively, and generating a map that identifies which ML models will perform which sub-tasks, respectively, and an order in which the plurality of sub-tasks are to be executed during the predictive process.

Images