Generative model control for performing tasks using multiple generative models

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for controlling the participation of generative models in a multi-agent system. One of the methods includes receiving an input for a task to be processed by a group of generative models to generate a final output for the task; and processing the input by the group of the generative models across a plurality of steps, including: for each intermediate step, obtaining context data at the intermediate step; generating based on the context data, control data for a target generative model in the group; providing the context data and the control data to the target generative model in the group; obtaining an output from the target generative model generated in response to the context data and the control data; and updating the context data for the task based on the output from the target generative model.

Images