The application relates to the technical field of
artificial intelligence, can be applied to a financial technology,
medical health and other business
system platform, and discloses a multi-
modal action model strategy optimization method, device, equipment and medium, the method comprises the following steps:
relationship analysis is carried out among acquired image data, language instructions and the behavior action sequence of a target user, relationship dependency is obtained, an initial multi-
modal action model is constructed in combination with initial training parameters, the initial multi-
modal action model is fine-tuned by using acquired task-specific data, a fine-tuned multi-modal action model is obtained, environment interaction data sets of a target environment are acquired, the environment interaction data sets are sampled one by one by using the fine-tuned multi-modal action model, a plurality of target interaction trajectories are generated, and the
selection strategy in the fine-tuned multi-modal action model is optimized, and a target
selection strategy is obtained. The application improves the
selection strategy accuracy of the multi-modal action model when the model faces new situations or insufficient data.