According to the distributed cooperative reasoning method oriented to the multi-
modal model, the overall execution steps are divided into an offline
preparation stage and an online reasoning stage, the offline
preparation stage part comprises the steps that a divisible part is recognized according to the
data dependency relationship in the multi-
modal model, meanwhile, the weight obtained through training is subjected to corresponding segmentation, and the divided part is divided into the divided part according to the
data dependency relationship in the multi-
modal model; the
feature extraction part of the multi-modal model is deployed to each end side device, the complete model is deployed to a center device receiving all data, and the multi-modal model is operated on each device in the
inference system to form offline segmentation configuration; the online reasoning stage part comprises the steps of completing reasoning total time
delay modeling, distributing a segmentation scheme and model reasoning, then distributing the optimal segmentation scheme of the model to each device by the central device, adjusting the actual operation part of the model by each device, and executing distributed reasoning calculation by each device based on a new model structure, so as to obtain the optimal segmentation scheme of the model. And finally, the central device merges the intermediate features transmitted by the devices to complete a distributed multi-modal reasoning task. According to the method, the optimal model distributed deployment scheme under the current bandwidth condition can be explained and output, and the reasoning time
delay is effectively reduced.