The embodiment of the invention provides a model service method and device and a storage medium. It is proposed to build a plurality of service instances deployed for the model service as a
data transmission network. After the service instance receives the model calling request, whether model data needed by model loading exists in the local storage space or not can be inquired firstly, and if not, the needed model data can be remotely downloaded from other service instances on the basis of a
data transmission network, and the downloaded model data is stored in the local storage space. Therefore, model
data sharing can be realized based on the
data transmission network established among the plurality of service instances, and the network
transmission rate among the service instances in the data
transmission network is far higher than the back-to-source downloading rate, so that even if the service instance does not have the model data required for loading locally, the service instance can not be loaded locally. Model data can also be downloaded remotely from other service instances. Therefore, the model loading efficiency can be effectively improved, so that the response efficiency to the model calling request is improved.