The invention provides an efficient AI
model management and safe loading
system and method oriented to a Serverless framework, and aims to solve the high
concurrency performance
bottleneck and potential safety hazards of AI model loading in a Serverless environment. According to the
system, an AI
model management module is introduced, efficient semantic
cutting is carried out on an uploaded AI model, and fine-grained
encryption model blocks are generated; a high-performance P2P network is constructed by utilizing a Serverless cluster, and distributed storage and fast routing of model blocks are realized; a function instance loads a model block in a high-
concurrency mode through a P2P network, a multi-stage intelligent cache is constructed locally, and dynamic caching and prefetching are achieved. According to the method, the model loading parallelism degree is improved by adopting a
heuristic cutting algorithm, lightweight model updating is realized by utilizing incremental updating transactions, and the loading overhead is minimized. According to the method, the AI model loading performance and efficiency in the Serverless scene are effectively improved, meanwhile, the flexibility and safety of
model management are considered, and the method has remarkable
technical innovation and practical value.