The invention discloses an end-cloud
collaboration large model secret state operation method and
system, the method is applied to an end-cloud
collaboration trusted execution environment, and the application-end cloud
collaboration trusted execution environment comprises an end-side security access layer and a cloud-side secret calculation layer for deploying a TEE cluster. The method comprises the following steps:
terminal equipment negotiates with a cloud side
encryption layer through an end side security access layer to generate a
session key, and sends a first
ciphertext generated based on the
session key to a TEE cluster; and receiving a second
ciphertext formed by the TEE
cluster based on the first
ciphertext, and decrypting the second ciphertext to obtain an interaction result. According to the method,
large model secret state operation is carried out by utilizing a two-stage framework of an end side security access layer and a cloud side secret calculation layer, and cloud
large model service
privacy protection is realized. Meanwhile, the trusted execution environment constructed by the TEE and the heterogeneous AI expansion TEE is adopted, so that the large-model secret-state operation can be operated on a multi-architecture
server and a multi-type GPU, and the requirements of diversified deployment scenes are met.