The application discloses a
large model cloud end security reasoning
chip architecture based on hardware
encryption, which comprises a
client encryption terminal, a cloud end security reasoning
chip and a
key management service.The
client encryption terminal is integrated with a hardware encryption module, adopts a
hybrid encryption strategy, encrypts
user input data through a symmetric encryption
algorithm, and realizes the safe distribution of session keys through an asymmetric encryption
algorithm.The cloud end security reasoning
chip is a special ASIC chip, adopts a multi-stage pipeline architecture, and comprises a
ciphertext input
processing unit, a secure calculation area, a
ciphertext output
processing unit and a security control and root of trust.The secure calculation area is a physically isolated chip area, and the decrypted input data, model weights and intermediate calculation results are circulated between the secure on-chip cache and the calculation unit in the area.The security control and root of trust are integrated with a physically unclonable function to realize hardware identity
authentication.The
key management service is a distributed
key management system based on a PKI
system, and supports key rotation,
revocation and update operations.