Ai computation device and method

Abstract

A computation method and a computation device are disclosed. A vector similarity search is performed in the computational memory system based on a query input to identify a similar vector. The similar vector is transferred from the computational memory system to the GPU dedicated memory. The CPU provides an instruction to the GPU to perform an instruction processing operation. The GPU executes large language model computations to obtain a large language model computation result. The large language model computation result is transferred from the GPU back to the computational memory system.

Images