The invention provides a method and
system for enhancing the model reasoning speed, a storage medium and
electronic equipment. The method comprises the following steps: in each iteration of each functional layer in a plurality of functional
layers of a target model, executing an operation comprising the following steps: executing arithmetic logic of a current functional layer in a current iteration based on at least one processor, reading key value KV data generated by a next functional layer in a previous iteration before the current iteration in advance from a storage device, and loading the key value KV data into a memory; writing KV data generated by the
current function layer in the current iteration into a buffer area based on the operation logic of the
current function layer in the current iteration executed by the at least one processor; and writing all the KV data in the buffer area into the storage device based on the fact that the buffer area is full or the resource overhead is smaller than a reference value.