A data cache method, device and data transmission system

Abstract

The invention relates to a data cache method and device and a data transmission system. The data cache device comprises a first cache module, a second cache module and a third cache module, which areconnected in sequence, wherein the first cache module is connected with a random access memory; and the third cache module is connected with a data processor. The system depends on a data locality principle, so that a waiting problem caused by broadband mis-matching between random access memories and data processors is avoided, and on the basis of satisfying the data locality, the data reading / writing efficiency between a plurality of data processors and between the plurality of data processors and the random access memories is improved through mining parallel operation.

Description

Technical field[0001]The present disclosure relates to the field of data processing technology, and in particular to a data caching method, device and data transmission system.Background technique[0002]In the course of the development of computer systems in the past decade or so, the increase in computing power has far exceeded the increase in memory bandwidth, so the distance between memory performance and computing performance is gradually expanding. This is also a challenge commonly faced by deep neural network accelerators. The high-bandwidth local cache, which relies on the principle of data locality, can solve the mismatch between memory bandwidth and computing power to a certain extent.Summary of the invention[0003]The embodiments of the present disclosure provide a data caching method, device, and data transmission system. The technical solution is as follows:[0004]According to a first aspect of the embodiments of the present disclosure, there is provided a data caching devi...

AI Technical Summary

Problems solved by technology

This is also a challenge that deep neural network accelerators usually face

Images