Cluster device for gpu and internal cache management method thereof

Abstract

The application discloses a cluster device for a GPU and an internal L1 cache management method thereof. The cluster device comprises: a plurality of stream processors connected with a crossbar switch; the crossbar switch has a plurality of input ports and a plurality of output ports, the plurality of input ports are connected with the plurality of stream processors respectively, the plurality of output ports are connected with the plurality of stream processors and an on-chip interconnection network of the GPU respectively, and the crossbar switch is used for communication between the plurality of stream processors and between the plurality of stream processors and the on-chip interconnection network; and an L1 index routing module arranged in the crossbar switch, which is used for calculating an index of a corresponding L1 cache according to an address of a memory access request sent by a stream processor received by the crossbar switch, and sending the memory access request to the stream processor containing the corresponding L1 cache through the crossbar switch. The application can realize L1 cache sharing of each stream processor in the cluster device, fully utilize L1 cache resources in the GPU, and improve the performance of the stream processor and the GPU.

Images