Cluster Memory Broadcast Control for Multi-PE Data Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Efficiently controlling memory access by a cluster of multiple processing units or processing elements in complex data processing systems is challenging, particularly in scenarios requiring time-efficient and energy-efficient interworking.
Innovation Solution
A Cluster Controller is introduced to manage memory access for a cluster of processing elements, initiating data broadcasting only after receiving requests from all participating elements, allowing independent operation and simultaneous data transfer without synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional memory access control is used for multiple processing elements, then data transfer can be performed, but data collisions occur and synchronization is required which reduces efficiency
Solution Approach 1:
The patent segments the memory access control by implementing separate request queues for different processing elements (PEs) within a cluster. Each PE has its own request queue that is independently managed by the cluster controller, allowing simultaneous request handling without conflicts. This segmentation eliminates the need for synchronization between PEs while maintaining orderly access to the shared cluster memory.
2Speed
If multiple processing elements access shared memory simultaneously, then data transfer speed increases, but data collisions occur causing errors
Solution Approach 1:
The patent implements preliminary action by establishing a predefined request queue structure for each processing element before data transfer begins. The cluster controller pre-allocates and manages separate queues for each PE, so when multiple PEs access the shared cluster memory simultaneously, their requests are already organized in dedicated queues. This preliminary organization prevents data collisions while maintaining high transfer speeds, ensuring both speed and reliability.
3Use of energy by moving object
If processing elements operate independently without synchronization, then energy consumption decreases, but coordinating memory access becomes complex
Solution Approach 1:
The patent implements self-service by enabling each processing element to independently manage its own memory access requests through its dedicated request queue. The cluster controller automatically retrieves requests from these queues and manages the actual memory access operations. This self-service mechanism allows PEs to operate independently without synchronization overhead, reducing energy consumption while the automated queue management handles the coordination complexity, effectively decoupling independence from complexity.
Data Source
Figure 1A~1B
Figure 1C~1D
Figure 2~5
AI summary
There is provided a Cluster Controller, CC, (16) configured to control memory access by a cluster of multiple processing units or processing elements, PEs, (18) to a common Cluster Memory, CM, (17) shared by the processing elements within the cluster. The Cluster Controller (16) is configured to receive requests, referred to as cluster broadcast requests, from at least a subset of the multiple processing elements (18) within the cluster for broadcasting of data from the common cluster memory (17) to said at least a subset of the multiple processing elements. The Cluster Controller (16) is configured to initiate broadcasting of data in response to the received cluster broadcast requests only after broadcast requests have been received from all processing elements of said at least a subset of said multiple processing elements (18) that are participating in the broadcast.