Extended Memory Operations in Computing Tile
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current memory operations require multiple clock cycles and function calls, leading to increased processing time and resource consumption, especially as data storage capacity increases, and often necessitate data movement and locking mechanisms that can hinder performance.
Innovation Solution
Extended memory operations are performed within a computing tile using a single address and operand, allowing operations like floating-point add accumulate without the need for intervening commands, reducing function calls and data movement, and enabling broader type fields and parallel processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If current memory operations are performed with multiple clock cycles and function calls, then data can be processed, but processing time and resource consumption increase
Solution Approach 1:
The patent combines multiple memory operations into a single extended memory operation that can be specified by a single address and operand. This merging eliminates the need for multiple function calls and intermediate data movements, directly reducing processing time while maintaining data processing capability
Solution Approach 2:
The patent performs data processing operations preliminarily within the memory device before data is moved to the host. By performing operations like floating-point add accumulate within the memory tile, the system reduces the amount of data that needs to be transferred and processed externally, thereby reducing overall processing time
2Ease of operation
If data movement and locking mechanisms are used in current memory operations, then operations can be performed, but performance is hindered
Solution Approach 1:
The patent enables the memory device to perform operations autonomously using its own internal resources. The memory tile can perform extended memory operations on stored data without requiring external intervention, data movement to host memory, or locking mechanisms, thereby eliminating performance bottlenecks while maintaining operational simplicity
Solution Approach 2:
The patent extracts the data processing functionality from the host system and places it directly within the memory device. By taking out the processing operations from the external system and embedding them in the memory tile, the invention eliminates the need for data movement and locking mechanisms that would otherwise be required, thus improving performance
Data Source
AI summary
Systems, apparatuses, and methods related to extended memory operations are described. Extended memory operations can include operations specified by a single address and operand and may be performed by a computing device that includes a processing unit and a memory resource. The computing device can perform extended memory operations on data streamed through the computing tile without receipt of intervening commands. In an example, a computing device is configured to receive a command to perform an operation that comprises performing an operation on a data with the processing unit of the computing device and determine that an operand corresponding to the operation is stored in the memory resource. The computing device can further perform the operation using the operand stored in the memory resource.