Compute-in-Memory Data Analysis via Segmented Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current compute-in-memory (CIM) devices face limitations in capability and efficiency due to short data paths and energy constraints, necessitating improved data processing and analysis capabilities within the memory array and input/output interface.
Innovation Solution
An integrated circuit with a memory array, input/output interface, and data path circuits that include buffer cells and computation circuits capable of parallel bit-by-bit logic operations, along with data analysis circuits to generate and analyze results, enabling efficient execution of multiple logic operations and data analysis within the memory array.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If logic operations are executed using circuits on the data path between memory array and input/output interface, then operation speed is improved, but capability and efficiency are limited due to short data paths
Solution Approach 1:
The data path is segmented into multiple functional zones: memory array region, computation circuit region with page buffers, and data analysis circuit region. Each segment performs specific functions (storage, computation, analysis) that were previously concentrated in a single short path, enabling both high speed and enhanced capability through distributed processing.
Solution Approach 2:
The invention extends the data path from a simple linear connection to a multi-dimensional architecture by adding vertical layers of computation and analysis circuits. Data can flow horizontally across the memory array and vertically through computation circuits and page buffers, creating a three-dimensional data processing space that increases both capability and efficiency.
2Productivity
If computation circuits are integrated into the data path, then processing capability is improved, but energy consumption increases
Solution Approach 1:
Computation circuits are merged with memory structures by integrating them directly into the data path between the memory array and input/output interface. This co-location eliminates the need for separate memory read operations followed by external processing, allowing data to be computed on-the-fly during normal memory operations, thereby improving productivity without proportionally increasing energy consumption.
Solution Approach 2:
The memory system performs computation and data analysis functions for itself through integrated circuits within its own data path. The computation circuits execute logic operations on data as it passes through the memory array, and data analysis circuits further process results without requiring external processing units, enabling the memory system to serve its own computational needs efficiently.
3Adaptability or versatility
If data analysis circuits are added to execute functions on results data page, then analytical capability is improved, but device complexity increases
Solution Approach 1:
The data analysis circuits are designed with multi-functionality to perform various analytical operations including logic operations, counting, and data comparison. These circuits can process different types of data (results data pages, buffer cell data) and execute multiple functions through configurable logic, thereby improving analytical capability without requiring separate dedicated circuits for each function, which would increase complexity.
Data Source
AI summary
A compute in memory device comprises a memory array including a plurality of data lines for parallel access to memory array data, and an input/output interface. Data path circuits between the memory array and the input/output interface include a page buffer, each buffer cell of the page buffer including a plurality of storage elements. A plurality of computation circuits is provided connected to respective buffer cells. The computation circuits execute a function of data in the storage elements of the respective buffer cells and can be configured in parallel to generate a results data page including operation results for the plurality of buffer cells. A data analysis circuit is connected to the data path circuits to execute a function of the results data page to generate an analysis result. A register can be provided to store the analysis result accessible via the input/output interface.


