Embedded Associative Memory for Parallel Data Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional memory devices lack the capability to perform parallel data processing efficiently, leading to bottlenecks in processing large vectors of data, especially in applications requiring fast associative computations.

Innovation Solution

An integrated circuit device with a semiconductor substrate featuring an array of RAM cells and a computational section comprising associative memory cells, which allows for simultaneous access and associative computations, enabling fast parallel processing of large data vectors by integrating a microcontroller and interfacing circuitry to manage data transfers and operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional memory devices are used for data storage, then data storage capability is provided, but parallel data processing capability is insufficient

Engineering Contradiction:
Improveparallel data processing capabilityVSAvoidprocessing capability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent combines RAM cells and CAM cells into a single integrated memory device, merging storage and associative processing functions. The RAM array provides conventional storage while the embedded CAM array enables parallel associative computations, directly resolving the contradiction between storage capability and parallel processing capability.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The memory device is designed to perform multiple functions: conventional read/write operations via RAM cells and associative computations via CAM cells. This multi-functionality allows the single device to handle both data storage and parallel processing tasks, improving both productivity and adaptability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of time

If data is transferred from RAM to external processor, then processing can be performed, but time consumption increases

Engineering Contradiction:
Improvedata transfer timeVSAvoidprocessing speed
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The CAM array acts as an intermediary between the RAM array and external processors. It receives data from RAM, performs associative computations locally, and returns results, eliminating the need for complete data transfer to external processors and reducing time loss.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The CAM array performs preliminary associative computations on data before it needs to be processed externally. By pre-processing data in the memory device itself, the system reduces the burden on external processors and minimizes data transfer time.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If CAM cells are added to memory device, then associative computation capability is improved, but device complexity increases

Engineering Contradiction:
Improvecomputational capabilityVSAvoidmemory structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The memory device is segmented into distinct RAM and CAM arrays, each handling specific functions. The RAM array manages conventional storage operations while the CAM array handles associative computations. This segmentation allows complex computational capabilities to be added without overwhelming complexity in the entire memory structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The CAM array is nested within the RAM array structure, with CAM cells positioned between RAM cells in the same column. This nested arrangement allows the associative computation capability to be embedded within the existing memory architecture, minimizing the increase in overall device complexity.

Inventive Principle:
Principle #7Nested doll (Nesting)

4Productivity

If multiple access paths are provided, then simultaneous access capability is improved, but control complexity increases

Engineering Contradiction:
Improvesimultaneous access capabilityVSAvoidaccess control complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The memory device dynamically switches between different access modes: conventional RAM access mode for standard read/write operations and CAM access mode for associative computations. The controller adaptively selects the appropriate access path based on the operation type, managing complexity through dynamic rather than static multi-path design.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS8332580B2System, method and apparatus for memory with embedded associative section for computations
Publication Date: 2012.12.11 GSI TECHNOLOGY INC
  • US8332580B2 patent drawing
  • US8332580B2 patent drawing
  • US8332580B2 patent drawing

AI summary

An integrated circuit device includes a semiconductor substrate and an array of random access memory (RAM) cells, which are arranged on the substrate in first columns and are configured to store data. A computational section in the device includes associative memory cells, which are arranged on the substrate in second columns, which are aligned with respective first columns of the RAM cells and are in communication with the respective first columns so as to receive the data from the array of the RAM cells and to perform an associative computation on the data.