Non-linear Activation in Memory Sensing Circuitry

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current memory systems face inefficiencies in processing operations due to the need for external processing resources and the inefficiencies of volatile memory types like DRAM, which require frequent refresh and consume power, especially when performing complex operations like those needed in machine learning.

Innovation Solution

Implementing a non-linear activation function in the sensing circuitry of memory systems, allowing for processing operations to be performed within the memory system without additional logic, such as sense amplifiers, by utilizing a non-linear reference voltage to compare charges and activate the sensing circuitry, thereby reducing the need for external processing and power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If processing operations are performed externally using separate processing resources, then processing capability is provided, but processing efficiency deteriorates due to data transfer and coordination overhead

Engineering Contradiction:

Improveprocessing efficiencyVSAvoidsystem architecture complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent merges processing functionality directly into the memory system by implementing activation functions within the memory device itself. This integration eliminates the need for separate processing resources and reduces data transfer overhead between memory and processing units, thereby improving processing efficiency while maintaining manageable system complexity through unified architecture.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The memory device is designed to perform multiple functions: traditional data storage and retrieval, as well as processing operations through implemented activation functions. This multi-functionality allows the same hardware resource to serve both memory and processing roles, improving overall system productivity without requiring additional dedicated processing components.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Speed

If volatile memory like DRAM is used for processing operations, then fast access is achieved, but power consumption increases due to frequent refresh requirements

Engineering Contradiction:

Improveaccess speedVSAvoidpower consumption

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

The patent implements non-linear activation functions that change the operational parameters of the memory device. By performing processing operations within the memory device using these activation functions, the system can utilize the fast access characteristics of volatile memory while reducing the frequency and impact of refresh operations, thereby lowering overall power consumption compared to traditional external processing approaches.

Inventive Principle:

Principle #35Parameter changes

3Adaptability or versatility

If additional logic components are added to perform processing operations, then processing capability is enhanced, but device complexity and cost increase

Engineering Contradiction:

Improveprocessing capabilityVSAvoidlogic circuit complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The memory device performs processing operations on its own data without requiring external processing resources. By implementing activation functions within the memory device, the system enables self-service processing that enhances adaptability while avoiding the complexity and cost of additional logic components.

Inventive Principle:

Principle #25Self-service

4Productivity

If processing operations are performed within the memory system using sensing circuitry, then external processing dependency is reduced, but sensing circuitry functionality must be extended

Engineering Contradiction:

Improveinternal processing efficiencyVSAvoidsensing circuitry complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The sensing circuitry is designed to perform its traditional sensing function while also implementing processing operations through activation functions. This multi-functionality allows the same circuitry to serve both sensing and processing roles, improving internal processing efficiency without requiring completely separate processing hardware that would increase overall system complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS10885970B2Non-linear activation for sensing circuitry

Publication Date: 2021.01.05 MICRON TECHNOLOGY INC

AI summary

Systems, apparatuses, and methods related to processing operations in a memory array are described. Sensing circuitry within a memory array may, for example, employ a non-linear activation function to perform certain operations, including processing or basic processing functions. A memory array can include multiple cells each coupled to respective sense lines and select lines. Sensing circuitry of the array may receive a charge from each of the cells via the sense lines and determine whether an aggregate charge of the is greater than a threshold. The sensing circuitry may then take certain actions, or refrain from taking certain actions depending on whether the aggregate charge is greater or less than the threshold. A non-linear reference voltage may be employed to manage or implement the non-linear activation function.