Recurrent Neural Network Decoding for Low-Latency ECC

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing error correction coding techniques in memory devices and wireless baseband circuitry increase processing complexity and resource usage, leading to inefficiencies in frequency, channel, and storage resource usage, particularly in applications requiring ultra-low power consumption and latency like IoT and tactile internet.

Innovation Solution

The use of multi-layer neural networks and recurrent neural networks for decoding encoded data, which leverage nonlinear mapping and distributed processing capabilities to reduce errors introduced by noise, such as bit flips in non-volatile memory devices, by transforming noisy encoded input data into decoded data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If complex error correction coding techniques are used to reduce errors in noisy environments, then reliability is improved, but device complexity and processing resources increase

Engineering Contradiction:
Improveerror correction capabilityVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing offline training of neural network decoders before actual decoding operations. During offline training, the neural network learns optimal decoding strategies for various error correction codes, storing pre-computed weight parameters. This pre-processing transfers complexity from real-time operation to offline preparation, reducing runtime processing requirements while maintaining high reliability in error correction.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If complex error correction coding techniques are used to reduce errors in noisy environments, then reliability is improved, but processing speed decreases

Engineering Contradiction:
Improveerror correction capabilityVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by performing offline training of neural network decoders before actual decoding operations. During offline training, the neural network learns optimal decoding strategies for various error correction codes, storing pre-computed weight parameters. This pre-processing transfers complexity from real-time operation to offline preparation, reducing runtime processing requirements while maintaining high reliability in error correction.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If traditional decoding methods are used to decode encoded data, then device complexity is reduced, but error reduction capability in noisy environments deteriorates

Engineering Contradiction:
Improveprocessing complexityVSAvoiderror reduction capability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent applies mechanics substitution by replacing traditional mechanical/error-prone decoding algorithms with neural network-based decoding. The neural network decoder uses learned weight parameters and nonlinear transformations to achieve superior error correction performance compared to conventional algebraic decoding methods, while the offline training phase prepares the network to operate efficiently during runtime.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Productivity

If offline training of neural networks is performed to transfer complexity, then processing speed during decoding is improved, but loss of time during training increases

Engineering Contradiction:
Improvedecoding speedVSAvoidtraining time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by performing offline training of neural network decoders before actual decoding operations. During offline training, the neural network learns optimal decoding strategies for various error correction codes, storing pre-computed weight parameters. This pre-processing transfers complexity from real-time operation to offline preparation, reducing runtime processing requirements while maintaining high reliability in error correction.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11424764B2Recurrent neural networks and systems for decoding encoded data
Publication Date: 2022.08.23 MICRON TECHNOLOGY INC
  • US11424764B2 patent drawing
  • US11424764B2 patent drawing
  • US11424764B2 patent drawing

AI summary

Examples described herein utilize multi-layer neural networks, such as multi-layer recurrent neural networks to decode encoded data (e.g., data encoded using one or more encoding techniques). The neural networks and/or recurrent neural networks have nonlinear mapping and distributed processing capabilities which are advantageous in many systems employing the neural network decoders and/or recurrent neural networks. In this manner, neural networks or recurrent neural networks described herein are used to implement error correction coding (ECC) decoders.