Sparse-Readout Reservoir Computing for Optical Communication Power Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The high power consumption of full readout layers in existing reservoir computing (RC) solutions for optical communication systems due to their large number of connections hinders efficient energy use.

Innovation Solution

Implementing a sparse-readout reservoir computing method, where neural network parameters are generated using an elastic linear regression method and sent to communication devices to configure a sparse readout layer, allowing for the switching off of devices corresponding to the sparse part of the readout layer, thereby reducing power consumption while maintaining good bit error rate (BER) performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a full readout layer is used in reservoir computing, then the equalization performance is improved, but the power consumption increases due to the large number of readout connections

Engineering Contradiction:
Improveequalization performanceVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent extracts only the necessary connections from the full readout layer by identifying and retaining significant weights while eliminating redundant ones. This is achieved through threshold-based pruning where connections below a certain weight threshold are removed, creating a sparse readout layer that maintains essential functionality while reducing power consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies local quality by making different parts of the readout layer have different properties - some connections are retained while others are pruned based on their individual weight magnitudes. This creates a heterogeneous structure where important connections remain dense while less important areas become sparse, optimizing the trade-off between performance and power consumption locally.

Inventive Principle:
Principle #3Local quality

2Use of energy by moving object

If a sparse readout layer is implemented, then the power consumption is reduced, but the complexity of configuring the sparse structure increases

Engineering Contradiction:
Improvepower consumptionVSAvoidconfiguration complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by pre-calculating the sparse structure configuration using elastic linear regression before deployment. The significant weights are identified and the sparse pattern is determined in advance through offline training, which simplifies the runtime configuration and reduces the complexity of setting up the sparse readout layer in the actual communication device.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary elastic linear regression model that acts as a bridge between the full readout layer and the sparse readout layer. This intermediary model is trained to learn the mapping relationships and generate the sparse configuration, thereby reducing the direct complexity of configuring the sparse structure in the communication device itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If elastic linear regression is used for training, then the training complexity is reduced, but the computational requirements for parameter generation increase

Engineering Contradiction:
Improvetraining complexityVSAvoidcomputational power
Core Design Contradiction:
Device complexityVSPower

Solution Approach 1:

The patent segments the training process into two distinct phases: an offline training phase where the elastic linear regression model is trained to generate sparse configurations, and an online deployment phase where the pre-trained model is used for inference. This segmentation allows complex training computations to be performed once offline, reducing the ongoing training complexity during actual device operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs the computationally intensive parameter generation and model training as a preliminary action before deployment. The elastic linear regression model is trained offline to learn the optimal sparse configurations, so that during actual communication device operation, only lightweight inference is required, reducing real-time computational power requirements.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP4266217A1Method, device and signal equalizer based on sparse-readout reservoir computing
Publication Date: 2023.10.25 NOKIA SOLUTIONS & NETWORKS OY
  • EP4266217A1 patent drawingFigure 1
  • EP4266217A1 patent drawingFigure 2(a)~2(b)
  • EP4266217A1 patent drawingFigure 3

AI summary

The objective of the embodiments of the present application is to provide a method, device and signal equalizer based on sparse-readout reservoir computing. Said method comprises the following steps executed by a first communication device: when a predetermined trigger condition is met, generating the neural network parameters corresponding to a second communication device using an elastic linear regression method based on the channel condition information reported by said second communication device; sending said neural network parameters to the second communication device in order for the second communication device to perform the relevant configurations of sparse-readout reservoir computing based on the neural network parameters. Said method comprises the following steps executed by a second communication device: performing the relevant configurations of the sparse-readout reservoir computing method based on the neural network parameters from a first communication device; accordingly switching off the devices corresponding to the sparse part of readout layer based on said relevant configurations, so as to train said reservoir computing based on the non-sparse part of readout layer.