Extended long short-term memory neural networks

WO2025168512A1PCT designated stage Publication Date: 2025-08-14NXAI GMBH +1

Patent Information

Application Number
PCT/EP2025/052727
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-05-07
Filing Date
2025-02-04
Publication Date
2025-08-14

Smart Images

  • Figure EP2025052727_14082025_PF_FP_ABST
    Figure EP2025052727_14082025_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed is a long short-term memory (LSTM) enhanced with exponential gating with appropriate normalization and stabilization techniques. Also disclosed are LSTM variants with modified memory structures: (i) sLSTM (104) with a scalar memory, a scalar update, and new memory mixing, and (ii) mLSTM (102) with a matrix memory and a covariance update rule, which is fully parallelizable.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Neural network memory for audio

    US20220415304A1

  • Recurrence in transformer architecture

    WO2023230058A1

Cited By

  • Distributed optical fiber sensor vibration identification method and system

    CN121524783A

  • Wind driven generator fault diagnosis method and system based on Mamba-ResNet

    CN121615089A

  • Hardware-optimized recurrent neural network system

    WO2026074103A1

  • Large recurrent action models for controlling robots and other technical systems

    WO2026074153A1