EEG-to-Text Communication Using Deep Learning and Generative AI

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional communication aids struggle to accurately interpret non-verbal cues, particularly in medical and caregiving environments, leading to inadequate care and delayed responses for individuals with neurological disorders or severe disabilities.

Innovation Solution

A system that utilizes EEG data processing, deep learning models, and generative AI to convert brain activity into natural language, ensuring real-time, secure, and accurate emotional or cognitive state analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional communication aids are used to interpret non-verbal cues, then the system is simple and easy to operate, but the measurement precision and reliability of emotional or cognitive state interpretation are insufficient

Engineering Contradiction:
Improveinterpretation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the complex task of emotional interpretation into distinct processing stages: EEG signal acquisition, preprocessing and noise removal, deep learning-based feature extraction and classification, and natural language generation. This segmentation allows each component to be optimized independently, achieving high measurement precision through specialized algorithms while managing overall system complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediate processing layers between raw EEG data and final interpretation results. A deep learning model acts as an intermediary to transform complex neural signals into meaningful emotional states, and a natural language generation system serves as another intermediary to convert these states into comprehensible text. These intermediaries bridge the gap between raw data and actionable insights, enhancing measurement precision without exposing the full complexity to end users.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If real-time EEG data processing is implemented, then the response speed improves, but the computational resources and processing time increase

Engineering Contradiction:
Improveresponse speedVSAvoidcomputational resource consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary actions by continuously preprocessing EEG data in real-time, including noise removal, artifact rejection, and feature extraction, before emotional analysis is actually needed. This allows the deep learning model to receive pre-processed, ready-to-analyze data, reducing computational burden during critical decision moments and enabling faster response times without excessive resource consumption during peak analysis periods.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements periodic processing cycles where EEG data is collected over specific time windows, processed through the deep learning model at regular intervals, and updated continuously. This periodic approach balances real-time responsiveness with computational efficiency, allowing the system to maintain accurate emotional state tracking while managing energy consumption through structured, interval-based processing rather than continuous full-scale analysis.

Inventive Principle:
Principle #19Periodic action

3Reliability

If secure communication protocols are applied to transmit EEG data, then the data security improves, but the transmission time and processing overhead increase

Engineering Contradiction:
Improvedata securityVSAvoidtransmission delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts and processes sensitive EEG data locally using the deep learning model before transmission, sending only the processed emotional state results or aggregated features to remote systems. This extraction approach maintains data security by minimizing the transmission of raw sensitive data, reduces transmission time by sending smaller data volumes, and preserves reliability through secure handling of essential information.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS20260047788A1system
Publication Date: 2026.02.19 SOFTBANK GROUP CORP
  • US20260047788A1 patent drawing
  • US20260047788A1 patent drawing
  • US20260047788A1 patent drawing

AI summary

System includes a processor that is configured to: collect EEG data obtained by an EEG measurement device, preprocess the collected EEG data and convert the data into a format suitable for analysis, input the preprocessed EEG data into a deep learning model to analyze emotions or thoughts, convert the analysis result into natural language using a generative AI model, and display the converted natural language.