Systems and methods involving decoding / processing imagined sentences and / or discrete language via non-invasive brain / neural interfaces and / or other features

Abstract

Systems and methods are disclosed for direct, non-invasive brain-to-AI communication. Consistent with the disclosed technology, a user may silently imagine one sentence chosen from a predefined vocabulary while neural activity is captured with modalities such as high-density fNIRS, MEG. EEG, fMRI or HDDOT. According to other aspects, a machine-learning decoder may classify the neural data and output the corresponding sentence with real- or near-real-time latency. In certain illustrative implementations, the decoded sentence can be forwarded as a natural-language prompt to a large language model, for example, enabling bidirectional conversation, or serve as a discrete command for software, games, or assistive devices. Representative embodiments achieve above-chance accuracy in identifying complete imagined sentences and in detecting imagination onsets. Further, aspects of the disclosed technology provide a scalable, portable and surgery-free pathway to intuitive human-AI interaction, augmentative communication, and hands-free control interfaces.

Images