Neural biometric authentication system and method
Patent Information
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- DOTSIFY
- Filing Date
- 2024-06-28
- Publication Date
- 2026-05-06
AI Technical Summary
Current user authentication methods, such as multiple account credentials and external device-based biometrics, lead to user burden, security risks, and inefficiencies for service providers, while existing biometric systems are vulnerable to spoofing and require specialized hardware.
A neural biometric authentication system that uses a receiving module to capture neural data, an encoding module to generate user representative synthetic data and individual biometric identifiers using generative models, and a recognition module to authenticate users based on these identifiers, eliminating the need for multiple credentials and leveraging internal brain signals for secure authentication.
Provides a secure, universal, and efficient user authentication method that reduces user burden and enhances security by utilizing unique neural signatures, eliminating the need for external devices and promoting strong authentication practices.
Smart Images

Figure EP2024068367_02012025_PF_FP_ABST
Abstract
Description
NEURAL BIOMETRIC AUTHENTICATION SYSTEM AND METHOD FIELD OF INVENTION
[0001] The present invention relates to the general field of biometric identification, particularly to a neural biometric authentication system and method for providing a secure, user-specific multimedia experience using individual neural signatures. BACKGROUND OF INVENTION
[0002] In today's digital era, online platforms and services have become an inseparable part of our everyday life. Users engage with a myriad of websites, applications, and services that necessitate authentication and access control. As it stands, the most prevalent method of user authentication is based on the creation and management of multiple accounts across diverse platforms, each with its unique login credentials (for example, usernames and passwords). This fragmented approach leads to several challenges and inconveniences for both users and service providers.
[0003] Existing Limitations and Challenges:
[0004] User Burden: Users face the challenge of remembering multiple usernames and passwords for different services, leading to password fatigue, increased security risks, and a higher likelihood of forgotten credentials. This burden discourages users from engaging with new platforms and can result in a poor user experience.
[0005] Security Risks: Many users resort to using weak passwords or reusing passwords across multiple services due to the difficulty of managing multiple credentials. This practice poses significant security risks, as a data breach on one platform can expose user accounts on other services.
[0006] Inefficiency for Service Providers: Managing user accounts, authentication systems, and password-related support requests can be resource-intensive for service providers. Additionally, they may face challenges in ensuring consistent security practices across their user base.
[0007] Thus, there is a clear need for a universal login system that addresses the limitations and challenges mentioned above.
[0008] Current methods of user recognition, such as facial recognition and voice recognition, often require the use of external devices, such as cameras or microphones. Palm print requires palmprint scanner or palmprint reader. Fingerprint requires fingerprint sensors. Retinal scanning requires a retinal scanner. Iris recognition requires an iris scanner, typically an electronic device equipped with a specialized camera and subtle infrared light. These methods can also be vulnerable to spoofing and other security threats.
[0009] Thus, there is also a need for a universal login system that uses physiological data measured directly from the users to recognize them and grant access to their digital space. SUMMARY
[0010] The present invention relates to neural biometric authentication system for securely authenticating a user , the system comprising: • a receiving module configured to receive biometric data of said user, said biometric data comprising at least neural data {Nr} of said user, said neural data {Nr} comprising at least one neural signal SN function of time and of at least one channel, said at least one channel covering a predefined area of said user’s head; • an encoding module comprising: - an augmentation module configured to generate user representative synthetic data {Ns} by using at least one first generative model configured to receive as input said received neural data {Nr}, wherein said at least onefirst generative model has been previously pre-trained on neural data obtained from a plurality of subjects at different mental states, from different recording devices, and acquired by at least two channels; - an identity – ID – generating module configured to generate a set of individual biometric identifiers – IBI – comprising at least one first individual biometric identifier – IBI –, said at least one first IBI being generated from at least said generated user representative synthetic data {Ns} and said received neural data {Nr} using a biometric identity – ID – model, said biometric ID model being a previously trained Transformer- based model; • a recognition module comprising an identity – ID – management module configured to, depending on a predetermined condition: - compare said set of individual biometric identifiers – IBI to at least one user’s signature stored in a memory (and output an authentication result; or - save said set of individual biometric identifiers – IBI as at least one user’s signature in said memory.
[0011] According to other advantageous aspects of the invention, the system comprises one or more of the features described in the following embodiments, taken alone or in any possible combination.
[0012] According to one embodiment, said at least one generative model is configured for generating said user representative synthetic data {Ns} comprising synthetic neural signals function of time and of at least one synthetic channel, said at least one synthetic channel covering an area of said user’s head different from said specific area covered by said at least one channel of said received neural data {Nr}.
[0013] According to one embodiment, said at least one generative model is a Generative Adversarial Network – GAN – based model using a convolutional neural network architecture, said at least one generative model being fine-tuned with an enrollment dataset, and wherein said enrollment dataset comprises recording neural data of said user at various mental states and / or at various times of a day.
[0014] According to one embodiment, said biometric data further comprises physiological data {P} and / or anatomical data {A}.
[0015] According to one embodiment, the identity – ID – generating module is further configured to generate: • a second IBI obtained from said physiological data {P}and / or a third IBI obtained from said anatomical data {A}, wherein the second IBI and / or the third IBI are comprised in the set of IBI; and / or • a first mixed IBI obtained from a combination of at least said at least one first IBI being generated from said user representative synthetic data {Ns} and said received neural data {Nr}, said second IBI obtained from said physiological data {P} and / or said third IBI obtained from said anatomical data {A}, wherein the first mixed IBI is comprised in the set of IBI.
[0016] According to one embodiment, the system further comprises: • a pre-processing module configured to: - pre-process said received biometric data (20) by applying at least one of: a bandpass filter, an alignment, an artifact removal, and / or a standardization; - analyze said received biometric data (20), respectively said pre- processed biometric data when available, and compute a quality parameter; and / or wherein the augmentation module is configured to receive said pre-processed and / or analyzed neural data {Np / a} and, to generate said user representative synthetic data {Ns} by using said pre-processed and / or analyzed neural data {Np / a} instead of the received neural data {Nr}.
[0017] According to one embodiment, the system further comprises: • a transmission module configured to encrypt each individual biometric identifier – IBI – of the set of IBI and transmit each encrypted IBI through a communication network; • a decrypting module configured to receive and decrypt each encrypted IBI;wherein, depending on said predetermined condition, said ID management module is configured to: • compare each decrypted IBI to at least one user’s signature stored in said memory and output the authentication result; or • save said each decrypted IBI as at least one user’s signature in said memory.
[0018] According to one embodiment, the system further comprises a conversion module configured to convert at least one among said neural data {N}, said physiological data {P}, and said anatomical data {A}, into respectively a neural converted data, a physiological converted data and / or anatomical converted data, wherein said neural converted data is a 1D or 2D representation of said neural data {N}, said physiological converted data is a 1D or 2D representation of said physiological data {P} and said anatomical converted data is a 1D or 2D representation of said anatomical data {A}.
[0019] According to one embodiment, wherein: • the augmentation module (230) further comprises at least one second generative model configured to receive as input the at least one converted data representative of said neural data {N} and to generate second user representative synthetic data {Is}; and • the identity – ID – generating module (250) is further configured to generate: i. a first complex IBI obtained from said second user representative synthetic data {Is} and the at least one converted data representative of said neural data {N}, the first complex IBI being comprised in the set of IBI; and / or ii. a second complex IBI obtained from the at least one converted data representative of said physiological data {P} and / or a third complex IBI obtained from the at least one converted data representative of said anatomical data {A}, the second complex IBI and the third complex IBI being comprised in the set of IBI; and / oriii. a second mixed IBI obtained from a combination of at least said first complex IBI, and at least one among said second complex IBI and third complex IBI, the second mixed IBI being comprised in the set of IBI.
[0020] According to one embodiment, the system further comprises: • a fusion module configured to merge the at least two among converted data obtained for said neural data {Nr}, said physiological data {P}, said anatomical data {A} into a unique converted data {INPA} by using at least one fusion model, said unique converted data being a 1D or 2D representation of a combination of said neural data {N}, said physiological data {P} and / or said anatomical data {A}, wherein, the identity – ID – generating module is further configured to generate, depending on a third configuration parameter: • at least one conjugated IBI obtained from said unique converted data, the at least one conjugated IBI being comprised in the set of IBI; and / or • a third mixed IBI obtained from a combination of at least said user representative synthetic data {Ns} and said neural data {Nr}, and said unique converted data, the third mixed IBI being comprised in the set of IBI.
[0021] According to one embodiment, the physiological data {P} comprise at least one of: a first optical signal and / or an electrical signal representative of a measurement of a vascular or muscular function of the user, such as a photoplethysmyography or an electromyography, and / or a first acoustic signal such as a bioacoustics-based signal like the user’s voice, coming from at least one specific physiological sensor.
[0022] According to one embodiment, the anatomical data {A} comprise at least one of: a second optical signal and / or a second acoustic signal representative of morphologic information or density information relative to the user, such as a broadband ultrasound attenuation, quantitative ultrasounds, bioacoustics-based techniques, a computed-tomography image or a magnetic resonance image, coming from at least one specific anatomical sensor.
[0023] According to one embodiment, the receiving module is also configured to receive at least one external user identifier {EID}, and wherein the ID generating module is configured to generate a combined individual biometric identifier by combining said at least one individual biometric identifier to said at least one external user identifier {EID}.
[0024] According to one embodiment, said ID management module is further configured to send to a recipient an information signal representative of said authentication result, said recipient being said user or an external user interface, and said information signal being at least one of: a visual signal, an auditory signal, a kinesthetic signal, an olfactory signal, a gustative signal.
[0025] According to one embodiment, the system further comprises a stimulation module configured to control an external stimulation device configured to deliver to said user at least one sensory stimulus, said sensory stimulus being at least one of: a visual stimulus, an auditory signal, a kinesthetic signal, an olfactory stimulus; and wherein the receiving module is further configured to receive a feedback signal from said user in response to said at least one delivered sensory stimulus.
[0026] According to one embodiment, wherein the system is embedded in an apparatus, said apparatus being one of: an earbud or earphone, a headband, an earring, a headset such as an augmented Reality – AR - headset, a Virtual Reality – VR - headset, a Mixed Reality – MR - headset, smart glasses.
[0027] According to another aspect, the present invention relates to a neural biometric authentication system for securely authenticate a user, the system comprising: - a receiving module configured to receive biometric data of said user, said biometric data comprising at least neural data {N} of said user, said neural data {N} comprising at least one neural signal SN function of time and of at least one channel, said at least one channel covering a specific area of said user’s head; - an encoding module comprising:o an augmentation module configured to generate user representative synthetic data {Ns} by using at least one generative model configured to receive as input said received neural data {Nr}, wherein said at least one generative model has been previously pre-trained on neural data obtained from a plurality of subjects at different mental states, from different recording devices, and acquired by at least two channels; o an identity – ID – generating module configured to generate at least one individual biometric identifier – IBI – from at least said generated user representative synthetic data {Ns} using a biometric identity – ID – model, said biometric ID model being a Transformer-based model; - a recognition module comprising an identity – ID – management module configured to, depending on a predetermined condition: o compare said at least one IBI to at least one user’s signature stored in a memory and output an authentication result; or o save said at least one IBI as at least one user’s signature in said memory.
[0028] According to other advantageous aspects of the disclosure, the system comprises one or more of the features described in the following embodiments, taken alone or in any possible combination:
[0029] said at least one generative model is configured for generating said user representative synthetic data {Ns} comprising synthetic neural signals function of time and of at least one synthetic channel, said at least one synthetic channel covering an area of said user’s head different from said specific area covered by said at least one channel of said received neural data {Nr};
[0030] said at least one generative model is a Generative Adversarial Network – GAN – based model using a convolutional neural network architecture, said at least one generative model being fine-tuned with an enrollment dataset, and wherein said enrollment dataset comprises recording neural data of said user at various mental states and / or at various times of a day;
[0031] when the biometric data (20) received comprises more modalities in addition to neural data {N}, such as physiological data {P} and / or anatomical data {A}, and depending on a first configuration parameter, said at least one individual biometric identifier – IBI – generated by the identifier ID generating module (250) comprises: - a first IBI obtained from at least said user representative synthetic data {Ns} and, at least a second IBI obtained from said physiological data {P}and / or said anatomical data {A}; and / or - a first mixed IBI obtained from a combination of at least said user representative synthetic data {Ns} and, said physiological data {P} and / or said anatomical data {A};
[0032] the system further comprises a pre-processing module configured to: pre-process said received biometric data by applying at least one of: a bandpass filter, an alignment, an artifact removal, and / or a standardization; analyze said received biometric data, respectively said pre-processed biometric data when available, and compute a quality parameter; and / or wherein the augmentation module is configured to receive said pre- processed and / or analyzed neural data {Np / a} and, to generate said user representative synthetic data {Ns} by using said pre-processed and / or analyzed neural data {Np / a} instead of the received neural data {Nr};
[0033] the system further comprises: - a transmission module configured to encrypt said at least one individual biometric identifier – IBI – and transmit the at least one encrypted IBI through a communication network; - a decrypting module configured to receive and decrypt said at least one encrypted IBI; wherein, depending on said predetermined condition, said ID management module is configured to: o compare said at least one decrypted IBI to at least one user’s signature stored in said memory and output the authentication result; or o save said at least one decrypted IBI as at least one user’s signature in said memory;
[0034] the system further comprises a conversion module which, when the biometric data received comprises more modalities in addition to neural data {N}, such as physiological data {P} and / or anatomical data {A}, converts, for at least one modality, the corresponding data received into at least one 1D or 2D data slice {IN, IPand / or IA}; and wherein, depending on a second configuration parameter: - said least one generative model is configured to receive as input the at least 1D or 2D neural data slice {IN}, instead of said received neural data {Nr}; and / or - said at least one individual biometric identifier – IBI – generated by the identifier ID generating module comprises: o a first IBI obtained from at least said synthetic data and, at least a third IBI obtained from said at least one 1D or 2D data slice {IN, IPand / or IA}; and / or o a second mixed IBI obtained from a combination of at least said user representative synthetic data {Ns} and said at least one 1D or 2D data slice {IN, IPand / or IA}.
[0035] the system further comprises a fusion module configured to merge the at least one 1D or 2D data slice obtained for each modality {IN , IP , IA} into a unique 1D or 2D data slice {INPA} by using at least one fusion model, wherein, depending on a third configuration parameter: - said at least third IBI is obtained from said unique 1D or 2D data slice {INPA} instead of being obtained from said at least one 1D or 2D data slice {IN, IP, IA}; and / or - said second mixed IBI is obtained from a combination of at least said user representative synthetic data {Ns} and said unique 1D or 2D data slice {INPA} instead of being obtained from a combination of at least said user representative synthetic {Ns} and said at least one 1D or 2D data slice {IN , IP , IA}.
[0036] the physiological data comprise at least one of: a first optical signal and / or an electrical signal representative of a measurement of a vascular or muscular function of the user, such as a photoplethysmyography or an electromyography, and / or a first acousticsignal such as a bioacoustics-based signal like the user’s voice, coming from at least one specific physiological sensor;
[0037] the anatomical data comprise at least one of: a second optical signal and / or a second acoustic signal representative of morphologic information or density information relative to the user, such as a broadband ultrasound attenuation, quantitative ultrasounds, bioacoustics-based techniques, a computed-tomography image or a magnetic resonance image, coming from at least one specific anatomical sensor;
[0038] the receiving module is also configured to receive at least one external user identifier {EID}, and wherein the ID generating module is configured to generate a combined individual biometric identifier by combining said at least one individual biometric identifier to said at least one external user identifier {EID};
[0039] said ID management module is further configured to send to a recipient an information signal representative of said authentication result, said recipient being said user (10) or an external user interface, and said information signal being at least one of: a visual signal, an auditory signal, a kinesthetic signal, an olfactory signal, a gustative signal (S120)
[0040] the system further comprises a stimulation module configured to control an external stimulation device configured to deliver to said user (10) at least one sensory stimulus, said sensory stimulus being at least one of: a visual stimulus, an auditory signal, a kinesthetic signal, an olfactory stimulus; and the receiving module is further configured to receive a feedback signal from said user (10) in response to said at least one delivered sensory stimulus; and / or
[0041] the system is embedded in an apparatus, said apparatus being one of: an earbud or earphone, a headband, an earring, a headset such as an augmented Reality – AR - headset, a Virtual Reality – VR - headset, a Mixed Reality – MR - headset, smart glasses.
[0042] According to another aspect, the present disclosure relates to a computer- implemented method for securely authenticating a user, the method comprising:- receiving biometric data of said user, said biometric data of said user comprising at least neural data {N} of said user, said neural data {N} comprising at least one neural signal SN function of time and of at least one channel, said at least one channel covering a specific area of said user’s head; - generating user representative synthetic data {Ns} using at least one generative model configured to receive as input said received neural data {Nr}, wherein said at least one generative model has been previously pre-trained on neural data obtained from a plurality of subjects at different mental states, from different recording devices, and acquired by at least two channels; - generating at least one individual biometric identifier – IBI – from at least said generated user representative synthetic data {Ns} using a biometric identity – ID – model, said biometric ID model being a Transformer-based model; and depending on a predetermined condition: - comparing said at least one IBI to at least one user’s signature stored in a memory and outputting an authentication result; or - saving said at least one IBI as at least one user’s signature in said memory.
[0043] According to other advantageous aspects of the disclosure, the method comprises one or more of the features described in the following embodiments, taken alone or in any possible combination:
[0044] said at least one generative model is configured for generating said user representative synthetic data {Ns} comprising synthetic neural signals function of time and of at least one synthetic channel, said at least one synthetic channel covering an area of said user’s head different from said specific area covered by said at least one channel of said received neural data {Nr};
[0045] said at least one generative model is a Generative Adversarial Network – GAN – based model using a convolutional neural network architecture, said at least one generative model being fine-tuned with an enrollment dataset, and wherein said enrollment dataset comprises recording neural data of said user at various mental states and / or at various times of a day;
[0046] when the biometric data received comprises more modalities in addition to neural data {N}, such as physiological data {P} and / or anatomical data {A}, and depending on a first configuration parameter, said at least one individual biometric identifier – IBI – generated by the identifier ID generating module comprises: - a first IBI obtained from at least said user representative synthetic data {Ns} and, at least a second IBI obtained from said physiological data {P}and / or said anatomical data {A}; and / or - a first mixed IBI obtained from a combination of at least said user representative synthetic data {Ns} and, said physiological data {P} and / or said anatomical data {A};
[0047] the method further comprises, after receiving said biometric data of said user: pre-processing said received biometric data {Nr , Pr , Ar} by applying at least one of: a bandpass filter, an alignment, an artifact removal, and / or a standardization; and / or analyzing said received biometric data {Nr, Pr, Ar}, respectively said pre-processed data when available {Np, Pp, Ap}, and computing a quality parameter; and wherein said user representative synthetic data are generated {Ns} by using said pre-processed and / or analyzed neural data {Np / a} instead of the received neural data {Nr};
[0048] the method further comprises: encrypting said at least one individual biometric identifier – IBI – and transmitting said at least one encrypted IBI through a communication network; receiving and decrypting said at least one encrypted IBI; and, depending on said predetermined condition: - comparing said at least one decrypted individual biometric identifier to at least one user’s signature stored in said memory and output the authentication result; or - saving said at least one decrypted individual biometric identifier as at least one user’s signature in said memory;
[0049] the method further comprises further comprising, when the biometric data received comprises more modalities in addition to neural data {N}, such as physiological data {P} and / or anatomical data {A}: converting, for at least one modality, thecorresponding data received into at least one 1D or 2D data slice {IN, IPand / or IA}; and wherein, depending on a second configuration parameter: - said least one generative model is configured to receive as input the at least 1D or 2D neural data slice {IN}, instead of said received neural data {Nr}; and / or - said at least one generated individual biometric identifier – IBI – comprises: o a first IBI obtained from said synthetic data and, at least a third IBI obtained from said at least one 1D or 2D data slice {IN, IP and / or IA}; and / or o a second mixed IBI obtained from a combination of at least said user representative synthetic {Ns} and said at least one 1D or 2D data slice {IN, IPand / or IA};
[0050] the method further comprises merging the at least one 1D or 2D data slice obtained for each modality {IN, IP and / or IA} into a unique 1D or 2D data slice {INPA} by using at least one fusion model, and wherein, depending on a third configuration parameter: - said at least third IBI is obtained from said unique 1D or 2D data slice {INPA} instead of being obtained from the at least one 1D or 2D data slice {IN, IP and / or IA}; and / or - said second mixed IBI is obtained from a combination of at least said user representative synthetic data {Ns} and said unique 1D or 2D data slice {INPA} instead of being obtained from said user representative synthetic data {Ns} and said at least one 1D or 2D data slice {IN, IP and / or IA};
[0051] the physiological data comprise at least one of: a first optical signal and / or an electrical signal representative of a measurement of a vascular or muscular function of the user, such as a photoplethysmyography or an electromyography, and / or a first acoustic signal such as a bioacoustics-based signal like the user’s voice, coming from at least one specific physiological sensor;
[0052] the anatomical data comprise at least one of: a second optical signal and / or a second acoustic signal representative of morphologic information or density information relative to the user, such as a broadband ultrasound attenuation, quantitative ultrasound,bioacoustics-based techniques, a computed-tomography image or a magnetic resonance image, coming from at least one specific anatomic sensor;
[0053] the method further comprises receiving at least one external user identifier {EID}; and wherein generating at least one individual biometric identifier comprises generating a combined individual biometric identifier by combining said at least one individual biometric identifier to said at least one external user identifier {EID};
[0054] the method further comprises sending to a recipient an information signal representative of said authentication result, said recipient being said user (10) or external user interface, and said information signal being at least one of: a visual signal, an auditory signal, a kinesthetic signal, an olfactory signal, a gustative signal; and / or
[0055] the method further comprises controlling an external stimulation device configured to deliver to said user at least one sensory stimulus, said sensory stimulus being at least one of: a visual stimulus, an auditory signal, a kinesthetic signal, an olfactory stimulus, and / or a gustative stimulus; and the biometric data received also comprise a feedback signal from said user in response to said at least one delivered sensory stimulus.
[0056] In addition, the disclosure relates to a computer program comprising software code adapted to perform a method for securely authenticating a user compliant with any of the above execution modes when the program is executed by a processor.
[0057] The present disclosure further pertains to a non-transitory program storage device, readable by a computer, tangibly embodying a program of instructions executable by the computer to perform a method for securely authenticating a user compliant with the present disclosure.
[0058] Such a non-transitory program storage device can be, without limitation, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor device, or any suitable combination of the foregoing. It is to be appreciated that the following, while providing more specific examples, is merely an illustrative and not exhaustive listing as readily appreciated by one of ordinary skill in the art: a portable computer diskette, a harddisk, a ROM, an EPROM (Erasable Programmable ROM) or a Flash memory, a portable CD-ROM (Compact-Disc ROM). DEFINITIONS
[0059] In the present invention, the following terms have the following meanings:
[0060] The terms “adapted” and “configured” are used in the present disclosure as broadly encompassing initial configuration, later adaptation or complementation of the present system and method, or any combination thereof alike, whether effected through material or software means (including firmware).
[0061] The term “processor” should not be construed to be restricted to hardware capable of executing software, and refers in a general way to a processing device, which can for example include a computer, a microprocessor, an integrated circuit, or a programmable logic device (PLD). The processor may also encompass one or more Graphics Processing Units (GPU), whether exploited for computer graphics and image processing or other functions. Additionally, the instructions and / or data enabling to perform associated and / or resulting functionalities may be stored on any processor- readable medium such as, e.g., an integrated circuit, a hard disk, a CD (Compact Disc), an optical disc such as a DVD (Digital Versatile Disc), a RAM (Random-Access Memory) or a ROM (Read-Only Memory). Instructions may be notably stored in hardware, software, firmware or in any combination thereof.
[0062] “Machine learning (ML)” designates in a traditional way computer algorithms improving automatically through experience, on the ground of training data enabling to adjust parameters of computer models through gap reductions between expected outputs extracted from the training data and evaluated outputs computed by the computer models.
[0063] A “hyper-parameter” presently means a parameter used to carry out an upstream control of a model construction, such as a remembering-forgetting balance in sample selection or a width of a time window, by contrast with a parameter of a modelitself, which depends on specific situations. In ML applications, hyper-parameters are used to control the learning process.
[0064] “Datasets” are collections of data used to build an ML mathematical model, so as to make data-driven predictions or decisions. In “supervised learning” (i.e. inferring functions from known input-output examples in the form of labelled training data), three types of ML datasets (also designated as ML sets) are typically dedicated to three respective kinds of tasks: “training”, i.e. fitting the parameters, “validation”, i.e. tuning ML hyper-parameters (which are parameters used to control the learning process), and “testing”, i.e. checking independently of a training dataset exploited for building a mathematical model that the latter model provides satisfying results.
[0065] A “neural network (NN)” designates a category of ML comprising nodes (called “neurons”), and connections between neurons modeled by “weights”. For each neuron, an output is given in function of an input or a set of inputs by an “activation function”. Neurons are generally organized into multiple “layers”, so that neurons of one layer connect only to neurons of the immediately preceding and immediately following layers.
[0066] The above ML definitions are compliant with their usual meaning, and can be completed with numerous associated features and properties, and definitions of related numerical objects, well known to a person skilled in the ML field. Additional terms will be defined, specified or commented wherever useful throughout the following description.
[0067] In the context of the present disclosure and of neural measurements, such as EEG (electroencephalography), a “channel” refers to an individual recording pathway or sensor that captures electrical activity from a specific location on the scalp or any other relevant areas (for example: in-ear area like ear canal, ear concha, or mastoids). It represents a single data stream of neural signals obtained from a specific electrode or sensor. In EEG, for example, multiple electrodes or sensors may be strategically placed on the scalp or any relevant area of the body to capture electrical potentials generated by the brain or other physiological processes. Each electrode or sensor may be connected to an amplification and recording system, and the electrical activity detected at each locationis referred to as a channel. The channels are typically labeled or numbered for identification purposes. By having multiple channels, EEG measurements allow for the simultaneous recording of electrical activity from different brain regions or physiological sources. These channels provide spatial information about neural activity patterns and can be used to analyze brain dynamics, detect abnormalities, monitor brain states, or investigate cognitive processes.
[0068] It's worth noting that the term “channel” can be used more broadly in the context of the present disclosure to refer to the recording pathway or sensor for other modalities, such as electrocorticography (ECoG), electrocardiography (ECG), electromyography (EMG), or other neurophysiological measurements. The specific definition and application of a channel may vary depending on the neural measurement technique employed.
[0069] A “sequence model” is a type of neural network designed to analyze and predict sequences such as text, time series, or audio. The architecture of a sequence model typically includes an “encoder” and a “decoder”. The encoder is the part of a sequence model that processes segments of data to encode the underlying patterns and dynamics into a condensed, high-dimensional representation, capturing essential features relevant to the physiological state or process being monitored. The decoder uses the encoded data to reconstruct or predict sequences, enabling tasks such as anomaly detection or future signal forecasting. BRIEF DESCRIPTION OF THE DRAWINGS
[0070] The present disclosure will be better understood, and other specific features and advantages will emerge upon reading the following description of particular and non- restrictive illustrative embodiments, the description making reference to the annexed drawings wherein:
[0071] Figure 1 is a schematic representation of an embodiment of a method for securely authenticate a user.
[0072] Figure 2 is a schematic representation of the method for securely authenticate a user according to another embodiment.
[0073] Figure 3 represents an example of pre-processing operations on different types of signals such as a neural signal SN, an optical signal O or an acoustic signal Ac, and according to an embodiment of one of the steps of the method as illustrated in figures 1 and 2.
[0074] Figure 4 represents an example of a 2D conversion processed of different types of signals and according to an embodiment of one of the steps of the method as illustrated in figures 1 and 2.
[0075] Figure 5 illustrates an example of image fusion with two types of modalities.
[0076] Figure 6 is a schematic representation of a generative model configured to generate user representative synthetic data, and that may be used in one of the methods represented in figures 1 and 2 for.
[0077] Figure 7 is a schematic representation of a generative adversarial architecture adapted to generate at least one generative model (the generator), which may be used in one of the methods represented in figures 1 and 2.
[0078] Figure 8 is a schematic representation of a U-Net architecture that may be used in one of the methods represented in figures 1 and 2 for generating user representative synthetic data.
[0079] Figure 9 is a schematic architecture of a possible discriminator based on a convolutive neural network architecture.
[0080] Figure 10 is an illustration of a scalp equipped with electrodes positioned according to the 10-20 international system.
[0081] Figure 11 is an embodiment of one the steps of the method as illustrated in figures 1 and 2.
[0082] Figure 12a illustrates a general architecture of a transformer encoder, and figure 12b details one block of the transformer encoder.
[0083] Figure 13 represents an exemplary functional diagram of two steps of the method as illustrated in figures 1 and 2.
[0084] Figure 14 represents an exemplary use of the system of the present invention.
[0085] Figure 15 is an illustration of a neural biometric authentication system which may implement one of the methods represented in figure 1 and figure 2.
[0086] Figure 16 is an illustration a sequence model used to obtain the single modality IBI and then combine them together.
[0087] On the figures, the drawings are not to scale, and identical or similar elements are designated by the same references. DETAILED DESCRIPTION
[0088] The present description illustrates the principles of the present disclosure. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the disclosure and are included within its spirit and scope.
[0089] All examples and conditional language recited herein are intended for educational purposes to aid the reader in understanding the principles of the disclosure and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions.
[0090] Moreover, all statements herein reciting principles, aspects, and embodiments of the disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed inthe future, i.e., any elements developed that perform the same function, regardless of structure.
[0091] Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein may represent conceptual views of illustrative circuitry embodying the principles of the disclosure. Similarly, it will be appreciated that any flow charts, flow diagrams, and the like represent various processes which may be substantially represented in computer readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
[0092] The functions of the various elements shown in the figures may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.
[0093] It should be understood that the elements shown in the figures may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented in a combination of hardware and software on one or more appropriately programmed general-purpose devices, which may include a processor, memory and input / output interfaces.
[0094] The present disclosure relates to a computer-implemented method for securely authenticating a user. The present disclosure also relates to a neural biometric authentication system for securely authenticating a user and configured to, but not limited to, implement the present method. This system will be detailed after the description of the method.
[0095] METHOD FOR SECURELY AUTHENTICATE A USER
[0096] As illustrated in figure 1, the method for securely authenticating a user 10 comprises three main steps: - step S10: receiving biometric data 20 of said user 10, said biometric data 10 of said user 10 comprising at least neural data {Nr} of said user 10;- step S60: generating user representative neural synthetic data {Ns} using at least one generative model configured to receive as input said received neural data {Nr}, wherein said at least one generative model has been previously pre-trained on neural data obtained from a plurality of subjects at different mental states, from different recording devices, and acquired by at least two channels; - step S70: generating at least one individual biometric identifier (IBI) from at least said generated user representative neural synthetic data {Ns} using a biometric identity (ID) model; and depending on a predetermined condition: - step S100: comparing said at least one individual biometric identifier (IBI) to at least one user’s signature stored in a memory 40 and outputting an authentication result; or - step S110: saving said at least one individual biometric identifier (IBI) as at least one user’s signature in said memory 40.
[0097] As illustrated in figure 2, the method for securely authenticating a user 10 may further comprise optional steps, which can be applied alone or in combination when compatible: - Step S20: pre-processing said received biometric data {Nr, Pr, Ar} by applying at least one of: a bandpass filter, an alignment, an artifact removal, and / or a standardization; - Step S30: analyzing said received biometric data {Nr, Pr, Ar} or said pre-processed biometric data {Np, Pp, Ap} when available, and computing a quality parameter; - Step S40: converting, for at least one modality of the biometric data received, the corresponding data received into at least one 1D or 2D data slice {IN, IP, IA}; - Step S50: merging the at least one 1D or 2D data slice obtained for each modality {IN, IP, IA} into a unique 1D or 2D data slice {INPA} by using at least one fusion model; - Step S80: encrypting said at least one individual biometric identifier and transmitting said at least one encrypted individual biometric identifier through a communication network 30;- Step S90: receiving and decrypting said at least one encrypted individual biometric identifier; - Step S120: sending to a recipient an information signal representative of said authentication result; - Step S130: receiving at least one external user identifier {EID}; and / or - Step S140: controlling an external stimulating device configured to deliver to said user 10 at least one sensory stimulus, said sensory stimulus being at least one of: a visual stimulus, an auditory signal, a kinesthetic signal, an olfactory stimulus, and / or a gustative stimulus.
[0098] Each of these steps will now be described in detail:
[0099] Step S10: Receiving biometric data {N, P, A}
[0100] The neural data {N} included in the biometric data 20 received may comprise at least one neural signal SN function of time and of at least one channel, such as: electroencephalogram (EEG), electrooculography (EOG), magnetoencephalogram (MEG), functional near-infrared spectroscopy (fNIRS), functional magnetic resonance imaging (fMRI), positron emission tomography (PET), or single photon emission computed tomography (SPECT). These neural signals, such as EEG, are highly individualistic and difficult to forge, making them an effective means of identification. Furthermore, said at least one channel covers a specific area of said user’s head. Advantageously, said neural data of the user 10 are acquired by head worn devices or apparatuses comprising one or a plurality of neural sensors like, for example: headsets (such as an augmented Reality – AR – headset, a Virtual Reality – VR – headset, a Mixed Reality – MR – headset, an EEG helmet), headphones, earbuds, earrings, earpieces or smart glasses. The neural sensors may be wet or dry electrodes and be configured to be put into contact with a portion of the head of the user. When the neural data of the user 10 come from a plurality of channels, it increases the performance of the identification.
[0101] In an advantageous embodiment, said biometric data 20 further comprise more modalities in addition to said neural data {N} of the user 10, such as physiological data {P} and / or anatomical data {A} relative to the user 10. For example, the physiologicaldata {P} may comprise at least one: a first optical signal and / or an electrical signal representative of a measurement of a vascular or muscular function of the user 10, such as a photoplethysmyography or an electromyography, and / or a first acoustic signal such as a bioacoustics-based signal like the user’s voice, coming from at least one specific physiological sensor. The anatomical data {A} may comprise at least one of: a second optical signal and / or a second acoustic signal representative of morphologic information (e.g. sonar-based inner ear reconstruction) or density information (e.g. cranial bones characterization) relative to the user, such as a broadband ultrasound attenuation, quantitative ultrasounds, bioacoustics-based techniques, a computed-tomography (CT) image or a Magnetic Resonance Image (MRI), coming from at least one specific anatomical sensor. In figures 1 and 2, {Nr} represents the neural data received, {Pr} represents the physiological data received, and {Ar} represents the anatomical data received. The physiological and anatomical data may be acquired by adapted sensors which can be integrated in the above-cited devices or apparatuses comprising one or a plurality of neural sensors.
[0102] In the case where the user 10 receives at least one sensory stimulus from an external device, the biometric data 20 may also comprise a feedback signal from said user 10 in response to said at least one delivered sensory stimulus. Depending on the nature of said feedback signal, the feedback data contained will be included in the neural data {N}, the physiological data {P} and / or the anatomical data {A}.
[0103] Step S20: Pre-processing the biometric data received {Nr, Pr, Ar}
[0104] Figure 3 represents an example of pre-processing which depends on the nature of the data, and thus of the corresponding signals to be pre-processed. The different data contained in the biometric data 20 are provided in real-time, and can be buffered to process data chunks of specific duration. Depending on the type of data, thus on the type of signals, a specific preprocessing chain will be used. In the example shown in figure 3:
[0105] Bloc a represents the chain to pre-process neural signals, SN, of electromagnetic origin as EEG and MEG, for example. Segments SNare matrices of size T x C, where Cis the number of channels (at least, C=1) and T=t*Fs the number of data samples, where t is the duration of the segment in seconds and Fs is the sampling frequency.
[0106] A bandpass filter (bloc a.1) is applied to remove low frequencies (cut-off frequency between 0.5 and 2Hz) and high frequencies (up to the gamma frequency, i.e. from 40 to 100Hz). The bound frequencies may be adjusted according to the quality of the neural data provided by the sensors.
[0107] If the number of channels C is greater than or equal to 2, a re-reference (bloc a.2) can be applied to reduce noise. Re-reference is the process of adjusting brain electrical activity recordings to a chosen reference. Usually, EEG recordings are made using multiple electrodes / sensors placed on the scalp or any other relevant area (for example: in-ear area like ear concha, ear canal, or mastoids). Each electrode measures the electrical activity of the brain relative to another reference electrode or a neutral point. Re-reference is done to get a more accurate representation of the relationships between different brain regions. It can be carried out in different ways, in particular by using an average reference, an intracranial reference or a mathematical reference. For example, a possible re- referencing procedure is to subtract of all channels to each channel individually.
[0108] Then, an algorithm to reduce noise can be applied (bloc a.3). A possible implementation is to apply independent component analysis (ICA) if C > 2, then identify and remove components whose distributions match typical artifacts such as cardiac beats, eye blinks, eye movements and muscular activity.
[0109] Finally, a standardization (bloc a.4) can be applied. By standardizing signals, the performance and stability of subsequent deep learning models can be improved. A possible standardization approach is to perform mean normalisation, which adjusts the data so that the mean of each channel is 0 and the standard deviation is 1.
[0110] Bloc b represents the procedure to preprocess optical biosignals, O, such as photoplethysmography (PPG), near-infrared spectroscopy (NIRS) and spectroscopy. First, signals are bandpass filtered (bloc b.1) to suppress unwanted, frequencies and then apply baseline removal (bloc b.2) to reduce noise caused by factors such as skin motionand ambient light. A possible implementation of baseline removal is to apply a moving average filter.
[0111] Bloc c represents the preprocessing procedure for acoustic biosignals, Ac, from audible signals recorded by microphones (voice, acoustic signature of specific parts of the body), to ultrasounds (such as Doppler imaging or pulse-echo imaging) and acoustic impedances. Data is filtered (bloc c.1) between specific cut-off frequencies in order to remove unwanted oscillations and improve further blocs to extract audio and anatomical features.
[0112] In figures 1 and 2, {Np} represents the neural data pre-processed, {Pp} represents the physiological data pre-processed, and {Ap} represents the anatomical data pre- processed.
[0113] Step S30: Analyzing the biometric data received {Nr , Pr , Ar} or pre-processed {Np , Pp , Ap}
[0114] Analyzing the biometric data received {Nr, Pr, Ar}, respectively the pre- processed data {Np, Pp, Ap} when available, consists in verifying that said biometric data 20 are usable by computing a quality parameter, and verifying if the quality parameter respects at least one predetermined criterion. Said quality parameter may be computed based on time-series characteristics both in temporal and frequency domain (descriptive statistics, linear and nonlinear measurements) compared to gold-standard data, and said at least one criterion may be representative of: - signal strength: the signal(s) should have sufficient strength to be received and interpreted accurately without significant degradation or distortion; - signal-to-noise ratio (SNR): a high SNR indicates that the desired signal is strong compared to background noise or interference, making it easier to extract the relevant information; - bandwidth: sufficient bandwidth ensures that the signal carries the necessary information without excessive loss or distortion;- signal quality: the signal(s) should be free from distortions, artifacts, or other impairments that could affect its integrity or legibility. This criterion is particularly relevant in audio, video, or image signals; - modulation / demodulation: the signal(s) should be modulated in a way that is compatible with the receiver's demodulation scheme. This ensures that the signal(s) can be properly extracted and decoded; - signal stability: the signal(s) should remain stable over time, without significant variations or fluctuations. Stability is important to maintain reliable communication or accurate data transmission; - signal durability: the signal(s) should be able to withstand various environmental conditions, such as interference, attenuation, or multipath effects, depending on the specific transmission medium; - compatibility: the signal(s) should conform to the protocols, standards, or formats expected by the receiving system or device. Compatibility ensures proper reception and interpretation of the signal(s); - signal integrity: the signal(s) should retain its original characteristics and content during transmission or processing, without significant loss or corruption.
[0115] If said at least one criterion is not respected, a new acquisition of the biometric data 20 need to be realized. In this case, a message or a signal can be delivered to the user 10 so new biometric data 20 can be sent and received.
[0116] It is to be noted that this analysis does not modify the nature of the data received {Nr, Pr , Ar}or pre-processed {Np, Pp , Ap}. However, for a better understanding of figures 1 and 2, the neural data analyzed represented by {Na} are the analyzed neural data considered as exploitable / accepted which mean that all or part of the above-cited criteria are respected, preferably at most one criterion is not respected. In the same manner, the physiological and anatomical data analyzed respectively represented by {Pa} and {Aa} are the analyzed data which are considered as exploitable / accepted because they respect all or part of the above-cited criteria, preferably at most one criterion being not respected.
[0117] Step S40: Converting data into 1D or 2D data slice(s) {IN, IP, IA}
[0118] This step S40 consists in computing, for at least one modality, at least one 1D or 2D data slice {IN, IP, and / or IA} of the corresponding data received {Nr, Pr, Ar}, pre- processed {Np, Pp, Ap} and / or analyzed {Na, Pa, Aa} when available. In other words the step S40 allow to convert the input data into a 1D or 2D converted data representative of the input data, notably to obtain a neural converted data {IN} being a 1D or 2D representation of said neural data {N}, a physiological converted data {IP}, which is a 1D or 2D representation of said physiological data {P} and / or an anatomical converted data {IA}, which is a 1D or 2D representation of said anatomical data {A}. Figure 4 illustrates an example of a 2D conversion on signals having different modalities: a neural signal EEG representative of neural data of the user 10, an optical signal PPG representative of physiological data of the user 10, and ultrasound signals representative of anatomical data of the user 10.
[0119] A possible (preferred) implementation uses signal processing techniques to encode time-varying signals into 2D data slices representing different biometric levels to benefit from further fusion methods exploiting convolutional neural networks (CNN).
[0120] The type of data slices, 1D or 2D, can vary according to the type of biometric data, for example:
[0121] Spectrograms: Spectrograms are 2D images expressing oscillatory changes in time. They can be obtained using Fourier Transform (FT), Wavelet Transform (WT), Hilbert Transform (HT), Empirical Mode Decomposition (EMD) or other similar decomposition techniques. With Neural data, spectrograms allow to represent power band changes in brain activity in a time-frequency plane and subsequently extract the neural signature associated to an individual. With voice or an acoustic signal, spectrograms can characterize voice tones in the time-frequency plane individual voice tones, and add supplementary information sequences.
[0122] State-space plots: They provide a visual representation of the system's dynamics by plotting the current state or phase of the system against its previous states. These techniques allow to distinguish between chaotic and regular dynamics of a deterministic dynamical system, such as the cardio-vascular system. The state-space plots can bePointcaré plots, attractor reconstruction plots, 0-1 test for chaos and other 2D representations of time-series. For example, when physiological data {P}, such as data from the vascular system (PPG, Blood flow and perfusion, where subject-specific plots can be obtained from the analysis of the dynamics of the cardio-vascular system; or motion data (accelerometer, gyroscopes), where gait, body and limb movements, are represent in the form of state-space plots they contain useful information to detect subject- specific patterns.
[0123] Sonography (ultrasound imaging): Using ultrasounds, anatomic data can be reconstructed using a plurality of techniques, depending on the ultrasound techniques employed. For wearable technology, beamforming is the most suitable technique as it allows for a reduced number of sensors, focusing on specific directions or regions of interest. By combining and weighting the received signals appropriately, the technique synthesizes the desired image. This block can implement Delay-and-Sum or Plane-Wave beamforming. Other time-series encoding techniques, such as Gramian Angular Fields (GAF) and Markov Transition Fields (MTF). They can be applied to neural data and physiological signals.
[0124] Other possible implementations include, but are not limited to, using temporal signals to feed CNN, computing features from the temporal signals (peak amplitudes, moving average values, entropy measurements) and then converting them into 2D images.
[0125] Step S50: Merging the images into a unique 1D or 2D data slice {INPA}
[0126] In this step S50, the eventually available 1D or 2D data slices {IN, IP, and / or IA} are taken to build a unique 1D or 2D data slice {INPA} representative of a neuro-anatomic feature vector, Z.
[0127] The purpose of this block is double fold: - Increase accuracy: Leverage additional information to enhance the performance of the biometric ID block. - Increase security: Add supplementary authentication steps using different biometric levels.
[0128] Using two or more modalities, multi-level feature abstraction and fusion can be applied. In the absence of supplementary data (no physiological data P and / or anatomical data A available), this step is omitted.
[0129] Given that the biometrical modalities are heterogeneous and of variable number, the present method proposes a late fusion approach (based on Stahlschmidt et al., 2022), in which 1D or 2D data slices from each modality {IN, IP, and / or IA} are processed by independent models to output a feature vector. The models to compute feature vectors are preferably convolutional neural networks (CNN), with a variable number of layers to map the input data slices (of variable dimension) into output vectors of the same size. Each modality vector is then weighted by attention parameters, with the aim at giving the importance to the most relevant modality (in terms of data quality and quantity). The attention modules take the feature vector as input and output a set of attention weight parameters that can be implemented, preferably, by a neural network (NN).
[0130] Finally, the weighted vectors are aggregated to obtain the final feature vector Z. Figure 5 illustrates an exemplary implementation of this step S50, in the case where physiological data {P} and anatomical data {A} are available in the biometric data 20 received.
[0131] A novelty introduced by the present method is the creation of a new user- dependent factor, inheriting specific characteristics of the user’s physiology and / or anatomy. This information can be used either to reinforce the security in a double authentication factor or to increase the performance of ID matching by associating independent modal classifiers.
[0132] Step S60: Generating user representative synthetic data {Ns}
[0133] The term “user representative synthetic data” refers to one or more synthetic signals obtained by a generative model based on one or more neural networks previously trained and fine-tuned to reproduce signals that are not sensed by the head worn device. When the number of channels of the head worn device is insufficient to ensure good performance of ID generator, mapping a few “real” channels (i.e., input neural signals) toother “synthetic” (i.e., synthetic signals) positions is advantageous to increase the robustness of ID generators based on Transformer(s) (i.e., Transformer-based model).
[0134] This step consists in augmenting the received neural data {Nr} of the user 10 with said at least one first generative model, and outputting a modified version of the inputted signal, corresponding to said user representative synthetic data {Ns}, which contain user- specific characteristics and, advantageously spatial information. This step may as well consist in augmenting the pre-processed and / or analyzed neural data {Np / a}, or the at least one 1D or 2D neural data slice {IN} (i.e., converted data representative of said neural data {N}) when available with said at least one second generative model, and outputting a “modified” (augmented) version of the inputted signal, called in the present description second user representative synthetic data {Is}. The advantage of this augmentation step is also that in case of malfunctioning or non-functioning channels, they may be simulated using the generative model.
[0135] The aim of the data augmentation is to increase the size and diversity of the received signal (i.e., neural data {Nr}, pre-processed and / or analyzed neural data {Np / a} or neural converted data {IN}) (usually limited in channel numbers and duration), thereby enhancing the generalization and robustness of the biometric ID model. Said at least one generative model (first or second generative model) may be based one deep neural networks, such as Generative Adversarial Networks (GANs) or variational auto-encoders (VAEs).
[0136] In order to be compatible with a large variety of users, mental states, neural sensors, number and location of channels, the at least one generative model is pre-trained on a generic neural training dataset comprising neural data obtained from a plurality of subjects at different mental states, from different recording devices, and acquired by at least two channels, preferably more than two channels.
[0137] Advantageously, to reinforce the authentication and enhance the generation of the at least one IBI, said at least one generative model may further be fine-tuned on enrollment data comprising recording neural data of said user 10 at various mental states and / or at various times of a day or a week, preferably from a plurality of channels.
[0138] To generate said user representative synthetic data {Ns} (or {Is}), said at least one generative model may comprise an ensemble of generative networks (i.e., generators) that use said received neural data {Nr} of the user 10 (respectively said pre-processed and / or analyzed neural data {Np / a}, or respectively the at least one 1D or 2D neural data slice {IN} when available). Said user representative synthetic data may be seen as a modified version of the input signal, as it comprises the new signals, mimicking channels not comprised in the received neural data {Nr}, generated by the generative networks which receives as input the received neural data {Nr}. The user representative synthetic data {Ns} contains user-specific characteristics of the input signals, and may also be enriched by spatial information. In one example, each new signal in {Ns} is generated by one generative network. Therefore, the number of generative networks NG implemented by the step S60 may be variable. The number of generative networks depends on the number of channels of the head worn device used to compute the neural ID (i.e. if the head worn device only have one channel, it is desirable to augment to generated channels and therefore of generative networks). For example, the generative model may be configured to ensure the reconstruction of a neural mapping typical of a 10-20 system, which comprises 21 channels (i.e., electrodes reading neural signals). In this case the generative model would comprise 21 generative networks, one for each channel of the 10-20 system. This means for example that the generative network associated to the channel Cz is configured to receive at least two input neural signals from any other channel of the 10-20 system, except the Cz channel, and provide as output one synthetic signal mimicking the neural signal that would be acquired from the Cz signal (and the same for the other channels). If the head worn device comprises 2 electrodes, such as the F7 and the F8, then only the neural networks corresponding to the other channels of the 10-20 system will be used to generate the missing signal as the synthetic signals.
[0139] User-specific underlying information and spatial information may be added as follows: first, a number of generators (i.e., generative networks) are pre-trained using the generic neural training dataset so to learn to synthesize neural data from specific brain areas (such as frontal, temporal, occipital and other areas, comprised in the neural data of the generic neural training dataset). In other words, the generative model (thus each of its generators) needs to be pre-trained, using a variety of subjects and neural data(respectively a variety of neural data slices generated from the variety of subjects and neural data), including different mental states and different channel positions. Then, pre- trained models are fine-tuned with user’s neural data (i.e., neural data {Nr}, pre-processed and / or analyzed neural data {Np / a} or neural converted data {IN}) to map original signals to several areas, thus increasing artificially the number of channels. Importantly, generated data is correlated to the input data as a multichannel neural dataset. In other words, thanks to the fine-tuning the first and second generative model learn to generate data that is specific to the user 10.
[0140] Figure 6 illustrates an exemplary implementation of step S60, wherein the generative model comprises NG generative networks (NG being an integer greater or equal to 1), each trained to map the input signal x, recorded in a specific area of the user’s head, into one or more different channel positions. Hence, each one of the generative networks Gk (k=1…NG) is trained with a dataset composed by signals representing the mapping.
[0141] For instance, if the input signal is sensed in the temporal position, one generative networks transforms this signal to be similar to a signal sensed in the frontal area, one generative networks transforms this signal to be similar to a signal sensed in the central, and so on with a desired number of generative networks. In one example, to perform data augmentation, at least one GAN is required to generate one supplementary, artificial neural signal, corresponding to said user representative synthetic data.
[0142] A possible implementation to train the generative networks is to use GANs design.
[0143] Generative / augmentation procedure implemented in Step S60 using GANs (generating G1-GNGmodels) may comprise the following steps.
[0144] A first step of collecting data for generating a training dataset. The data collected may be EEG data from a public dataset composed by nc channels.
[0145] A preprocessing step comprising cleaning and segmenting the data to obtaintraining dataset of size [ns, nw, nc, np], where ns=number of subjects, nw=number of segments of t seconds, nc=number of channels and np=number of data samples (T x Fs, where Fs is the sampling rate).
[0146] A step 3 of constructing the training dataset X{Nr}, composed by signals matching to the sensing positions of the device (at least one channel EEG).
[0147] A step 4 of selecting channels to map X{Ns}. These are specific channels in which no sensing data exist and need to be synthesized. X{Ns}is composed by a subset of channels {x1, x2, … xNG}
[0148] The generative / augmentation procedure comprises then a step 5 of taking xi to start training Generator i (i=1…NG).
[0149] A latent vector z is then created using X{Nr}in step 6. A possible way to generate latent vector is: a. Flatten and concatenate the signals from X{Nr};b. Apply dimensionality reduction technique such as principal component analysis (PCA).
[0150] In step 7, the generator i is then feed with said latent vector z to generate synthetic signal, yi, and Gaussian noise (if first iteration) or Discriminator output (otherwise). During the training xi and yi are compared in the Discriminator i and the loss function is computed (step 8). Generator i weights are then updated based on the gradients computed during backpropagation (step 9).
[0151] The procedure goes to step 7 and iterate until the Discriminator labels yi as real, regularizing and stabilizing training by tuning networks’ parameters and hyperparameters.
[0152] The performance of the trained model is monitored by using a validation set. Once the training of the current GAN is finished the procedure goes back to step 5 to train next GAN (until i=NG).
[0153] Description of GANs
[0154] Generative adversarial networks (GANs) consist of two subunits: a generator (G(x)) and a discriminator network (D(x)), one providing feedback to the other in a competitive manner. The generator tries to generate as realistic data as possible, with the aim of being labeled as real by the discriminator. The discriminator takes a generated fake (generator output) or real example (a real EEG segment) as an input and classifies the input as fake or real. The result of the comparison is fed iteratively to the generator and the discriminator so they can improve the model to be more realistic, until the discriminator cannot distinguish real and fake data. This “competition” can be expressed as a zero-sum game with the following objective, LGAN
[0155] Equation 1: ^^^^(^, ^, ^, ^) = ^^∼^^^^^(^)[log(^(^; ^^))] + ^^∼^^(^)[log(1 − ^(^(^; ^^); ^^))]
[0156] Equation 2:
[0157] where D and G are two neural networks with their respective parameters θDand θG. Real EEG data is denoted as x, and z is n-dimensional latent vector or noise. ^-).)(^)is the distribution of data and ^^(^) is the distribution of noise. During the training phase, the GAN aims at learning the mapping from random noise vector z to output signal y, G∶ z→y by estimating the parameters θDand θG, in which the loss is maximal concerning θDand minimal concerning θG.
[0158] The general architecture of the GANs is shown in figure 7, where x corresponds to the real signal that conditions the generation of the synthetic signal y and z corresponds to the random noise vector. Dotted lines correspond to feedback information from the functions loss to train the generator to improve the generated signals, and to train the discriminator to better classify real and fake signals.
[0159] Architecture of generators
[0160] Figure 8 illustrates a possible implementation for the at least one generative model comprising NG generative networks Gk based on encoder-decoder networks using convolutional neural network (CNN) architecture, and particularly using the “U-net” approach (Ronneberger et al., 2015). The U-Net architecture includes a contracting (encoder) path and an expansive (decoder) path. The encoder pathway is responsible for capturing high-level, abstract features from the input data, and it shares similarities with the architecture of a convolutional network.
[0161] In the encoder pathway, a common practice is to apply repeated sets of operations to extract features. These operations typically consist of two convolutions followed by a rectified linear unit (ReLU) activation function. For 1D data such as neural signals, the convolutions are adapted to operate in 1D rather than the 2D convolutions used for images. The convolutions in the encoder are typically performed using unpadded convolutions, hence the spatial dimensions of the feature maps are reduced after each convolution operation.
[0162] During each convolution, a set number of filters (f) or kernels are utilized. These filters determine the number of features or channels in the output feature maps. The choice of f is often based on the desired capacity and complexity of the network. Typically, the number of filters increases as we progress deeper into the encoder, allowing the network to capture more intricate and abstract features from the input data.
[0163] By employing unpadded convolutions and adjusting the number of filters in each convolutional operation, the U-Net architecture can effectively extract and represent hierarchical features at different scales. This ability enables the network to learn increasingly sophisticated representations and ultimately achieve better performance in generation tasks.
[0164] After each convolution, a rectified linear unit (ReLU) activation function is applied element-wise to the feature maps. The ReLU function introduces non-linearity into the network, setting all negative values to zero while leaving positive values unchanged. This non-linear activation helps capture complex patterns and introduces the ability to model more sophisticated relationships within the data.
[0165] By repeating this sequence of convolutions and ReLU activations, the encoder pathway gradually captures higher-level, abstract features while reducing the spatial dimensions of the feature maps. The downsampling is typically achieved through operations such as max-pooling or strided convolutions, which reduce the size of the feature maps while increasing the number of feature channels.
[0166] The encoder comprises L downsampling layers (E1 to EL), and each downsampling layer performs a convolution that divides by two the number of feature channels. Also, the decoder comprises a plurality of upsampling layers (D1to DL), and each upsampling layer performs a deconvolution that doubles the number of feature channels. An output with identical dimensions than the input is given by the U-Net architecture.
[0167] The possible implementation of figure 8 can be done by setting the number of filters (f) to 64 and the number of layers to 4. In that case, if the input is a 1D signal of size 512x1 (e.g. 2 seconds of neural data sampled at 256 Hz), then application of this signal to input layer results in a slice of size 256x16. Application of this slice to E1results in a slice of 128x32, which applied to E2 results in a 64x64 slice, which applied to E3 results in a slice of size 32x128 and finally, the application of layer E4 provides a 16x256 slice. During the expansive path, the process is mirrored in layers D1, D2, D3and the output layer, that ensures that the output has the same dimension than the input.
[0168] Architecture of discriminators
[0169] The discriminators can also be based in convolutional neural networks. A possible implementation is to use a PatchGAN approach, as illustrated in figure 9. In a PatchGAN, instead of considering the entire input signal as a whole, the discriminator can classify smaller patches or segments independently. This is convenient in the context of neural signals, because instead of looking at each time sample (as done in traditional GAN discriminators), processing separately patches by subsequent layers can better identify dynamics associated to different oscillation bands. The size of the patches can be adjusted based on the desired level of detail and local pattern recognition. Finally,PatchGAN is a good choice to increase training efficiency and help to prevent the discriminator from overfitting to the training data.
[0170] PatchGANs typically use a series of L convolutional layers, which can learn local features of the input signal without reducing the size of the feature maps or increasing the computational complexity of the discriminator. The filters can be of size 3x1 or 5x1.
[0171] The final (output) layer of the discriminator consists of a single node with a sigmoid activation function, producing a probability score indicating the authenticity of the input signal.
[0172] A possible implementation of discriminator based on Figure 9 can be done by setting f to 64 and L to 4. In that case, if the input is a 1D signal of size 1x512 (e.g 2 seconds of neural data sampled at 256 Hz), then application of this signal to input layer results in a feature map of size 510x64. Application of this slice to the second convolution layer results in a feature map of 508x128, which applied to next convolution layer results in a 506x256 feature map, which applied to the last convolution layer results in a feature map of size 504x1.
[0173] Mapping and Spatial information
[0174] The main idea is to map a sensed neural signal x into its equivalent to any position of a multichannel system. Some definitions are needed to explain in detail the method to create NG generative networks: - Reference positioning systems (RPS): Sensor positions on the scalp (or any other relevant area) according to some standard. Most common configurations for high density EEG systems are the International 10-20 or 10-10 systems. Other specific configurations exist in a variety of wearable sensing devices. - Device’s sensor positions (ΦXY): Positions in the scalp used by the device to record input data, according one reference positioning system. - Position subsets (ΦY): Groups of positions from the ensemble of RPS. Groups need to follow a neuro-anatomic repartition, hence included positions are in close proximity. At least, two position subsets are needed. In practice, its number isdetermined by the number of desired augmented channels. Therefore, ΦY= {Φ1, Φ2, … ΦNG}. Position subsets contain at least two positions of at least one RPS. - Generator training dataset (GTDk): An ensemble of neural signals recorded in a position subset. Each dataset is used to train a generator Gk.
[0175] The aim of creating position subsets is to obtain generators specialized at generating signals from a neuro-anatomical area, but not limited to specific electrode locations. This provides flexibility to include positions from different RPS, and hence, any recording device.
[0176] In a possible configuration illustrated in figure 10, a 10-20 international system and 11 groups is employed to form the reference subsets and hence, the generators.
[0177] Figure 10 is an illustration of a scalp and electrodes positioned according to the 10-20 International system. 11 different reference subsets (Φ1,… Φ11) are highlighted in different grey levels. Frontal subset (Φ1, at the top and in center of the figure) comprises Fp1, Fp2, FpZ, AF3, AF4, AFz, F1, F2 and FZ. Left frontal subset, Φ2, comprises: F3, F5, F7, F9, AF7. Left temporal subset, Φ3 comprises: FT9, FTP7, T9, T7, TP9 and TP7. Left temporal-central, Φ4 comprises: FC5, FC3, C5, C3, CP5 and CP3. Central subset, Φ5 comprises: FC1, FCZ, FC2, C1, CZ, C2, CP1, CPZ and CP2. Left posterior subset, Φ6 comprises: P9, P7, P5, P3 and PO7. Posterior subset, Φ7 comprises: P1, PZ, P2, PO3, PO2, PO4, O1, OZ and O2. Right positions are surrounded by dotted lines of the same gray level for their left equivalent subsets.
[0178] In a possible configuration, the generators are created to map a single EEG channel recorded in the ear canal. Without an identical position in the 10-20 system, the equivalent position Φxy is T9.
[0179] Pre-training generators Gk
[0180] The pre-training of each generator Gk may consist in the following steps:
[0181] Data preparation
[0182] In order to correctly pre-train each generator, the training data needs to be prepared. This preparation consists in:
[0183] First of all, define position subsets which may depend on the specificities of the neural biometric authentication system implementing the method. If the login system is based on the brain response to certain stimuli, then subsets need to encompass areas where targeted mental states can be properly mapped (e.g. emotions can elicit bilaterally asymmetric neural responses). If the login system is cross-state, then a homogenous distribution of positions is more appropriate. Once the number of position subsets and their components are defined, generator training datasets can be built.
[0184] Secondly, select a multichannel neural data from a public and / or private dataset. To ensure the generalizability of the system and the effectiveness of the pre-training process, the following aspects needs to be considered: - High Signal-to-Noise Ratio, ensuring accurate and reliable measurements. - Inclusion of various recording devices. - Inclusion of various mental states: a range of mental states is necessary, including resting states with both opened and closed eyes, mental load, evoked emotions, and other relevant cognitive processes. If the authentication system is designed for a specific cognitive task, the data must capture the corresponding cognitive processes. - Sufficient subject diversity and number to ensure representative sampling, encompassing a diverse user population. - Proper anonymization and good data acquisition practices, ensuring that individual identities are protected, and data collection is conducted responsibly and ethically.
[0185] Thirdly, pre-process the training data to minimize artefacts by applying the same procedures than the one described in the pre-processing step S20. It is to be noted that this third step is optional but the pre-training gives better results when the pre-processing is done.
[0186] Fourth, select channel data belonging to a subset k (k=1, …, NG) and cut into segments of t seconds (input data is buffered in t seconds segments).
[0187] Fifth, repeat the process until NG datasets are complete.
[0188] Initialize pre-training parameters
[0189] When using a U-net or a deep learning architecture, the initialization of the pre- training parameters is realized as follow, defining: - for the generator having a U-net architecture: the number of layers, number of filters, filters size and convolutions for the encoder and the decoder pathways. During initial iterations, the number of layers can be small (e.g. 3) and increase up to 8 for example but not limited to. - for the discriminator, defining the number of convolution layers, number of filters and size of filters. - the learning rate (step size taken during each update of the model’s parameters) - the batch Size (number of samples used in each iteration of the training process) - the loss function (equation (2))
[0190] Advantageously, a validation strategy may also be processed to ensure that the pre-training is correctly done and gives reliable results. A possible strategy is to employ K-fold cross-validation method to evaluate the transformation performance with K = 10, for example, which means that 90% of subjects were randomly selected as a training set, and 10% were used for testing.
[0191] Adversarial pre-training process
[0192] The discriminator is trained in an alternating fashion with the generator. In each round of training, the discriminator is first trained on a batch of real data. The discriminator is then trained on a batch of fake data generated by the generator. The discriminator's loss function is minimized in each training iteration.
[0193] Briefly, the procedure to train the generator and the discriminator is as follows:
[0194] 1 - Initialize the generator and discriminator randomly.
[0195] 2 - Train the discriminator on a batch of real data and a batch of fake data generated by the generator, while minimizing the discriminator's loss function.
[0196] 3 - Train the generator on the feedback from the discriminator, while minimizing the generator's loss function.
[0197] 4 - Repeat steps 2 and 3 until the generator is able to generate data that is indistinguishable from real data. The generator is then ready to generate user representative synthetic data from the received neural data {Nr} of the user 10 (respectively the pre-processed and / or analyzed neural data {Np / a}, or the at least one 1D or 2D neural data slice when available).
[0198] Generator fine-tuning
[0199] Advantageously, a fine-tuning can be used to improve the realism of the generated user representative synthetic data by using the pre-trained generative model on data from different subjects, devices and tasks.
[0200] This fine-tuning requires to collect data from new users to be able to generate individual-like neural data acquired with a specific sensor (not necessarily the same used to build the pre-trained generative model). This new data is called enrollment dataset.
[0201] This collect may be done by a system implementing the method which would guide the new users through a visual / audio interface to acquire the enrollment dataset. Then, data quality may be assessed. When quality is considered satisfactory, then the systems may record the new user’s data in various mental states (enrollment tasks); for example: resting with opened / closed eyes, performing mental computations, evoking emotions, processing visual, audio, tactile or other sensorial stimuli and other cognitive tasks. Eventually, enrollment dataset might ask the new user to repeat some of the tasks in another time of the day or another day to deal with intra-user variability of neural data.
[0202] Given that only a few samples from a new user may be available to fine-tune the pre-trained generative model, an incremental learning is preferably used. Incremental learning is a process of training a model on a series of small datasets. Each dataset is added to the model one at a time. The pre-trained generative model can be then fine-tunedon the new dataset. An exemplary implementation of this fine-tuning procedure is as follows: 1- Split the enrollment dataset into a training set (80%) and a validation set (20%). 2- Train the U-Net generator on the training set by freezing the weights of the pre- trained generative model. 3- Evaluate the performance of the U-Net generator on the validation set. If the U- Net generator is not overfitting to the training set, proceed to step 4. Otherwise, adjust the hyper-parameters of the U-Net generator and repeat step 3. 4- Add a new layer to the U-Net generator. The new layer can be added to the U-Net generator to learn the features of the new data. 5- Fine-tune the U-Net generator on the validation set. The U-Net generator can be fine-tuned using backpropagation. 6- Evaluate the performance of the U-Net generator on the validation set. If the U- Net generator is not overfitting to the validation set, proceed to step 7. Otherwise, adjust the hyper-parameters of the U-Net generator and repeat step 6. 7- Repeat steps 4-6 until the U-Net generator is able to generate realistic user representative synthetic data from the new subject.
[0203] User representative synthetic data generation for ID process
[0204] Once the generative networks (i.e., generator models) are fine-tuned by using the enrollment dataset, they are ready to proceed to generate the user representative synthetic data {Ns} (respectively {Is} when the pre-training and the fine-tuning are realized on 1D or 2D neural data slices) for ID purposes.
[0205] Advantageously, if data qualities (at step S30) or authentication success ratios (at step S100) are low, the method may further comprise asking the user 10 to repeat some of the enrollment tasks described before.
[0206] In one alternative embodiment, the generative network may be a Conditional Variational Autoencoder (CVAE).
[0207] A Conditional Variational Autoencoder (CVAE) is a generative model consisting of an encoder (E) and a decoder (D). The encoder (E) maps the input signal X{Nr}, and aconditioning variable xi(the target channel position in X{Ns}) into a latent vector z. The decoder (D) reconstructs the signal yi for the target channel from the latent vector z and the conditioning variable xi by sampling from the conditional distribution pVAE(yi|z, xi). During training, the distribution of the latent vectors is regularized to ensure that the latent space is smooth and continuous, and that similar inputs are mapped to similar points in the latent space. This allows for effective and coherent generation of new signals.
[0208] More formally, the approximate inference q(z|X{NR}, xi) during training is used as the encoder network to produce z, and pVAE(yi|z, xi) is used as the decoder network to generate the output signal. The trade-off between the encoder and decoder is achieved by maximizing the variational lower bound ℒ(2):
[0209] where: - The first term of the subtraction, is the expected log-likelihood of the output signal given the latent space.
[0210] - The second term of the subtraction is the Kullback-Leibler (KL) divergence between the approximate posterior 2(^|C{9:}, ^<) and the prior =>?@(^|^<).
[0211] The prior =>?@(^|^<)is often chosen to be a standard normal distribution for simplicity. The approximate posterior 2(^|C{9:}, ^<) is typically modeled as a Gaussian distribution parameterized by a neural network.
[0212] Generative procedure using CVAEs (generating G1-GNG models) may be implemented as follows:
[0213] Steps 1 to 4 are identical than the GANs procedure
[0214] 5. Feed encoder i with an input, concatenating X{Nr} and mapping position (xi)
[0215] 6. Obtain latent space and parameters for the latent distribution
[0216] 7. Feed decoder with the latent space to reconstruct the original input
[0217] 8. Compute loss as a combination of reconstruction loss and the KL divergence
[0218] 9. Regularize and stabilize training procedure, adjust hyperparameters
[0219] 10. Monitor the model’s performance using a validation set.
[0220] 11. Go to step 5 and train next CVAE
[0221] Step S70: generating at least one individual biometric identifier (IBI)
[0222] The purpose of this step S70 is to generate at least one individual biometric identifier, or IBI, used to label and describe the user 10. Said at least one individual biometric identifier generated may serves to enroll users (i.e. register a new user 10 based on one or more IBI, see step S110), or verify (i.e. authenticate) the user 10 (see step S100).
[0223] When the biometric data 20 received comprise at least neural data {N} of the user 10, the at least one IBI is generated from at least said user representative synthetic data {Ns} using a biometric identity (ID) (generation) model. This biometric ID model is based on a deep neural network architecture, preferably a transformer-based model, such as a temporal and / or spatial transformer encoder.
[0224] In one embodiment, this biometric ID model is a sequence model, well-suited for processing sequential data to properly capture long-term dependencies and temporal patterns specific to an individual. A long short-term memory (LSTM) model or, preferably a transformer-based model, such as a temporal and / or spatial transformer encoder may be implemented. Said transformer may be previously trained on multichannel EEG datasets, such as public repositories, containing a plurality of subjects, channels and mental states (i.e., neural signals acquired while the subject is a mental state). Once trained, the transformer-based model can be fine-tuned with enrollment data. Alternatively, a pre-trained model specifically on neural data may be used then directly fine-tuned with enrollment data.
[0225] In one example, a BENDR (BErt-inspired Neural Data Representations, where BERT stands for Bidirectional Encoder Representations from Transformers) may be used as transformer-based model.
[0226] In the case where the neural data received {Nr} come from only one or two channels, said at least one IBI is generated by using said neural data received {Nr} (respectively said pre-processed and / or analyzed neural data {Np / a} when available) in addition to said user representative synthetic data {Ns} (also called first IBI in the present description).
[0227] The following paragraphs comprises an example of the use of a BENDR model to compute IBI from user representative neural signals
[0228] BENDR (BErt-inspired Neural Data Representations), inspired by natural language processing and speech recognition techniques, leverages self-supervised learning to adapt Transformer models for EEG data analysis. It utilizes contrastive predictive coding to pre-train on vast EEG datasets. This allows BENDR to extract generalizable features from unlabeled data, making it a powerful tool for various downstream EEG tasks like classification. The model's architecture combines convolutional layers with a Transformer encoder to generate robust EEG representations (encoded vectors).
[0229] The reference {Ns}(e)will be used to designate an enrollment dataset for an individual, of size [Nw, Nc, Np], where Nw is the number of segments or sequences, Nc is the number of channels, and Np is the number of data points.
[0230] The procedure to fine-tune the BENDR model using {Ns}(e)is as follows: 1. Reshape and prepare data: Structure {Ns}(e)into sequences of typical dimension handled by Transformers [Nw, Np, Nc]; wherein Nw is the number of sequences; Np is the sequence length, Nc is the feature dimension (number of channels); 2. Adapt the input layers: Ensure that the input dimensions of the BENDR model match the dimensions of {Ns}(e). If different number of channels, adjust the input layer accordingly. 3. Modify the output layers:i. Replace the classification layer with a fully connected (dense) layer that outputs a fixed-size encoded vector; ii. Determine the Embedding Dimension: choose an appropriate size for the encoded vector if the default embedding dimension (1536) needs to be changed 4. Training Configuration: Set up the training loop to fine-tune the BENDR model and learn the encoded vectors (contrastive self-supervised learning) using the following training parameters and configurations: i. Loss function: BENDER may use contrastive loss, which penalizes the model when it fails to place similar data points closer together in the embedding space and dissimilar points further apart. ii. Hyperparameters: 1. Learning Rate: Size of steps taken to update model weights during training. (Too high: unstable, too low: slow learning). 2. Weight Decay: Penalty on large weight values, prevents overfitting. 3. Cosine Learning Rate Decay: Gradually reduces learning rate over training, helps with smooth convergence. 4. Transformer Mask Probability: Chance of masking parts of the input data, forces model to focus on different sections during training. 5. Extract and store encoded vector.
[0231] When the biometric data 20 received comprise more modalities, in addition to the neural data {N} of the user 10, such as physiological data {P} and / or anatomical data {A}, the identity – ID – generating module (250) is configured to generate a set of IBI comprising one or more IBI. The set of IBI generated, the identity – ID – generating module 250, may comprise, (optionally depending on a first configuration parameter): - a first IBI obtained from at least said synthetic data {Ns} and received neural data {Nr}; - a second IBI obtained from said physiological data {P}; - a third IBI obtained from said anatomical data {A}; and / or- a first mixed IBI obtained from a combination of at least said first IBI (obtained from said user representative synthetic data {Ns} and neural data {Nr}), said second IBI (obtained from said physiological data {P}) and / or said third IBI (obtained from said anatomical data {A}), wherein the first mixed IBI, the second IBI and / or the third IBI are comprised in the set of IBI.
[0232] The first configuration parameter may be a binary, configured so that if it is set to one the first mixed IBI is calculated or if it is set to zero it is not calculated. The first configuration parameter could be set by the user or based on the quality of the signals received.
[0233] In the case where at least one modality is converted into at least one 1D or 2D data slice {IN, IP and / or IA} (and optionally depending on a second configuration parameter), the at least one set of IBI generated may comprise: i. a first complex IBI obtained from said second user representative synthetic data {Is} and the at least one converted data representative of said neural data {N}, the first complex IBI being comprised in the set of IBI; and / or ii. a second complex IBI obtained from the at least one converted data representative of said physiological data {P}; and / or iii. a third complex IBI obtained from the at least one converted data representative of said anatomical data {A}; and / or iv. a second mixed IBI obtained from a combination of at least said first complex IBI and at least one among said second complex IBI and said third complex IBI; the second complex IBI, the third complex IBI and the second mixed IBI being comprised in the set of IBI
[0234] Furthermore, in the case where the at least one 1D or 2D data slice obtained for each modality {IN , IP and / or IA} are merged into a unique 1D or 2D data slice {INPA}, (and optionally depending on a third configuration parameter) the at least one set of IBI generated may comprise:• at least one conjugated IBI obtained from said unique converted data, the at least one conjugated IBI being comprised in the set of IBI; and / or
[0235] a third mixed IBI obtained from a combination of at least said user representative synthetic data {Ns} and said neural data {Nr}, and said unique converted data, the third mixed IBI being comprised in the set of IBI. Finally, in the case where at least one external user identifier {EID} is also received, the set of IBI (i.e., at least one IBI) generated may comprise a combined individual biometric identifier generated by combining one of the above-cited IBI (depending on the configuration parameters) to said at least one external user identifier {EID}.
[0236] In the following paragraphs will be described an example of use of a sequence model using multiple data modalities.
[0237] A sequence model may effectively integrate the different biometric data modalities (i.e., neural, physiological and anatomical). By mixing complementary data modalities, the model’s performance is enhanced providing additional robustness and security in IBIs. An example of such sequence model comprising one encoder for each modality is represented in figure 16.
[0238] To train such a sequence model the following steps are needed: 1. Compute a latent vector for each of the modalities using separate encoders suitable for each modality. 2. Combine latent vectors by concatenating them 3. Train the multimodal sequence model with combined latent vectors.
[0239] In one exemplary implementation, the multimodal sequence model can be a pre- trained BENDR. In this case, the fine-tuning procedure will consider as input the combined latent vectors.
[0240] Individual encoders may differ according to the modality. Preferably, they will be implemented by pre-trained models as they have already learned useful features from large datasets. To output a latent vector, several models specifically designed for each type of data may be adopted. For example, for neural data may be used a EEGNet whichis a Deep CNN pre-trained for BCI applications, a Wave2Vec which is a sequence model for speech adaptable to EEG, or a BENDR which is a Transformer model effective to extract EEG characteristics. For the physiological data may be used a DeepPPG: Convolutional network to capture the periodic nature of PPG, WaveNet which is a Sequence model capturing long-range dependences, adaptable to ECG or a TSception: Temporal and spatial convolutional network for EMG-based recognition and motor imagery tasks. In the case of anatomical data it may be used a ResNet (Deep CNN pre- trained on a large image database) or a VGGNet (simple and effective deep CNN pre- trained on ImageNet).
[0241] It is to be noted that, for security and privacy issues, raw biometrical data 20 (neural N and physiological P signals, A anatomic data) are not stored. The at least one IBI is a latent vector that capture the essential features of the biometrical signals received while minimizing interpretability. In the present method, the only information requiring to be stored is the at least one IBI, that, moreover can benefit of an additional encryption procedure (see step S80).
[0242] For enhanced security, the encoder models used in this step S70 can be modified in various ways, including retraining them with different hyper-parameters and introducing a secret key during certain stages of encoding. Such modifications may be valuable in preventing information leaks. If the encoder model requires reconstruction, the only inconvenience for users would be to repeat the enrollment procedure.
[0243] Figure 11 illustrates an exemplary implementation of step S70, wherein the biometric ID model comprises three generators: a neural ID generator, a physiological ID generator and an anatomical ID generator, and wherein the set of IBI comprises: an IBI “IBI_N” (i.e., first IBI) representative of the neural data received {Nr}, an IBI “IBI_P” (i.e., second IBI) representative of the physiological data received {Pr}, and an IBI “IBI_A” (i.e., third IBI) representative of the anatomical data received {Ar}.
[0244] To capture time-domain information from EEG, for example, the Temporal Transformer Encoder (TTE) extracts temporal correlations in neural data. Given that user representative synthetic data {Ns} may be multichannel, spatial correlations can beextracted and fused to temporal ones in a Spatial Transformer Encoder (STE). The IBI thus obtained, IBI_N, is a vector encoding spatio-temporal, low level characteristics of the EEG sample.
[0245] TTE takes into account the long-distance dependence in time. The pre-processed neural data {Np} may be directly feed into the transformer, instead of employing transformations such as convolutions or trainable linear projections. For a given input X = [x1, x2, ..., xM] ∈ ℝT×M(and T being the number of data points for that input sample and M being an integer which may be representative of the total number of the real {Nr / p / a} and / or synthetics channels {Ns}), a self-attention may be computed in the transformer to estimate temporal correlations, and then the sum is weighted to obtain the new representation. Self-attention is computed as:
[0246] Equation 3:
[0247] where Q, K, and V are all matrices obtained by linear projections of the input and dk is a scalar factor. To jointly attend to information from different representation subspaces at different positions, multi-head attention mechanism on the input can be employed. Each transformer encoder is composed by two units: multi-head attention (MHA) and multi-layer perceptron (MLP). Each unit employs residual connection and layer normalization (LN) to improve the speed of training and robustness of the model. Figures 12a and 12b illustrate the above calculation process. Particularly, Figure 12a illustrates a general architecture of a transformer encoder and Figure 12b details the multi-head attention block architecture. The TTE part can be expressed by:
[0248] Equation 4: ℎTU= ^V(WXG(^TUYZ)+ ^TUYZ), [ = 1,2, ... , ^
[0249] Equation 5:1,2, ... , ^
[0250] STE. The channels in the EEG signal represent the locations of the electrodes on the scalp, and the functional connectivity between different brain regions can be calculated by considering the dependencies among different channels. Similar to TTE, in STE an attention mechanism to model the spatial information among different channels can be used. In order to preserve the spatial location information, the position encoding of the spatial domain to the input can be added, then the result can be fed to STE:
[0251] Equation 6:
[0252] where tran() represents the transpose operation and the εpos∈ ℝM×Trepresents the position encoding. In a possible implementation, the position encoding can be represented in the form of a trigonometric function at a fixed position. ^_^denotes the representation with the addition of spatial position information. The STE, employs a similar structure than the TTE to learn the spatial information on the different channels of the neural signals. The process equation is expressed as:
[0253] Equation 7: ℎT_= ^V(WXG(^T_YZ) + ^T_YZ), [ = 1,2, ... , ^
[0254] Equation 8: ^T_= ^V(W^G(ℎT_)+ ℎT_), [ = 1,2, ... , ^
[0255] Advantageously, the neural ID model is trained using a large number of EEG data, including different types of sensors and mental states, including resting with closed and opened eyes, mental calculations, induced emotions, visually and auditory evoked potentials, among others. A possible source of training data may be public datasets such as Physionet, Muse 2018 (which includes wearable EEG) and many others.
[0256] Regarding the IBI_P representative of the physiological data received {Pr}, a possible implementation is to use a temporal transformer encoder with single-channeldata to obtain temporal correlations. The output of this module, IBI_P, is a vector encoding the temporal, low level characteristics of PPG.
[0257] Regarding the IBI_A representative of the anatomical data received {Ar}, a possible implementation is to use a CNN to 2D anatomical data slices, for example.
[0258] Step S80: Encrypting and transmitting IBI
[0259] The aim of this step S80 is to allow the at least one IBI previously generated to be securely send into a communication network 30, in order to be able to remotely authenticate the user 10. Thus, it is required to encrypt the IBIs before transmitting the data through a designated communication protocol.
[0260] This encryption ensures that the sensitive biometric information remains protected during data transfer. This robust security measure adds an extra layer of assurance, safeguarding the integrity and confidentiality of the transmitted login data (i.e the IBIs). To ensure the security and the anonymization of the data transmitted several operations may be processed such as: de-identification wherein all identifiable information linked to the data and other personally identifiable information (PII) are removed or replaced; noise addition wherein the noise is designed to obfuscate individual- level data while preserving aggregate-level trends and patterns; and data shuffling wherein the order of the data is randomly rearranged ensuring that individual data points cannot be linked back to the original source.
[0261] Advantageously, the encryption can be implemented using a symmetric encryption algorithm, such as Advance Encryption Standard (AES). The encrypted IBIs may then be processed by a wireless transmission module.
[0262] Step S90: Receiving and decrypting IBI
[0263] When the at least one IBI has been encrypted and transmitted into a communication network 30, it is necessary to receive the encrypted IBI(s) and to decrypt it (or them if there are a plurality of IBIs), before comparing the IBI(s) or storing the IBI(s) depending on said predetermining condition. The decryption is made according to the encryption protocol used on the IBI(s).
[0264] Step S100: Comparison between the IBI and a user’s signature
[0265] As described before, the comparison between the IBI and a user’s signature is realized depending on a predetermined condition. This predetermined condition may be, for example: at least one user’s signature is already stored in the memory 40.
[0266] In this case where such a predetermined condition is validated, the IBI(s) generated (respectively the IBI(s) decrypted) is(are) compared to said at least one user’s signature stored in a memory 40.
[0267] Depending on login mode (single factor, double factor, etc) corresponding to the modalities used to generate the IBI(s), the IBI(s) will be compared to a corresponding user’s signature coming from the same modalities. For example, a neural IBI, representative of only the neural data, will be compared to a neural signature of the user 10. Respectively, a physiological IBI will be compared to a physiological signature of the user 10 and an anatomical IBI will be compared to an anatomical signature. The same reasoning may be applied to combined or mixed IBI(s) which will be compared to combined or mixed signature(s) when a plurality of modalities will be simultaneously used in the IBI or in the stored signature.
[0268] At the end of the comparison, an authentication result is outputted. This authentication result may be a percentage, a binary value like 0 / 1, an “Identity – ID - confirmed” / “Success” response or an “Invalid ID” / “Failure” response, for example.
[0269] This comparison, also called template or identity matching, is based on measuring the similarity of the IBI(s) to the user’s signatures stored in memory 40. A possible implementation includes measuring the distance between the IBI(s) and the stored signatures. Distance metrics can be Euclidean, Mahalanobis and others. Support vector machines or neural networks can also be trained to solve template matching.
[0270] Step S110: Saving IBI as a user’s signature
[0271] As described before, the registration of the generated IBI (respectively the decrypted IBI) as at least one user’s signature is realized depending on a predetermined condition. This predetermined condition may be, for example: the absence of a user’ssignature recorded in the memory 40 (meaning that an enrollment is required), a user’s signature stored but having a low quality index, and / or an IBI generated having a quality index greater than the quality index of a user’s signature recorded in the memory 40.
[0272] In this case, where such a predetermined condition is validated, the IBI(s) generated (respectively the IBI(s) decrypted) is(are) saved in the memory 40 as a user’s signature(s) which can be used in for the comparison made in step S100.
[0273] Figure 13 illustrates a functional diagram relative to step S100 and S110, wherein the predetermined condition is whether the user 10 is enrolling (if yes step 110 is processed, if no step S100 is processed) or is wanting to overwrite / remove one of the user’s signatures recorded in the memory 40 at the end of Step S100 (if yes step S110 is processed).
[0274] Step S120: Sending authentication result
[0275] In order to inform the user 10 of the authentication result, the method may further comprise sending to a recipient an information signal representative of said authentication result. Said recipient may be said user 10 or an external user interface, and said information signal may be at least one of: a visual signal, an auditory signal, a kinesthetic signal, an olfactory signal, a gustative signal, or any other signal adapted to the external interface. The information signal may be, for example: a visual notification, an auditory notification, images or animation, a video notification, a popup or tooltip, an email or SMS notification, a dynamic interface change, a biometric confirmation, a voice recognition feedback, or a haptic feedback.
[0276] Furthermore, in case of success the method may also send the appropriate token to grant the access to a requested service (banking, vehicle access, …) and provide feedback to the user interface.
[0277] Step S130: Controlling external stimulation device
[0278] The purpose of this step S130 is to strengthen the authentication and security of the identification. In fact, the delivery of an external stimulating device to said user 10will made the user react and generate a feedback signal which will be integrated to the biometric data received.
[0279] Depending on the nature of the stimulus delivered (i.e. visual, auditory, kinesthetic, olfactory, and / or gustative), the feedback signal will affect at least the neural data {N}, and may also affect the physiological data {P}, and thus the new IBI(s) generated by the method on this new biometric data received.
[0280] Step S140: Receiving external user ID {EID}
[0281] In the same manner as step S130, the aim of step 140 is to reinforce the authentication and the security of the identification by integrating an external user ID {EID} in the at least one IBI generated. For example, the external user ID {EID} may be at least one of: fingerprint, facial recognition, iris scan, voice pattern, or any other type of external user ID known by a skilled person.
[0282] Advantageously and as previously described in this case, generating said at least one individual biometric identifier comprises generating a combined individual biometric identifier by combining said at least one individual biometric identifier to said at least one external user identifier {EID}.
[0283] NEURAL BIOMETRIC AUTHENTICATION SYSTEM
[0284] The method for securely authenticate a user, as previously described in the different embodiments, can be implemented in a neural biometric authentication system 1000 as illustrated in figure 14.
[0285] The system 1000 comprises three main modules: - a receiving module 100; - an encoding module 200; and - a recognition module 300.
[0286] These main modules can be implemented on at least one processor.
[0287] Receiving module 100
[0288] The receiving module 100 is configured to implement the receiving step S10 and according to any one of the above-cited embodiments of step 10. Furthermore, the receiving module 100 is also configured to receive a predetermined condition as well as some optional configuration parameters.
[0289] Advantageously, the receiving module 100 is also configured to implement step S130 when an external device is connected to the system 1000. Advantageously, the receiving module 100 may also be configured to receive a feedback signal from the user 10 when a sensory stimulus has been delivered to the user 10. In general, the receiving module 100 may also be configured to receive any other information or signal, when the system 1000 is connected to another device or apparatus, such as an external stimulation device for example, with which information needs to be exchanged.
[0290] Encoding module 200
[0291] The encoding module 200 comprises at least two main submodules: an augmentation module 230 and an Identity – ID – generating module 250, wherein the augmentation module 230 is configured to implement step 60 according to any one of the above-cited embodiments of step 60, and wherein the ID generating module 250 is configured to implement step S70 according to any one of the above-cited embodiments of step 70.
[0292] The augmentation module 230 may comprise at least one first generative model configured to receive as input said received neural data {Nr} and generate user representative synthetic data {Ns}. The augmentation module 230 may further comprises at least one second generative model configured to receive as input the at least one converted data representative of said neural data {N} and to generate second user representative synthetic data {Is}.
[0293] As illustrated in figure 14, the encoding module 200 may comprise optional submodules such as:
[0294] a pre-processing module 210 configured to implement step S20 and / or step S30 according to any one of the above-cited embodiments of steps S20 and S30;
[0295] a conversion module 220 configured to implement step S40 according to any one of the above-cited embodiments of step S40.
[0296] a fusion module 240 configured to implement step S50 according to any one of the above-cited embodiments of step S50; and / or
[0297] a transmission module 260 configured to implement step S80 as previously described, and may also be configured to transmit any other information or signal, when the system 1000 is connected to another device or apparatus, such as an external stimulation device for example, with which information needs to be exchanged.
[0298] Recognition module 300
[0299] The recognition module 300 comprises at least an Identity – ID – management module 320 configured to implement at least steps S100 and S110 according to any one of the above-cited embodiments of steps S100 and S110. Advantageously, the ID management module 320 is also configured to implement step S120 and / or step S140 according to any one of the above-cited embodiments of steps S120 and S140.
[0300] In another embodiment, the recognition module 300 also comprises a decrypting module 310 when the encoding module 200 comprises the transmission module 260. The decrypting module 310 is configured to implement step S90 as previously described.
[0301] According to another embodiment, the system 1000 may further comprise a memory 40 configured to store at least one user’s signature. Advantageously, the predetermined condition as well as the optional configuration parameters may also be stored in the memory 40.
[0302] [TECHNICAL ADVANTAGES OF THE METHOD AND SYSTEM]
[0303] The method and system 1000 previously described provide a solution that simplifies the user authentication process while enhancing security and efficiency for both users and service providers. Particularly, the method and system 1000 offer several advantages, such as:
[0304] User convenience and efficiency of Service Providers: the at least one individual biometric identifier – IBI – based on at least the neural data received, offers a universal login which eliminates the need for users to remember multiple sets of login credentials. Instead, they can use a single set of credentials across various platforms, reducing the burden on users and enhancing the user experience. Implementing such a universal login system also streamlines the account management process for service providers. They can leverage a standardized authentication infrastructure, reducing costs, improving security, and enhancing overall efficiency.
[0305] Enhanced security: the at least one generated individual biometric identifier – IBI – does not contain any direct biometric data anonymizing these data, which cannot be easily replicated or spoofed. This makes it more secure than methods that rely on external devices or easily-imitated physical characteristics, such as a face or a voice. Furthermore, the method and system 1000 incorporate advanced security measures, such as multifactor authentication with the use of the physiological and / or anatomical data as well as an external user identifier, biometric verification (cf. step S100), or other robust authentication mechanisms. By promoting strong security practices, the method and system mitigate the risks associated with weak passwords and the reuse of credentials.
[0306] Unique biometric measure: Neuro-cognitive based ID systems are being increasingly used because cognition is inherently unique. The way each individual process external stimuli, emotions and memories depends on neurogenesis, which is conditioned both on genetic and environmental factors. Consequently, each individual has a neuro-cognitive print identity. The at least one individual biometric identifier – IBI – is based on direct or indirect measures of the neuronal networks in the brain. Neurons generate time-changing electrical waves at several frequencies that can be measured by non-invasive (surface) or invasive (intra-cortical) sensors and also change blood oxygenation due to their activity. Sensors can be specifically designed to capture the electrical currents (electrodes), magnetic fields (magnetometers) or blood oxygenation changes in the brain (optodes). The most widely used technology for measuring neural activity is the electroencephalogram (EEG). This unexpansive, non-invasive technology uses surface electrodes on the head, mostly on the scalp, but also on the ears and into theear canal. The singularity of each user is established by creating a comprehensive profile, said at least one IBI, based on their specific neural data. This profile serves as a distinctive identifier that sets individuals apart from one another. By analyzing various aspects of the EEG signals for example, such as frequency, amplitude, and spatial distribution, a comprehensive representation of the individual's brainwave pattern is created. Unlike other forms of identification, such as fingerprints or facial recognition, neural data are internal and not easily manipulated or replicated by external means. This attribute enhances their effectiveness as a means of identification, making them a reliable biometric measure for user authentication. By leveraging the individualistic nature of the neural data of the user 10 and incorporating advanced analysis techniques, the at least one IBI provides a robust and difficult-to-forge means of authentication for various applications and systems.
[0307] Flexibility and versatility: The method and system 1000 are hardware agnostic, meaning they can be integrated into a variety of head-mounted apparatuses, such as headphones, earbuds, glasses, and augmented reality and virtual reality headsets. This allows users to access their digital space using their preferred apparatus in a variety of settings. EXAMPLES OF APPLICATION OF THE AUTHENTICATION METHOD AND / OR SYSTEM
[0308] The following use cases are given as illustrative examples of application of the authentication method and / or system previously described, it will thus be appreciated that those skilled in the art will be able to devise various use cases that, although not explicitly described or shown herein, embody the principles of the disclosure and are included within its spirit and scope.
[0309] As illustrated in figure 15, the method and system 1000 previously described may be use for accessing to a digital wallet 70. For example, the user 10 is on their smartphone 60 with connected earphones comprising the system 1000, and at the moment of payment through one of their bank cards entered into their Cards section via anenhanced verification step using the at least one individual biometric identifier (IBI). A similar use case is to securely accessing to a personal cloud.
[0310] More generally, the method and system 1000 previously described offer to the user the ability to store their self-custodial private keys and can take advantage of an interface for managing cryptocurrencies, monitoring balances of any imaginable digital asset, traditional currencies or financial products, and executing transactions, notably between two user profiles. At any given time, they can choose to back up their encrypted keys to a cloud system for synchronization and recovery purposes.
[0311] As stated previously, the method and system 1000 allow the user to maintain their private digital identity, without divulging any personal information. The authenticated user, being unique, can obtain a unique digital token. These method and system 1000 enable users to enter their credentials once, and in exchange, they receive a unique encrypted string of random characters. The user can then use this token to access protected systems instead of having to enter their credentials again or undergo new biometric authentication. The digital token confirms that they already have access permission.
[0312] Furthermore, the user can authenticate offline. The system 1000 can memorize the user's brainprint without the need for wired connections like Ethernet (LAN), Fiber Optic Connection, DSL (Digital Subscriber Line), ADSL (Asymmetric Digital Subscriber Line), ISDN (Integrated Services Digital Network), etc., or wireless connections such as Wi-Fi, 5G, 4G LTE, Bluetooth, Satellite Internet, etc.
[0313] Regarding all dematerialized access, a possible application of the method and system is replacing the current CAPTCHA system for verifying human authenticity based on brain data. The user 10 attempting to access a protected online service is prompted to wear a non-invasive brain-computer interface (BCI) device, such as an electroencephalogram (EEG) headset including the system 1000.
[0314] In another use case, the method and system 1000 can be utilized for a keyless vehicle access system based on biometric brain signals. For instance, user 10 can wear a Bluetooth earpiece incorporating system 1000 to gain access to their vehicle, such as a car, bike sharing service, electric scooter, and so on (the list is not exhaustive). When thevehicle detects the presence of a nearby earpiece, either through Bluetooth or another communication method, it initiates a biometric analysis session using the aforementioned method. The vehicle is equipped with a receiver element that ensures positive access for the authenticated user. To facilitate this process, the user receives a notification on their smartphone when they approach their vehicle, alerting them about an upcoming physiological data analysis session involving various signals. If the analysis is successful, the user is notified of successful login through a feedback notification, which could be in the form of a visual or auditory signal, or a haptic response involving a slight vibration. It is worth noting that the system can also operate independently without requiring the user to have a smartphone. In such cases, the test session proceeds directly through the system using an auditory signal or a slight haptic vibration to notify the user.
[0315] Another possible use case relates to spatial computing, wherein the user 10 establishes a connection to their personal profile / space using the system 1000, instead of a conventional Optic ID system. For instance, the system 1000 seamlessly integrates into the emerging spatial UX / UI era. Upon successful authentication, a dynamic interface change can be triggered, enabling the user to navigate through a customized digital world tailored to their personal user experience. The User Interface (UI) and User Experience (UX) intelligently adapt to the user's preferences and behaviors upon logging into their profile.
Claims
CLAIMS 1. A neural biometric authentication system (1000) for securely authenticating a user (10), the system comprising: • a receiving module (100) configured to receive biometric data (20) of said user (10), said biometric data (20) comprising at least neural data {Nr} of said user (10), said neural data {Nr} comprising at least one neural signal SNfunction of time and of at least one channel, said at least one channel covering a predefined area of said user’s head (S10); • an encoding module (200) comprising: - an augmentation module (230) configured to generate user representative synthetic data {Ns} by using at least one first generative model configured to receive as input said received neural data {Nr}, wherein said at least one first generative model has been previously pre-trained on neural data obtained from a plurality of subjects at different mental states, from different recording devices, and acquired by at least two channels (S60); - an identity – ID – generating module (250) configured to generate a set of individual biometric identifiers – IBI – comprising at least one first individual biometric identifier – IBI –, said at least one first IBI being generated from at least said generated user representative synthetic data {Ns} and said received neural data {Nr} using a biometric identity – ID – model, said biometric ID model being a previously trained Transformer-based model (S70); • a recognition module (300) comprising an identity – ID – management module (320) configured to, depending on a predetermined condition: - compare said set of individual biometric identifiers – IBI to at least one user’s signature stored in a memory (40) and output an authentication result (S100); or - save said set of individual biometric identifiers – IBI as at least one user’s signature (S110) in said memory (40).
2. The system according to claim 1, wherein said at least one generative model is configured for generating said user representative synthetic data {Ns} comprising synthetic neural signals function of time and of at least one synthetic channel, said at least one synthetic channel covering an area of said user’s head different from said specific area covered by said at least one channel of said received neural data {Nr}.
3. The system according to either one of claim 1 or 2, wherein said at least one generative model is a Generative Adversarial Network – GAN – based model using a convolutional neural network architecture, said at least one generative model being fine-tuned with an enrollment dataset, and wherein said enrollment dataset comprises recording neural data of said user (10) at various mental states and / or at various times of a day.
4. The system according to any one of claim 1 to 3, wherein said biometric data (20) further comprises physiological data {P} and / or anatomical data {A}.
5. The system according to any one of claim 4, wherein the identity – ID – generating module (250) is further configured to generate: • a second IBI obtained from said physiological data {P}and / or a third IBI obtained from said anatomical data {A}, wherein the second IBI and / or the third IBI are comprised in the set of IBI; and / or • a first mixed IBI obtained from a combination of at least said at least one first IBI being generated from said user representative synthetic data {Ns} and said received neural data {Nr}, said second IBI obtained from said physiological data {P} and / or said third IBI obtained from said anatomical data {A}, wherein the first mixed IBI is comprised in the set of IBI.
6. The system according to any one of claim 1 to 5, further comprising: • a pre-processing module (210) configured to: - pre-process said received biometric data (20) by applying at least one of: a bandpass filter, an alignment, an artifact removal, and / or a standardization (S30);- analyze said received biometric data (20), respectively said pre- processed biometric data when available, and compute a quality parameter (S20); and / or wherein the augmentation module (230) is configured to receive said pre- processed and / or analyzed neural data {Np / a} and, to generate said user representative synthetic data {Ns} by using said pre-processed and / or analyzed neural data {Np / a} instead of the received neural data {Nr}.
7. The system according to any one of claims 1 to 6, further comprising: • a transmission module (260) configured to encrypt each individual biometric identifier – IBI – of the set of IBI and transmit each encrypted IBI through a communication network (30) (S80); • a decrypting module (310) configured to receive and decrypt each encrypted IBI (S90); wherein, depending on said predetermined condition, said ID management module (320) is configured to: • compare each decrypted IBI to at least one user’s signature stored in said memory (40) and output the authentication result (S100); or • save said each decrypted IBI as at least one user’s signature in said memory (40) (S110).
8. The system according to any one of claims 4 to 7, further comprising a conversion module (220) configured to convert at least one among said neural data {N}, said physiological data {P}, and said anatomical data {A}, into respectively a neural converted data, a physiological converted data and / or anatomical converted data, wherein said neural converted data is a 1D or 2D representation of said neural data {N}, said physiological converted data is a 1D or 2D representation of said physiological data {P} and said anatomical converted data is a 1D or 2D representation of said anatomical data {A} (S40).
9. The system according to claim 8, wherein: • the augmentation module (230) further comprises at least one second generative model configured to receive as input the at least one converteddata representative of said neural data {N} and to generate second user representative synthetic data {Is}; and • the identity – ID – generating module (250) is further configured to generate: i. a first complex IBI obtained from said second user representative synthetic data {Is} and the at least one converted data representative of said neural data {N}, the first complex IBI being comprised in the set of IBI; and / or ii. a second complex IBI obtained from the at least one converted data representative of said physiological data {P} and / or a third complex IBI obtained from the at least one converted data representative of said anatomical data {A}, the second complex IBI and the third complex IBI being comprised in the set of IBI; and / or iii. a second mixed IBI obtained from a combination of at least said first complex IBI, and at least one among said second complex IBI and third complex IBI, the second mixed IBI being comprised in the set of IBI.
10. The system according to claim 8, further comprising: • a fusion module (210) configured to merge the at least two among converted data obtained for said neural data {Nr}, said physiological data {P}, said anatomical data {A} into a unique converted data {INPA} by using at least one fusion model, said unique converted data being a 1D or 2D representation of a combination of said neural data {N}, said physiological data {P} and / or said anatomical data {A} (S50), wherein, the identity – ID – generating module (250) is further configured to generate, depending on a third configuration parameter: • at least one conjugated IBI obtained from said unique converted data, the at least one conjugated IBI being comprised in the set of IBI; and / or• a third mixed IBI obtained from a combination of at least said user representative synthetic data {Ns} and said neural data {Nr}, and said unique converted data, the third mixed IBI being comprised in the set of IBI.
11. The system according to any one of claims 4, 5, 8, 9 or 10, wherein: • the physiological data {P} comprise at least one of: a first optical signal and / or an electrical signal representative of a measurement of a vascular or muscular function of the user (10), such as a photoplethysmyography or an electromyography, and / or a first acoustic signal such as a bioacoustics-based signal like the user’s voice, coming from at least one specific physiological sensor; and • the anatomical data {A} comprise at least one of: a second optical signal and / or a second acoustic signal representative of morphologic information or density information relative to the user (10), such as a broadband ultrasound attenuation, quantitative ultrasounds, bioacoustics-based techniques, a computed-tomography image or a magnetic resonance image, coming from at least one specific anatomical sensor.
12. The system according to any one of the preceding claims, wherein the receiving module (100) is also configured to receive at least one external user identifier {EID} (S130), and wherein the ID generating module (250) is configured to generate a combined individual biometric identifier by combining said at least one individual biometric identifier to said at least one external user identifier {EID} (S70).
13. The system according to any one of the preceding claims, wherein said ID management module (320) is further configured to send to a recipient an information signal representative of said authentication result, said recipient being said user (10) or an external user interface, and said information signal being at least one of: a visual signal, an auditory signal, a kinesthetic signal, an olfactory signal, a gustative signal (S120).
14. The system according to any one of the preceding claims, further comprising:• a stimulation module configured to control an external stimulation device configured to deliver to said user (10) at least one sensory stimulus, said sensory stimulus being at least one of: a visual stimulus, an auditory signal, a kinesthetic signal, an olfactory stimulus; and wherein the receiving module is further configured to receive a feedback signal from said user (10) in response to said at least one delivered sensory stimulus.
15. The system according to any one of the preceding claims, wherein the system is embedded in an apparatus, said apparatus being one of: an earbud or earphone, a headband, an earring, a headset such as an augmented Reality – AR - headset, a Virtual Reality – VR - headset, a Mixed Reality – MR - headset, smart glasses.
16. A computer-implemented method for securely authenticating a user (10), the method comprising: • receiving biometric data (20) of said user (10), said biometric data (20) comprising at least neural data {Nr} of said user (10), said neural data {Nr} comprising at least one neural signal SN function of time and of at least one channel, said at least one channel covering a predefined area of said user’s head (S10); • generating user representative synthetic data {Ns} by using at least one first generative model configured to receive as input said received neural data {Nr}, wherein said at least one first generative model has been previously pre-trained on neural data obtained from a plurality of subjects at different mental states, from different recording devices, and acquired by at least two channels (S60); • generating generate a set of individual biometric identifiers – IBI – comprising at least one first individual biometric identifier – IBI –, said at least one first IBI being generated from at least said generated user representative synthetic data {Ns} and said received neural data {Nr} using a biometric identity – ID – model, said biometric ID model being a previously trained Transformer-based model (S70); anddepending on a predetermined condition: - compare said set of individual biometric identifiers – IBI to at least one user’s signature stored in a memory (40) and output an authentication result (S100); or - save said set of individual biometric identifiers – IBI as at least one user’s signature (S110) in said memory (40).