Analyzing brain function using behavioral event markers from portable electronic devices

Through portable electronic devices recording and analyzing the behavioral output of smartphone users, the problem of neuronal activity monitoring in smartphone touch screen interaction is solved, and high-resolution neuronal activity analysis is realized outside the laboratory, supporting detailed monitoring and health of brain functions. diagnosis.

CN114126489BActive Publication Date: 2024-11-12LEIDEN UNIVERSITY
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202080047459.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-05-24
Filing Date
2020-05-22
Publication Date
2024-11-12
Estimated Expiration
2040-05-22

AI Technical Summary

Technical Problem

The prior art is difficult to effectively monitor and analyze the user's brain neuronal activity in smartphone touch screen interactions, especially the lack of high-resolution time landmarks and synchronous neuronal recordings in daily behaviors.

Method used

An event-based analysis method was developed to record user behavior outputs using portable electronic devices (such as smartphones) and determine user event-related neuron activations, even outside the laboratory without requiring them to be used to compare them with predefined behavior outputs. Any stimulus can monitor and identify changes in neuronal activity.

Benefits of technology

The ability to monitor user neuronal activity on-site outside the laboratory is realized, able to identify the development and changes in user neuronal activity, provide detailed analysis of brain function, and support the diagnosis of health and disease, especially early diagnosis and treatment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114126489B_ABST
    Figure CN114126489B_ABST
Patent Text Reader

Abstract

A method (10) for monitoring user neuronal activity, the method comprising recording a user behavioral output using a portable electronic device (such as a mobile phone). The user behavioral output (14) is compared (18) to a predefined behavioral output, the predefined behavioral output being associated with a known event-related neuronal activation (20). The event-related neuronal activation (22) of the user is determined based on the comparison to provide an indication of the user's neuronal activity.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to methods and systems for analyzing brain function of a user, such as a user of a portable electronic device. The present invention also relates to using a portable electronic device, such as one having a touch screen, to analyze brain function of a user of the device. Background Art

[0002] Smartphones can be operated with just a few gestures on the screen - mainly taps and swipes, which allows users to engage in a wide range of activities. According to recent estimates, young people generate approximately 4,000 touchscreen touches per day. For voluntary, self-paced motor control ("VSPMC") in which an individual's finger presses a button, neuronal processing in the individual's brain may begin 1.5-2 seconds before the finger moves (Shibasaki, H. & Hallett, M., Clin. Neurophysiol. 117, 234-2356 (2006). The resulting brain electrical signal, when measured from the scalp (e.g., EEG), is negative and gradually rises over time and peaks when the button is pressed. This widely studied signal is divided into: preparation potential ("RP"), movement potential ("MP") and reafferent potential ("RAP"), which reflects different stages of motor control, such as motor preparation, execution and processing of the resulting proprioception, respectively. The RP is thought to be central to higher brain function and may hold biomarkers for the initiation of intentional action. The subsequent MP and RAP are thought to be closely related to generating motor cortical output and monitoring ongoing movement. However, these empirical insights cannot be simply applied to smartphones. For example, on a smartphone's touchscreen, a pair of touches is typically separated by less than 500 milliseconds, which is much shorter than the normal preparation time for self-paced button presses. In addition, in contrast to the nearly constant results of laboratory button presses, the touches can produce a range of consequences - from shopping to dating. Therefore, the time course of the neuronal signals behind personal smartphone movements remains unclear.

[0003] Correlations between neuronal activity and behavioral output are identified by synchronizing neuronal recordings and behavioral output recordings, such as using at least two devices with synchronized clocks, where the output of each device is plotted along a single time axis. Summary of the invention

[0004] Continuous monitoring of neuronal activity with sub-second resolution over long periods of time provides new opportunities to understand and assess brain function. The advent of mobile EEG has enabled long-term neuronal recordings outside the laboratory. It is not just electrodes implanted in the brain that can collect neuronal data for years. A significant obstacle to analyzing these brain signals is the absence of high-resolution temporal landmarks in everyday behavior. In contrast, traditional laboratory-based measurements can powerfully utilize landmarks such as visual evoked potentials—> time of artificial visual stimulation, somatosensory evoked potentials—> time of artificial shock or touch, and movement-related potentials—> time to indicate a button press.

[0005] An unexplored avenue for event-based analysis of brain signals during spontaneous behavior is the development of high-resolution smartphone touchscreen events.

[0006] However, despite this access, the described pathway is not without obstacles: (a) it is not known whether touchscreen interactions have any consistent patterns of neuronal activity associated with them, and (b) typical event-related analyses depend on synchronizing independent clocks to millisecond resolution, preventing seamless analysis of neurobehavioral data even if smartphone events are collected and a consistent pattern is known.

[0007] The inventors' research has determined that previous work based on laboratory tasks provides some reasonable expectations about the nature of neuronal signals surrounding smartphone interactions. For example, the inventors have determined that US2017 / 351958 (on behalf of the University of Zurich and the University of Fribourg) relies on regression models and only provides "predicted brain responses" to users. US2017 / 351958 involves estimating "brain states" and allowing users to change device usage (through self-regulation) based on their needs. US2017 / 351958 explicitly requires "sensory stimulation"; and teaching multiple usage data sets from multiple different users is an essential feature for generating a computational interference model. However, the inventors hereby novelly develop methods for the present application, which can determine the event-related neuronal activation of a user by comparing with predefined behavioral outputs, which are associated with known event-related neuronal activations. The inventors have uniquely determined that this determination can be performed on-site outside the laboratory without any stimulation, as described in detail herein. The inventors even initially determined the ability to use the monitoring of on-site behavioral outputs to determine changes in the user's neuronal activity over a period of time, sequentially and remotely identifying the development of the user's neuronal activity.

[0008] Various theoretical and empirical works in neuroscience have shown that the brain neuronal circuits that are generally believed to be involved in the details of individual VSPMC are key factors in individual higher-level cognition as well as individual social interaction and emotions. For example, an individual's MP is inhibited by increased cognitive load without obvious motor effects, and stimulation with emotional load inhibits MP-related signals. The effects can be explained by the simultaneous involvement of different neuronal processes that are intertwined with sensorimotor processing in cognitively demanding situations.

[0009] Theoretical and empirical work has also shown that event-based analysis of brain signals focusing on sensory events can reveal aspects of brain function in health and disease. For example, laboratory-derived visual evoked potentials are routinely used to detect visual processing abnormalities in multiple sclerosis, stroke, or epilepsy.

[0010] However, there is an unmet need for methods and systems to better analyze the function of such neuronal circuits of the brain; such as they engage in voluntary, self-paced motor control of an individual and have a range of possible behavioral outputs (e.g., pressing a button with a finger, etc.). There is also an unmet need for methods and systems to capture multiple parts of neuronal processing simultaneously without the need for specialized tasks or tests.

[0011] According to aspects of the present disclosure, a method for monitoring user neuronal activity is provided. The method may include recording user behavior output outside the laboratory; and / or spontaneous behavior using restricted instructions in the laboratory (such as "check messages using a smartphone"). The method may include recording user behavior output on site and / or in the laboratory. The method may include recording user behavior output inconspicuously. The method may include recording user behavior output on site. The method may include recording user behavior output without simulation, such as without artificial simulation. For example, the method may include recording user behavior output during unprompted natural activity(ies). The method may include recording user behavior output without stimulation, such as without artificial stimulation. The method may include recording user behavior output with a portable electronic device. The portable electronic device may include a handheld device, such as a mobile phone (e.g., a smartphone). The portable electronic device may include a wearable device or an implant (e.g., a smart watch, etc.). The method may include using multiple devices to record user behavior output.

[0012] The method may include comparing the user behavior output with a predetermined behavior output. The predetermined behavior output may include a known behavior output, such as a historically determined one. The predetermined behavior output may be compiled in a database. The predetermined behavior output may be based on the user's historical behavior output. For example, the predetermined behavior output may include a user's previously recorded or observed behavior output. Additionally or alternatively, the predetermined behavior output may include other users' previously recorded or observed behavior outputs. The predetermined behavior output may be predetermined before performing the method for monitoring the user. In at least some examples, the method may include a pre-monitoring step or process. The pre-monitoring step or process may include compiling the predetermined behavior output, such as in a database. Compiling the predetermined behavior output may include observing and / or recording multiple behaviors of the user and alternatively other users; such as using a device or multiple devices in the field and / or in a laboratory.

[0013] The predetermined behavior output can be recorded or observed with a portable electronic device, such as the same portable electronic device used to record the user behavior output in the current method for monitoring the user's neuronal activity. Additionally or alternatively, the predetermined behavior output can be recorded or observed with different devices. For example, the predetermined behavior output can be recorded in advance with the same portable electronic device, and can be additionally recorded, such as in a laboratory, with another behavior output recording device, such as a camera for observing the user. In other examples, different devices may include a portable electronic device of another user, such as where at least some of the predetermined behavior output is based on the predetermined behavior output of another user.

[0014] The behavioral output may be associated with event-related neuronal activation. For example, the behavioral output of a device interaction, such as a touch screen touch, may be associated with a specific neuronal activation (e.g., the event-related neuronal activation may include a neuronal activation associated with a specific motion control that causes the touch). Each behavioral output may be associated with a corresponding event-related neuronal activation. The event-related neuronal activation may include a known event-related neuronal activation. The event-related neuronal activation may include an event-based neuronal activation. The event-related neuronal activation may be associated with an input supply to or toward an electronic device. The input may include one or more of the following: gestures, touches, sound inputs, such as voice commands, sequences, series. For example, the input may include a specific sequence of gestures and / or touches. The touch may include a "touch in the air," whereby there is no actual physical contact between the user and the interface, such as whereby the movement of the user's finger toward the device before contact is terminated, withdrawn, or redirected. Such a "touch" or gesture may be recorded or observed by a portable electronic device (e.g., one / multiple proximity sensors and / or one / multiple cameras such as a smartphone). The behavioral output may be indicated by an input to or toward an electronic device. The behavioral output may include one or more of the following: one / more taps; one / more swipes; one / more gestures; button presses; touch screen touches; air touches; touches; sound input; voice commands; sequences; series; and / or another self-paced action control output.

[0015] The method may include determining event-related neuronal activation based on observed or recorded behavioral output. The method may include determining event-related neuronal activation based only on observed or recorded behavioral output. The method may include determining event-related neuronal activation depending on behavioral output. The method may include determining event-related neuronal activation without observing or recording, such as directly recording or observing neuronal activity. The method may include determining event-related neuronal activation without a neuronal recorder. The method may include determining event-related neuronal activation without synchronizing behavioral recordings or observations with neuronal recordings. The method may include determining event-related neuronal activation without synchronizing all behavioral recordings or observations with neuronal recordings. The method may include determining event-related neuronal activation outside of a laboratory. The method may include determining event-related neuronal activation in the field. The method may include determining event-related neuronal activation in an asynchronous manner, such as without clock synchronization, without a behavioral output recorder and a neuronal recorder. The method may include determining event-related neuronal activation depending on a user's spontaneous, non-artificial activity or stimulation, such as a user's normal daily activities.

[0016] The method may include an asynchronous association between a behavioral output and an event-related neuronal activation. The method may include an asynchronous determination of an event-related neuronal activation based on an observed or recorded behavioral output. The method may include deriving an event-related neuronal activation dependent on the behavioral output. The method may include matching or identifying a behavioral output with an asynchronously observed or recorded event-related neuronal activation. For example, the method may include identifying a behavioral output and associating the behavioral output with a previously recorded or observed event-related neuronal activation. The method may include classifying the behavioral output. The method may include determining an associated event-related neuronal activation dependent on a classification of the behavioral output.

[0017] The method may include compiling a database of multiple neuronal activities and corresponding behavioral outputs. The method may include compiling a database of event-related neuronal activations, such as a database of previously recorded or observed event-related neuronal activations. The method may include compiling a database by matching data from a behavioral output recorder and a neuronal recorder. The data matching may include pattern matching to identify event-related neuronal activations, the event being associated with the recorded behavioral output. In at least some examples, the pattern matching includes synchronous time-based pattern matching. For example, database compilation may include synchronous, synchronized neuronal and behavioral output records. Accordingly, events may be identified from behavioral output records and corresponding neuronal activations identified based at least in part on identifying neuronal activity within corresponding recording times or corresponding time windows or intervals. For example, neuronal activity associated with a behavioral output may be stimulated or identified as being initiated before the behavioral output, such as by a time interval associated with a lag or delay between the neuronal activity that stimulates motor control and the behavioral output caused by the motor control. Additionally or alternatively, database compilation may include asynchronous pattern matching. For example, pattern matching can include the identification of sequences or patterns of behavioral outputs and matching those sequences or patterns with corresponding sequences or patterns of neuronal activity, thereby eliminating the need for commonality of absolute or relative timing between neuronal and behavioral recordings.

[0018] Accordingly, a device such as a database may be provided for associating a behavioral output with a neuronal activity or vice versa. The database may provide a plurality of identifiable event-related neuronal activations. Subsequently, the database may be used to identify the other of the neuronal activity or the behavioral output based on one of the behavioral output or the neuronal activity. For example, then using only a behavioral output recorder, the associated neuronal activity may be identified based on matching the pattern from the recorded behavioral output with the pattern stored in the database. Accordingly, the neuronal activity associated with the behavioral output may be identified to provide an indication of the event-related neuronal activation.

[0019] It should be understood that the database may be supplemented or adjusted after it is established. For example, additional data or input may be used to identify additional event-related neuronal activations. Similarly, the database may be updated to reflect recognition biases or adaptations of patterns, such as over time and / or with different or additional users and / or behavioral outputs.

[0020] The method may include comparing a user's behavioral output with event-related neuronal activations that match a pattern associated with a behavioral output recorder having a known pattern to identify the event-related neuronal activations. The known pattern may have been previously established using a neuronal recorder. The method may include determining the event-related neuronal activations of the user based on a comparison of the user's behavioral outputs and predetermined behavioral outputs such as stored in a database. The method may include determining the event-related neuronal activations of the user based on the comparison so as to provide an indication of the user's neuronal activity. The method may include identifying the development of the user based at least primarily on monitoring of the behavioral output recorder in the form of a portable electronic device alone.

[0021] The method may include recording a plurality of behavioral outputs of a user; and using the plurality of behavioral outputs to determine the neuronal activity of the user. The plurality of behavioral outputs may be continuous over a period of time. The plurality of behavioral outputs may be recorded by the same single behavioral output recorder, such as a smartphone. Alternatively, the plurality of behavioral outputs may be recorded by a plurality of devices, such as a smartphone of the user and a tablet or laptop of the user.

[0022] The method may include sequentially determining the user's neuronal activity over a period of time. The method may include determining any changes in the user's neuronal activity over a period of time. Changes in the user's neuronal activity may be associated with the user's development. For example, the development may be associated with an improvement or deterioration in the user's neuronal activity. The development may be associated with the user's health. The method may include associating the user's neuronal activity with one or more of the following: physical health; mental health; one or more physical developments; one or more psychological developments; treatment; disease; diagnosis. For example, the method may include identifying developments in specific areas or regions of the brain based at least primarily on recorded behavioral outputs. For example, changes in identified event-related neuronal activation over a period of time may be associated or associable with specific functions or regions of the brain. Accordingly, the changes may be associated or associable with corresponding changes in functions and / or regions of the brain. The changes may be associated with damage or disease and / or treatment thereof. For example, the method may include diagnosis, particularly early diagnosis, of a disease associated with a specific function or region of the brain. For example, the method may include identifying or diagnosing the development and / or treatment of a disease or ailment, such as one or more of the following: brain damage; brain disease; cancer; tumor; Parkinson's disease, multiple sclerosis; dementia; cerebral palsy; stroke; epilepsy. In at least some examples, changes in neuronal activation associated with identified events over a period of time represent specific changes in the function or condition of a specific area of ​​the brain, such as identified in the illustrated example (e.g., in the contralateral sensorimotor cortex). The method may include alerting the user and / or a third party, such as a medical professional; to the development or change. The alert may include a real-time alert, such as an emergency alert. Additionally or alternatively, the method may include monitoring influences on neuronal activity, such as associated with user-based activities; medications; recreational activities or drugs; or the like. Additionally or alternatively, the method may include monitoring the user's behavior and / or development, such as in social aspects.

[0023] In at least one example, the method of the present disclosure works by empirically aligning the two data streams of a person's known taps and the person's continuously recorded brain signals, such as using Figure 1 The method enables event-related analysis of neuronal data to be generated by utilizing known features of SmRP. It should be understood that in at least some examples, once the signals are aligned, the data can be processed in: (a) time-voltage space: x-axis time, y-axis voltage; and / or (b) frequency-power space: x-axis frequency of brain signal, y-axis power; and / or (c) other parameters. It should be understood that although the alignment of signals of form "a" is shown here, subsequent analysis can be in any dimension (e.g., "a", "b" and / or "c").

[0024] According to another aspect, a method of simulating or modeling the method and / or apparatus according to any other aspect, embodiment, example or claim is provided.

[0025] Another aspect of the present disclosure provides a computer program comprising instructions configured to implement a method according to any other aspect, example, claim or embodiment when executed. Another aspect provides a machine-readable memory storing such a program. The memory may be non-transitory.

[0026] According to an aspect of the invention, computer software is provided which, when executed by a processing device, is arranged to perform a method according to any other aspect, example, claim or embodiment. The computer software may be stored on a computer readable medium. The computer software may be tangibly stored on a computer readable medium. The computer readable medium may be non-transitory. The computer software may include a smartphone application, such as a background application.

[0027] According to an example of the present disclosure, a method for analyzing the function of a neuronal circuit of an individual's brain is provided. Here, the circuit is involved in the individual's voluntary, self-paced motor control of pressing a button with a finger. Here, the method includes: measuring a smartphone-related potential ("SmRP") of the individual's brain when the individual, particularly with the individual's thumb, uses the touch screen of a smartphone; and then comparing the SmRP measurement of the individual's brain with standard SmRP measurements of other individuals' brains when other individuals, particularly with other individuals' thumbs, use the smartphone touch screen. Such measurements can be used to compile a database of neuronal activity corresponding to behavioral outputs.

[0028] According to an example of the present disclosure, a system for analyzing the function of a neuronal circuit of an individual's brain that is involved in the individual's voluntary, self-paced motor control of pressing a button with a finger is provided, the system comprising: a smartphone with a touch screen; a device for scanning the individual's brain to measure the SmRP of the individual's brain when the individual, particularly with the individual's thumb, uses the smartphone's touch screen; and a method for comparing the measured SmRP of the individual's brain with standard measurements of SmRP of other individuals' brains when other individuals, particularly with other individuals' thumbs, use the smartphone's touch screen.

[0029] According to an example of the present disclosure, a use of a smartphone is provided for analyzing the function of a neuronal circuit of an individual's brain that is involved in the individual's voluntary, self-paced motor control of pressing a button with a finger, the use comprising: determining the SmRP of the individual's brain when the individual, in particular with the individual's thumb, uses the touch screen of the smartphone; and comparing the determined SmRP of the individual's brain with standard determined values ​​of the SmRP of other individuals' brains when other individuals, in particular with other individuals' thumbs, use the touch screen of the smartphone.

[0030] The present invention includes one or more corresponding aspects, embodiments, examples or features, either alone or in various combinations, whether or not specifically described in that combination or alone (including claims). For example, it is readily understood that features that are optional with respect to the first aspect may additionally apply to other aspects without explicitly and unnecessarily listing those various combinations and arrangements here (e.g., a method of one aspect may include features of any other aspect). Optional features described with respect to the method may additionally apply to an apparatus or device; and vice versa. An apparatus or device of an aspect, example, embodiment or claim may be configured to perform features of the method of any aspect, example, embodiment or claim. In addition, corresponding devices for performing one or more of the functions discussed are also within the present disclosure.

[0031] It should be appreciated that one or more embodiments / aspects may be used to at least monitor a user.

[0032] The above summary is intended to be illustrative only and not limiting.

[0033] Various aspects and features of the present disclosure are defined in the following claims.

[0034] The goal of certain embodiments of the present disclosure may be to at least partially solve, mitigate or eliminate at least one of the problems and / or disadvantages associated with the prior art, such as described herein or elsewhere. Certain embodiments or examples may be intended to provide at least one of the advantages described herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] - Figure 1 An example of a method for compiling a database containing event-related neuronal activations is shown.

[0036] - Figure 2 An example of a method of monitoring a user's neuronal activity using a behavioral output recorder without a neuronal recorder is shown.

[0037] - Figure 3Figure 2 shows the SmRP of a touch screen event, and the rapid engagement of different cortical processes around the event. (a) shows the isolation of the SmRP by aligning the touch screen event when a user uses their own smartphone with recorded EEG signals. (b) shows the time course of the overall mean of the signal detected on the scalp from the selected electrodes and the corresponding standard error of the mean. (c) shows the topology of the overall mean signal detected on the scalp. (d) shows the corresponding results of a one-sample t-test. (e) shows the delay of the onset of a statistically significant signal. (f) shows the offset of the onset of a statistically significant signal.

[0038] - Figure 4 Figure 2 shows how signals over the sensorimotor cortex are suppressed when using social applications versus non-social applications. (a) Shows the population-average kinematic profiles for thumb movements for social and non-social applications. The shaded area depicts the standard error of the mean. (b) Shows the time course of the regression-adjusted population-average—for trial-to-trial kinematic variation—of the EEG signal. The inset shows the unadjusted signal; the shading depicts the standard error. (c) Shows the topology of the population-average adjusted signal, and the results of a paired t-test comparing the SmRPs collected from social and non-social applications.

[0039] - Figure 5 Figure 1 shows how the signal over the sensorimotor cortex flips between an "air touch" and an actual touchscreen touch. (a) shows the overall average of the kinematic trajectories of thumb movement during an "air touch," i.e., when thumb flexion occurs in the absence of a touchscreen event and an actual touchscreen event. (b) shows the time course of the overall average electroencephalogram signal recorded over the sensorimotor cortex. (c) shows the topology of the overall average signal for air touch and touchscreen touch detected on the scalp, and the results of a paired t-test comparing the two event types. DETAILED DESCRIPTION

[0040] Figure 1An example of a method 10 according to the present disclosure is illustrated. The method 10 shown here includes compiling a database 20 of multiple neuronal activities and corresponding behavioral outputs. The method 10 includes compiling a database of event-related neuronal activations 22, which is a database of previously recorded or observed event-related neuronal activations. The method includes preprocessing 16 of unmatched data from a neuronal recorder 12 and a behavioral output recorder 14. The method 10 includes: compiling a database 20 by matching 18 data from a behavioral output recorder 14 and a neuronal recorder 12. Data matching includes pattern matching 18 to identify event-related neuronal activations 22, which are associated with recorded behavioral outputs. In at least some examples, pattern matching 18 includes synchronized time-based pattern matching. For example, the database 20 compilation includes synchronized, synchronized neuronal and behavioral output records. Accordingly, events 22 are identified from the following: behavioral output records 14 and corresponding neuronal activations identified at least in part based on the identification of recorded neuronal activities within corresponding recording times or corresponding time windows or intervals. For example, neuronal activity associated with a behavioral output is often stimulated or identified as being initiated before the behavioral output, such as by a time interval associated with a lag or delay between the recorded neuronal activity 12 to stimulate the motor control and the recorded behavioral output 14 caused by the motor control. It should be understood that additional or improved Figure 1 The method 10 may be continued, such as through subsequent iterations or steps, to expand and / or improve the database 20. For example, the patterns identified herein may be further refined as data is added. As the data collection pipeline improves, more detail in the patterns identified herein may emerge. For example, a small peak that occurs approximately 50 milliseconds after a touch (capturing touch-related brain activity) may not appear in the currently illustrated method (e.g., at the current resolution), but may be included in the method 10 and subsequent database 20 (e.g., with increased resolution or refinement).

[0041] Figure 2 An example of a method 110 according to the present disclosure is illustrated. The method is for monitoring the neuronal activity of a user. The method includes recording the user's behavioral output with a behavioral output recorder 114, which is typically a portable electronic device, such as a mobile phone. The method 110 includes comparing the user's behavioral output with a predefined behavioral output, the predefined behavioral output being associated with a known event-related neuronal activation. As shown here, the method includes utilizing pattern recognition 118 of the behavioral output and pattern matching with a pattern database 120 to determine the user's event-related neuronal activation 122 based on the comparison to provide an indication of the user's neuronal activity. Accordingly, the neuronal activation 122 is recorded in Figure 2 is effectively modeled in the methods of and is inferred or derived without directly measuring neuronal activity with the neuronal recorders themselves.

[0042] In at least some examples, the method includes recording a plurality of behavioral outputs of a user; and using the plurality of behavioral outputs to determine the user's neural activity. The method includes sequentially determining the user's neural activity over a period of time to identify the development of the user's neural activity. The method includes associating the user's neural activity with one or more of: physical health; mental health; one or more physical developments; one or more psychological developments; treatment; disease; diagnosis. The method includes comparing the user's behavioral outputs with event-related neuronal activations, the event-related neuronal activations matching a pattern associated with a behavioral output recorder having a known pattern to identify event-related neuronal activations; and the known pattern was previously established using a neuronal recorder. The method includes compiling a database of a plurality of neuronal activities and corresponding behavioral outputs. It should be understood that the method includes compiling a database and then performing monitoring of the user's neural activity, such as using Figure 1 It should be understood that Figure 2 The database 120 shown in FIG. 1 may be the same as that in FIG. Figure 1 The method includes pattern matching of behavioral outputs with neuronal activity to enable identification of either behavioral output or neuronal activity based on only one of the other. Database 120 is capable of identifying neuronal activity based only on recording or observing behavioral outputs without direct neuronal recording. Here, Figure 2 The method does not include synchronous behavioral output recorder and neuronal activity recorder. The method includes asynchronous recording of behavioral output and neuronal activity.

[0043] As will be described in more detail below, event-related neuronal activation is associated with input provided to a portable electronic device. The input includes one or more of: gesture; touch; sound input, such as a voice command; sequence; series. In at least some examples, the method includes a diagnostic method and the user includes a patient. Similarly, in at least some examples (potentially overlapping examples), monitoring includes assessing the user's cognitive function. For example, a cognitive task may involve processing of salient information, regardless of the modality used for the input. An individual's MP may be inhibited due to increased cognitive load without noticeable motor effects. Emotionally charged stimuli may inhibit MP-related signals. Accordingly, an assessment of behavioral output (via input to the device) may provide an indication of the user's cognitive function.

[0044] Figure 3A method for analyzing the function of a neuronal circuit in an individual's brain that is involved in the individual's voluntary, self-paced motor control of pressing a button with a finger is illustrated, the method comprising: measuring a smartphone-related potential "SmRP" in the individual's brain when the individual, particularly with the individual's thumb, uses a touch screen of a smartphone; and then comparing the SmRP measurement of the individual's brain with standard SmRP measurements of other individuals' brains when other individuals, particularly with their thumbs, use a smartphone touch screen. Figure 3 In "a", a series of consecutive "telephone taps" (represented by dots) and the corresponding EEG readings (represented by μ) are shown over a time interval.

[0045] As used herein, the term "smartphone-related potential" or SmRP preferably means one or more, preferably all, of the following: readiness potential ("RP"), motor potential ("MP"), reafferent potential ("RAP") of an individual's brain, which involves continuous post-motor sensory processing at tactile, visual, frontal and parietal electrodes.

[0046] The method involves comparing an individual's smartphone-related potential ("SmRP") for a touchscreen event with the individual's rapid engagement of different cortical processes surrounding the event.

[0047] Initially, SmRP was measured before and after any touchscreen event for an individual. To this end, the individual's EEG signal was measured when the individual made a spontaneous right hand (thumb) touchscreen touch on his / her own smartphone to reveal the neuronal activity surrounding the touchscreen event. The overall median of the inter-touch interval of the analyzed events can be 2s (a 700 millisecond inter-touch interval cutoff can be used to eliminate fast touchscreen events). It is estimated that the overall average of the EEG signal can capture statistically significant deviations from a 1-second long baseline starting 4 seconds before the touch. Flat recordings can last up to 704 milliseconds before the touch, and the earliest signals can be detected at the right parietal and occipital electrodes ( Figure 3 ). Based on the overall average, this posterior positive signal may be briefly followed by simultaneous activation of the frontal (negative) and parietal and occipital (positive) electrodes. The gap seen at the beginning of the signal between the posterior and anterior electrodes is also evident at the corresponding signal peaks. 400 milliseconds before touch, the negative signal over the contralateral (left) sensorimotor cortex may dominate the topology. At the time of the touch screen event (0 milliseconds after the event), the negative signal may additionally occupy the parietal and occipital electrodes bilaterally.

[0048] Then, SmRP was measured after individual touch screen events. Following a touch screen event, the signal over the sensorimotor cortex may begin to reverse from a negative state. Bilateral negative components over parietal and occipital electrodes may precede touch and may peak within the first 100 milliseconds after touch ( Figure 3 ). In the gross average signal, the negative peak latency is shortest over the sensorimotor cortex, followed by the frontal electrodes and then the parietal electrodes. In the following 200 milliseconds, these negative components can be completely replaced by different positive components occupying the central and frontal electrodes. 400 milliseconds after the touch screen event, the positive components can occupy the central and parietal electrodes. This propagation towards the posterior electrodes can continue to activate the parietal and occipital electrodes at 600 milliseconds. This sequential activation pattern from the frontal to the occipital electrodes is also evident in the latency of the signal peak. Although this activation wave can subside after 700 milliseconds, the signal over the left sensorimotor cortex can remain above baseline until 1995 milliseconds after the touch screen event.

[0049] Variations between individuals in the amplitude of the negative sensorimotor signal detected before touch suggest that the pre-touch negative state can be correlated with post-touch activity. Pre-touch activity can be correlated almost entirely via parietal and occipital electrodes. The higher the amplitude of pre-touch activity, the larger the positive component at parietal and occipital electrodes between 200 and 600 milliseconds.

[0050] The effects on the individual's pre-touch neuronal activity between social applications and non-social applications are also measured. In addition to measuring the individual's brain signals, the individual's thumb flexion and thumb extension are preferably measured, preferably recorded using a flexion sensor (see e.g. Figure 4 and Figure 5 Kinematically, the magnitude of thumb movements tended to be similar, but there was a trend toward greater movement when using nonsocial apps compared to social apps (differences did not tend to be statistically significant after correction for multiple comparisons ( Figure 4 (a). For either category, touchscreen events tended to begin with a brief thumb extension and descent (flexion) toward the screen approximately 600 milliseconds before touch (619 milliseconds for social apps and 571 milliseconds for non-social apps based on the overall mean). After touch, the thumb tended to retract from the screen faster than the descent toward the screen, having reached maximum flexion at approximately 400 milliseconds (341 milliseconds for social apps and 426 milliseconds for non-social apps based on the overall mean). The individual SmRPs were found to vary depending on the behavioral context. In this regard, the pre-touch SmRPs over the sensorimotor cortex were suppressed when engaging in social apps versus non-social apps, in terms of signal amplitude ( Figure 4 (c). At 500 milliseconds before the touch event, the signal amplitude was significantly reduced. The difference was mainly seen at electrodes over the sensorimotor cortex, but negative components connected to the left parietal and occipital electrodes were also suppressed, and this suppression lasted up to 100 milliseconds after the touch. The suppressed sensorimotor negative state was also present in the analysis of the kinematic unmodulated potentials.

[0051] The effect of "air touch" on SmRP was also measured. In this regard, when individuals use their smartphones, their thumbs tend to bend towards the screen without causing any touchscreen events ( Figure 5 (a). These "air touches" accounted for an average of 31.66% (±3.0% SE) of all thumb flexions toward the screen. In fact, it has been found that "air touches" are inversely proportional to the number of actual touch screen events (β=-0.0004, R2=0.667, p=2.01x10-07, t=-7, linear regression analysis). Since actual touch screen events occur at maximum flexion of the thumb, the EEG analysis can be correlated with said maximum flexion. It can then be seen that "air touches" and actual touch screen events share similar motion trajectories, starting with thumb extension, then flexion toward the screen (437 milliseconds before air touch, based on the overall mean), followed by withdrawal away from the screen (extension). However, the final extension of the "air touch" is not as extensive as that of an actual touch screen touch.

[0052] The SmRP before the “air touch” was also compared to the SmRP before the actual touch, starting at 680 milliseconds before the touch ( Figure 5 Medium b and Figure 5 (c). Notably, actual touch induces a strong pre-touch negative component over the sensorimotor cortex, whereas air-touch induces a positive component over the sensorimotor cortex. The positive component over the sensorimotor electrodes peaks at 487 ms (based on the ensemble average) before air-touch.

[0053] The method of measuring the different SmRP potentials, namely RP, MP and RAP, associated with touchscreen events involving smartphones, showed that serial neuronal activations are often involved. In this regard, touch is preceded by a back-to-front EEG signal flow and a strong activation of the sensorimotor cortex. It is followed by an opposite front-to-back signal flow, revealing different directions of cortical information flow associated with touching the screen and processing the consequences of the touch separately. The activation of the sensorimotor cortex is strongly modulated by the behavioral context of the application used and the recent consequences of the thumb movement (such as whether the movement is accompanied by a touch).

[0054] It has been found that with this approach, an individual's touchscreen movement can be prepared quickly, and the critical decision of an individual to touch or not touch the smartphone screen can occur with the initiation of the movement. The first consistent visible signal before a touchscreen event is detected on frontal and parietal (and occipital) electrodes approximately 700 milliseconds before the touchscreen event, while the thumb has been extended and lowered toward the screen approximately 600 milliseconds before the touch. This frontoparietal signal seen before the dominant negative state in the sensorimotor cortex is associated with visual motor attention and response selection. This shows that neuronal activity precedes the movement by only 100 milliseconds - 20 times faster than the 2-second preparation time observed in a slow laboratory finger tapping task. However, the extended thumb does not always lead to a touchscreen event, and begins approximately 700 milliseconds before the "air touch", which is accompanied by a different positive component on the sensorimotor cortex. Therefore, the decision process and motor control process behind the touchscreen event can be highly compressed on a smartphone. Although screen touches separated by 2 seconds are common, frequent ones are faster, separated by less than 500 milliseconds (median).

[0055] We also found that pre-touch negative states over sensorimotor cortex were suppressed when using social apps compared to non-social apps. This difference was evident from about 500 milliseconds before touch to about 100 milliseconds after touch, even when any contribution from fluctuations in movement amplitude was regressed out at the level of individual trials. This suggests that sensorimotor computations remain connected to the behavioral context through much of the ongoing action.

[0056] The SmRP potentials measured by this method show the following. First, touch is followed by a persistent negative state in the lateral sensorimotor cortex and an expansion of the bilateral negative state to occupy the parietal and occipital electrodes. These signals are likely to reflect the action monitoring and tactile visual confirmation of touch screen events. Secondly, there is a positive component that recruits the front electrode to the back electrode in sequence. This activity pattern and signal delay are consistent with the P3 (P300) component of the brain that reflects attention and memory. This wave is often observed in cognitive tasks involving the processing of salient information, regardless of the modality used for the input. The neuronal generator behind this signal may inhibit the flow of extraneous information, thereby enhancing the flow of information from the attention-attracting input from the frontal lobe to the parietal cortical structure to "enhance memory." In fact, cognitive processing after touch may be affected by the sensorimotor activity before touch, because the amplitude of the sensorimotor signal recorded before touch is correlated with the post-touch activity on the parietal and occipital electrodes.

[0057] Accordingly, it can be seen that patterns can be identified that match behavioral outputs to neuronal activity. Such patterns can be stored in a database. For example, a specific touch associated with a specific smartphone function can be matched to a specific neuronal activity. These patterns can then be used, such as in Figure 2In the method, event-based neuronal activation is identified purely based on behavioral output. Accordingly, a smartphone can be used as a behavioral output recorder, such as using software (e.g., a background application) to record user behavioral output. The behavioral output can be matched with patterns in a database in real time or subsequently to identify the user's neuronal activity. In particular, the development of the user's neuronal activity can be identified over a longer period of time. For example, the temporal changes in the user's event-related neuronal activation can be identified. Such changes can be associated with the user's improvement and / or deterioration. For example, if the user is a patient, such as a neurologist, changes in neuronal activity over a period of time can be identified based solely or at least primarily on the use of a smartphone, particularly the user's normal daily spontaneous smartphone use on site. Such changes may be associated or associable with physical or psychological changes (such as health). Accordingly, these changes may represent improvements, such as recovery or healing; or the changes may represent deterioration, such as medical setbacks. Accordingly, the behavioral output monitored by the smartphone application can serve as a trigger for taking action, such as requesting or initiating a consultation or laboratory analysis or follow-up with the user.

[0058] When other individuals use the touch screen of the smartphone, especially with their thumbs, the measured SmRP of the individual's brain can be compared with the standard measured values ​​of the SmRPs of the other individuals' brains. Through this comparison, one can easily analyze one or more of the individual's well-being, health, hobbies, preferences, fears, prejudices, loyalties, etc.

[0059] It will be appreciated that the method may be such that we can include an estimate of the "accuracy" of the alignment, and optionally differentiate between the results of healthy and diseased individuals. It will also be appreciated that the exact detailed shape of the SmRP may be improved. For example, as the database 20 grows, more peaks and valleys may be revealed or identified. In at least some examples, the coarse features shown here may remain stable, but the finer features may be altered.

[0060] More than 20% of the world's population uses smartphones, and touchscreen actions are among the most common, yet also among the simplest to perform. Understanding how these actions are generated could not only reveal fundamental insights into how the brain engages in complex behaviors, but could also provide new ways to measure brain function in ways that are relevant to the real world.

[0061] Also according to the present invention, a system for analyzing the function of a neuronal circuit in an individual's brain that is involved in the individual's voluntary, self-paced motor control of pressing a button with a finger is provided, the system comprising: a smartphone with a touch screen; a device for scanning the individual's brain to measure the SmRP of the individual's brain when the individual, particularly with the individual's thumb, uses the touch screen of the smartphone; and a method for comparing the measured SmRP of the individual's brain with standard measured values ​​of SmRP of other individuals' brains when other individuals, particularly with other individuals' thumbs, use the touch screen of the smartphone.

[0062] Also according to the present invention, a smartphone is used to analyze the function of a neuronal circuit of an individual's brain that is involved in the individual's voluntary, self-paced motor control of pressing a button with a finger, and the use includes: determining the SmRP of the individual's brain when the individual, in particular with the individual's thumb, uses the touch screen of the smartphone; and comparing the determined SmRP of the individual's brain with standard determined values ​​of the SmRP of other individuals' brains when other individuals, in particular with other individuals' thumbs, use the touch screen of the smartphone.

[0063] Example

[0064] A total of 45 people were recruited. The age of the sample ranged from 18 to 45 years (median age was 23 years).

[0065] Smartphone activity log

[0066] Touchscreen interactions and the timestamps of the corresponding applications were recorded by using a background application attached to a cloud-based data collection platform (TapCounter, QuantActions Ltd, Lausanne, Switzerland). The background application was installed 3–5 weeks before the laboratory-based EEG recordings. The data were downloaded from the cloud in compressed form and further processed using MATLAB (Mathworks, Natick, USA) using the data unpacking process provided by QuantActions.

[0067] Classification of social and non-social applications

[0068] The classification of social and non-social applications is mainly based on the definition used in the previous report. In detail, if the main purpose is to allow users to communicate with others (friends or strangers), then the application label captured on the phone is classified as social. The application must also contain tools to support these interactions, such as direct messages, public posts or voice chats, personalized profiles and the ability to rate or follow said profiles. Applications that do not meet the main purpose and come with said tools are labeled as non-social applications. A slightly changed definition is applied when classifying gaming applications - they are classified as social applications only if they engage with other users during gameplay rather than sharing the results after playing games alone.

[0069] Motion sensor recording

[0070] During the laboratory measurements of smartphone behavior, thumb flexion was tracked using a flex sensor (FlexSensor, 4.5", SpectraSymbol, Salt Lake City, USA). The sensor was attached to the thumb (dorsum) using a custom-made jacket, which allowed the sensor to bend inside the jacket without being pulled. The thumb was further covered with a conductive surface (aluminum foil), ensuring that all touches were converted into touchscreen events and that the same part of the thumb was used to aim at the screen. The analog signals from the sensor were digitized at a frequency of 1 kHz via a USB6008 DAQ (National Instruments, Austin, USA) using Labview. The same DAQ was also used to power the sensor. In this configuration, the thumb was able to move freely on the touchscreen. The movements were recorded together with synchronized triggers issued from the EEG recording setup.

[0071] EEG recording

[0072] EEG recordings were performed in a Faraday-shielded room (Holland Shielding Systems BV, Dordrecht, The Netherlands) with a fiber-optic Internet connection. The users used their own smartphones while reclining comfortably in a chair. White noise was presented experimentally using headphones. A 64-channel EEG cap (Easycap GmbH, The cap size was matched using head circumference measurement. EEG recordings were performed using a BrainAmpDC amplifier (Brainproducts, Gilching, Germany). The data sampling rate was set to 1 kHz and no online filters were applied during recordings. As the EEG, smartphone and motion sensors ran on different clocks, they were synchronized using a common TTL pulse burst generated via an IBMT42 motherboard running MATLAB.

[0073] To measure EEG signatures around smartphone behavior, users were provided with their own list of top 4 apps—the top 2 social and non-social apps ranked according to the number of touches generated in the previous weeks. Video apps such as youtube were removed prior to ranking. Users had 12 minutes to use each app, and usage was interrupted by a short break of 2 minutes, with the subsequent app launched and ready for use. The order of the apps was randomized. Social interactions were expected to be dominated by higher levels of text messaging compared to the non-social interactions. To enable comparisons between the social and non-social interactions, participants were instructed “not to engage in a lot of text messaging”—and the experimenter further monitored this using thumb flexion sensor measurements online. However, in situations where they considered typing essential for sustained engagement (e.g., when writing a short reaction to a posted picture), users were allowed to type about 50 characters. According to the debriefing interviews, users mainly browsed older posts, read and liked them, and made brief comments using emojis and a few characters.

[0074] Brain wave analysis and statistics

[0075] Temporal alignment between the smartphone touchscreen events and flex sensor recordings was confirmed using cross-correlation analysis (Signal Processing Toolbox, MATLAB). In 8 of the 45 participants, alignment could not be confirmed (R2<0.8) due to recording gaps or trigger alignment failures, and they were omitted from further analyses of social vs. nonsocial comparisons (kinematic adjustments) and in-air touch vs. actual touchscreen event categories. For further analysis, a threshold of 700 acceptable trials had to be met to establish the SmRP, and 350 trials (per category) had to be met in cross-category comparisons. Our analysis focused on comparing social vs. nonsocial interactions. In addition to instructions to reduce typing interactions, we determined that in the real world, typing interactions are dominated by intervals of 200 ms (median), and for our analyses, interactions separated by intervals less than 3.5 times the threshold (700 ms) were excluded. During laboratory testing, the overall median separation was 2 seconds (for social and non-social interactions). After these tiers of exclusion, we were left with 34 participants for establishing the SmRP, 20 participants for comparing social to nonsocial interactions (without kinematic adjustments), and 24 participants for comparing mid-air touches to actual touchscreen events.

[0076] The EEG recordings were bandpass filtered between 0.1 and 70 Hz, and independent component analysis was run to subtract blink artifacts from the EEG signal (Icablinkmetrics implemented in MATLAB). This was followed by another bandpass filter between 0.1 and 30 Hz (and a parallel set was created, 0.1 to 3 Hz to focus on slower signals). Trials above 1 mV were cancelled. The epoch duration from touch screen events was -4 seconds to 4 seconds, and the signal was baseline corrected between -4 and -3 seconds from touch screen events. The signals were then processed using ordinary least squares regression using the hierarchical linear modeling toolbox LIMOEEG. The SmRP was tested using a one sample t-test at the overall level. To compare social and non-social touch, the trial-to-trial motion amplitude was used for an ANCOVA model at the single subject level, and the resulting beta values ​​for the social and non-social categories were used for paired t-tests at the overall level. To compare air touches with actual touch screen events, paired t-tests were used at the overall level. The statistics were corrected for multiple comparisons correction (MCC) using bootstrap signals and 2-D spatiotemporal clustering performed in LIMOEEG (α=0.05). Statistical masks for the main and parallel streams were merged using a logical "OR" operator. For simple behavioral regression analysis, robust (two-sided) linear regression was used.

[0077] Follow-up monitoring

[0078] Accordingly, it can be seen that patterns that match behavioral outputs to neuronal activity can be identified along the lines described above and as Figure 1 Such patterns can be stored in a database. For example, a specific touch associated with a specific smartphone function can be matched with specific neuronal activity. These patterns can then be used, such as in Figure 2 In the method, event-based neuronal activation is identified purely based on behavioral output. Accordingly, the smartphone can be used as a behavioral output recorder, such as using software (e.g., a background application) to record the user's behavioral output. Based on such recognition patterns outlined above, subsequent monitoring of the user can be based solely on the use of the smartphone in the field, using the background application running on the smartphone to record the behavioral output. For example, the detection or recording of smartphone touches by the background application allows the corresponding neuronal activity to be identified from a database of event-related neuronal activations. Changes in the identified event-related neuronal activations over a period of time may be associated with specific functions or regions of the brain, so that the changes may be associated with corresponding changes in functions and / or regions of the brain. The changes may be associated with damage or disease and / or its treatment - thereby enabling monitoring of changes in the user's brain.

[0079] The applicant hereby discloses separately each individual feature described herein and any combination of two or more such features, so that such features or combinations can be implemented according to the general knowledge of a person skilled in the art based on this specification as a whole, regardless of whether such features or combinations of features solve any problems disclosed herein, and without limiting the scope of the claims.

[0080] Applicants point out that aspects of the present invention may consist of any such individual features or combinations of features. It should be understood that the embodiments described herein are merely exemplary and that various modifications may be made thereto without departing from the scope or spirit of the present invention. For example, it should be understood that while what is shown here is related to smartphone touches, in other examples, other events, behaviors, and associated neuronal activities are included.

Claims

1. A method for monitoring a user's neuronal activity, the method comprising: Using a portable electronic device, recording user behavioral output during non-instructed activities; Comparing a user's behavioral output with a predefined behavioral output, wherein the predefined behavioral output is associated with a neuronal activation associated with a known event; determining the user's event-related neuronal activation using pattern recognition of the behavioral output and pattern matching with a database and based on the comparison to provide an indication of the user's neuronal activity, wherein the neuronal activation is effectively modeled and inferred or derived without directly measuring the neuronal activity with a neuronal recorder itself, wherein the user's behavioral output is an indication of an interaction detected by the portable electronic device, wherein the method further comprises: before performing monitoring of the user's neuronal activity, compiling a database of multiple neuronal activities and corresponding behavioral outputs, wherein the database is capable of identifying neuronal activity based solely on recording or observing the behavioral output without the need for direct neuronal recording.

2. The method according to claim 1, wherein: The portable electronic device is a mobile phone.

3. The method according to claim 1, comprising: Recording a plurality of behavioral outputs of a user; and using the plurality of behavioral outputs to determine a neuronal activity of the user.

4. The method according to any one of claims 1 to 3, comprising: The neural activity of the user is determined sequentially over a period of time to identify a development of the neural activity of the user.

5. The method according to any one of claims 1 to 3, comprising: The user behavioral output is compared to event-related neuronal activations that match a pattern associated with a behavioral output recorder having a known pattern to identify the event-related neuronal activations; and the known pattern is previously established using the neuronal recorder.

6. The method according to claim 1, wherein: The method includes matching the behavioral output with the pattern of the neuronal activity to enable identification of the behavioral output or the neuronal activity based solely on one of the other.

7. The method according to any one of claims 1 to 3, wherein: The method does not include: synchronizing the behavioral output recorder and the neuronal activity recorder.

8. The method according to any one of claims 1 to 3, wherein: The method includes asynchronous recording of behavioral output and neuronal activity.

9. The method according to any one of claims 1 to 3, wherein: Event-related neuronal activation is associated with providing input toward the portable electronic device.

10. The method according to claim 9, wherein: The input includes one or more of the following: gesture; touch; voice input.

11. The method according to claim 10, wherein: The sound input is a voice command.

12. The method according to any one of claims 1 to 3, wherein: Monitoring includes: Assessing the user's cognitive function.

13. The method according to any one of claims 1 to 3, wherein: User behavior output includes control of a user's voluntary, self-paced movements.

14. The method according to any one of claims 1 to 3, wherein: The method can be performed without any stimulation.

15. A non-transitory computer readable carrier medium carrying a computer readable code to implement the method of any one of claims 1-14.

16. A processor arranged to implement a method according to any one of claims 1 to 14.

17. A system for monitoring neuronal activity of a user, comprising a portable electronic device and a method arranged to implement any one of claims 1 to 14.

18. A computer program product executable on a processor to implement the method according to any one of claims 1 to 14.

Citation Information

Patent Citations

  • Method of determining the properties of pulsed activity of neuron under conditions of free behaviour of animals

    SU1507317A1

  • Neurological signal decoding

    US20030105409A1

  • Apparatus and method for supporting brain function enhancement

    US20140171757A1

  • Systems and methods for collecting, analyzing, and sharing BIO-signal and non-BIO-signal data

    US20150199010A1

  • Neural Interface Activity Simulator

    US20150213191A1