Systems and methods for cognitive training and monitoring - Patents.com

Abstract

To provide a system and method for analyzing user feedback in response to cognitive training regimens.SOLUTION: A method comprises training at least one machine learning algorithm with a predefined dataset to predict a training success rate, wherein the predefined dataset includes previously received user feedback for users with known characteristics, receiving new user feedback, and determining a prediction of the training success rate with the at least one machine learning algorithm based on the received new user feedback.SELECTED DRAWING: Figure 2A

Description

[Technical field]

[0001] The present invention relates to cognitive training, and more particularly to a system and method for monitoring and analyzing user feedback in response to a cognitive training program. [Background technology]

[0002] People who suffer from cognitive problems or who want to improve their cognitive skills may use cognitive training plans to improve cognitive health and train memory, similar to physical training at the gym. For example, people can use memory cards, solve crossword puzzles, or sit in front of a computer screen to perform various tasks designed to improve cognitive abilities (memory, calculations, vocabulary, etc.).

[0003] The main problem with self-administered cognitive training plans (e.g., without expert supervision) is the user's persistence and / or engagement in the training plan. For example, in a repetitive plan, weekly use may decrease over time as the user gradually loses interest in the plan and the training results decrease accordingly. For training to be effective, people need to continue training for a long period of time. Although many people usually start training with high motivation to improve their cognitive abilities, the average user may not complete the training and may stop or significantly reduce the amount of training sessions over time. Typically, this may occur due to monotony of the training, difficulty in understanding how these games relate to daily needs, and / or loss of interest. Thus, current training plans do not provide good cognitive benefits when self-administered. Summary of the Invention

[0004] In some embodiments of the present invention, a method of analyzing user feedback in response to a cognitive training plan includes training, by a processor, at least one machine learning algorithm with a predetermined dataset to predict a training success rate, the predetermined dataset including previously received user feedback of users having known characteristics, receiving, by the processor, new user feedback, and determining, by the processor, a prediction of the training success rate using the at least one machine learning algorithm based on the received new user feedback. In some embodiments, the at least one machine learning algorithm may be trained with reinforcement learning.

[0005] In some embodiments, behavioral patterns may be determined from user feedback. In some embodiments, at least one machine learning algorithm may be implemented on a recurrent neural network with long short-term memory units. In some embodiments, a training churn rate may be predicted. In some embodiments, the received feedback may be monitored for at least one of the timing, length of the training session, success rate of the training session, attention stability, freezing duration, location, training platform, and number of breaks in the training session.

[0006] In some embodiments, the user feedback may be classified to determine a user profile from a list of predefined profiles, and a prediction of the determined training success rate may be based on the determined user profile. In some embodiments, the user profile may be determined based on at least one user characteristic selected from the group consisting of gender, age, education, location, language, occupation, current occupational status, medical status, and marital status. In some embodiments, the user profile may be determined based on a clustering of the received feedback and the at least one user characteristic.

[0007] In some embodiments, the user may be monitored using at least one electroencephalogram (EEG) sensor, and the cognitive training plan may be altered based on the measured EEG signal. In some embodiments, the user's eye movements may be monitored using at least one imager to determine the user's attention. In some embodiments, behavioral patterns may be determined from the user feedback, and an alert may be generated when the determined behavioral patterns exceed a predetermined threshold.

[0008] In some embodiments of the present invention, a system for cognitively analyzing user feedback in response to a cognitive training plan includes a database including a dataset of previously received user feedback of users having known characteristics, and a processor coupled to the database, the processor configured to perform the steps of training at least one machine learning algorithm with the dataset to predict a training success rate, receiving new user feedback, and determining a prediction of the training success rate with the at least one machine learning algorithm based on the received new user feedback. In some embodiments, the at least one machine learning algorithm may be trained with reinforcement learning.

[0009] In some embodiments, the processor may determine a behavioral pattern from the user feedback. In some embodiments, the processor may classify the user feedback to determine a user profile from a list of predefined profiles, and the prediction of a training success rate using at least one machine learning algorithm may be based on the determined user profile. In some embodiments, the processor may predict a training churn rate using at least one machine learning algorithm. In some embodiments, the processor may monitor the received feedback on at least one of the following: timing, length of a training session, success rate of a training session, attention stability, freezing duration, and number of breaks in a training session.

[0010] In some embodiments, the at least one machine learning algorithm may be implemented on a recurrent neural network with a long-term short-term memory unit. In some embodiments, the user profile may be determined based on at least one user characteristic selected from the group consisting of gender, age, education, location, language, occupation, current occupational status, and marital status. In some embodiments, the user profile may be determined based on clustering of the received feedback. In some embodiments, at least one electroencephalogram (EEG) sensor may be connected to the processor, and the processor may monitor the user with the at least one EEG sensor, and the user profile may be determined based on the measured EEG signal.

[0011] In some embodiments, the at least one imager may be coupled to a processor, which may monitor the user's eye movements using the at least one imager. In some embodiments, the processor may determine a behavioral pattern from the user feedback and generate an alert when the determined behavioral pattern exceeds a predetermined threshold.

[0012] In some embodiments of the present invention, a method of cognitive training includes determining, by a processor, behavioral patterns from received user feedback in response to a cognitive training plan, and modifying, by the processor, the cognitive training plan using at least one machine learning algorithm based on the determined behavioral patterns to improve the cognitive training. In some embodiments, the at least one machine learning algorithm may be trained using previously received user feedback of users with known characteristics.

[0013] In some embodiments of the present invention, a method of analyzing user feedback in response to a cognitive training plan includes training at least one machine learning algorithm with a predetermined dataset by a processor to predict a training success rate, the predetermined dataset including previously received user feedback of users having known characteristics, and updating, by the processor, training variables according to the prediction of the training success rate using the at least one machine learning algorithm. In some embodiments, new user feedback may be received and the training variables may be re-updated based on the received new user feedback.

[0014] In some embodiments of the present invention, a method of analyzing user feedback in response to a cognitive training plan includes training, by a processor, at least one machine learning algorithm with a predetermined dataset to predict a training churn rate, the predetermined dataset including previously received user feedback of users having known characteristics; receiving, by the processor, new user feedback; and determining, by the processor, a prediction of the training churn rate using the at least one machine learning algorithm based on the received new user feedback.

[0015] In some embodiments of the present invention, a method of analyzing user feedback in response to a cognitive training plan includes training, by a processor, at least one machine learning algorithm with a predetermined dataset to predict cognitive decline, where the predetermined dataset includes previously received user feedback of users having known characteristics; receiving, by the processor, new user feedback; and determining, by the processor, a prediction of cognitive decline using the at least one machine learning algorithm based on the received new user feedback.

[0016] The subject matter of the present invention is particularly pointed out and distinctly claimed in the concluding portion of the specification, however the combination and method of operation of the invention, together with its objects, features and advantages, may be understood by reference to the following detailed description when read in conjunction with the drawings. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 illustrates a block diagram of an exemplary computing device according to some embodiments of the present invention. [Figure 2A] FIG. 1 illustrates a block diagram of a system for cognitive analysis of user feedback in response to a cognitive training plan according to some embodiments of the present invention. [Figure 2B] FIG. 1 illustrates a block diagram of a system for cognitive analysis of user feedback in response to a cognitive training plan according to some embodiments of the present invention. [Figure 2C] FIG. 1 illustrates a block diagram of a system for cognitive analysis of user feedback in response to a cognitive training plan according to some embodiments of the present invention. [Figure 2D] FIG. 1 illustrates a block diagram of a system for cognitive analysis of user feedback in response to a cognitive training plan according to some embodiments of the present invention. [Figure 2E]FIG. 1 illustrates a block diagram of a system for cognitive analysis of user feedback in response to a cognitive training plan according to some embodiments of the present invention. [Diagram 3] FIG. 1 illustrates a block diagram of a system for cognitive data collection according to some embodiments of the present invention. [Figure 4A] 1 illustrates a flowchart of a method for cognitive analysis of user feedback in response to a cognitive training regime according to some embodiments of the present invention. [Figure 4B] 1 illustrates a flowchart of a method for cognitive analysis of user feedback in response to a cognitive training regime according to some embodiments of the present invention. [Diagram 5] 1 illustrates a flowchart of a method for analyzing user feedback in response to a cognitive training plan to determine a training churn rate according to some embodiments of the present invention. [Figure 6] 1 illustrates a flowchart of a method for analyzing user feedback in response to a cognitive training plan to determine cognitive decline according to some embodiments of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] It will be appreciated that for simplicity and clarity of the drawings, elements in the figures have not necessarily been drawn to scale. For example, the dimensions of some elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements.

[0019] In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the present invention. However, it will be understood by those skilled in the art that the present invention may be practiced without these specific details. In other instances, detailed descriptions of well-known methods, procedures, components, modules, units and / or circuits have been omitted so as not to obscure the present invention. Some features or elements described with respect to one embodiment may be combined with features or elements described with respect to other embodiments. For clarity of description, descriptions of the same or similar features or elements may not be repeated.

[0020] For example, but not limited to, embodiments of the invention discussed herein may refer to the operation and / or processing of a computer, computing platform, computing system, or other electronic computing device, which manipulates and / or transforms data represented as physical (e.g., electronic) quantities in the registers and / or memory of the computer into other data similarly represented as physical quantities in the registers and / or memory of the computer or in other non-transitory information storage media that may store instructions for performing the operation and / or processing. For example, but not limited to, embodiments of the invention discussed herein may include a "multiple" or "two or more". For example, the terms "plural" and "multiple" may be used herein to describe two or more components, devices, elements, units, parameters, etc. A term set used herein may include one or more items. Unless otherwise specified, the method embodiments described herein are not constrained to a particular order or sequence. Additionally, some method embodiments or elements thereof described may be performed simultaneously, contemporaneously, or in parallel.

[0021] Please refer to FIG. 1, which is a schematic block diagram of an exemplary computing device according to some embodiments of the present invention. The computing device 100 may include a controller or processor 105 (e.g., a central processing unit processor (CPU), chip, or any suitable computing or computational device), an operating system 115, a memory 120, executable code 125, a storage 130, an input device 135 (e.g., a keyboard or touch screen), an output device 140 (e.g., a display), and a communication unit 145 (e.g., a cellular transmitter or modem, a Wi-Fi communication unit, etc.) for communicating with a remote device via a communication network such as the Internet. The controller 105 may be configured to execute program code to perform the operations described herein. The systems described herein may include one or more computing devices 100, for example, to function as various devices and / or components shown in FIG. 2A. For example, a system 200 may be or include a computing device 100 or a component thereof.

[0022] Operating system 115 may be or include any code segments (e.g., similar to executable code 125 described herein) designed and / or configured to perform tasks including coordinating, scheduling, arbitrating, monitoring, controlling, or managing the operation of computing device 100. Examples include scheduling the execution of software programs or enabling software programs or other modules or units to communicate.

[0023] Memory 120 may be or include, for example, a random access memory (RAM), a read only memory (ROM), a dynamic RAM (DRAM), a synchronous DRAM (SD-RAM), a double data rate (DDR) memory chip, a flash memory, a volatile memory, a non-volatile memory, a cache memory, a buffer, a short-term memory unit, a long-term memory unit, or other suitable memory or storage unit. Memory 120 may be or include multiple, possibly different, memory units. Memory 120 may be a non-transitory computer or processor readable medium, or a non-transitory computer storage medium, for example, a RAM.

[0024] Executable code 125 may be any executable code, such as an application, a program, a process, a task, or a script. Executable code 125 may be executed by controller 105, perhaps under control of operating system 115. For example, executable code 125 may be a software application that performs methods as further described herein. For clarity, a single item of executable code 125 is shown in FIG. 1, but systems according to embodiments of the present invention may include multiple executable code segments similar to executable code 125 that are stored in memory 120 and that can cause controller 105 to perform methods described herein.

[0025] Storage 130 may be or may include, for example, a hard disk drive, a universal serial bus (USB) device, or other suitable removable and / or fixed storage unit. In some embodiments, some components shown in FIG. 1 may be omitted. For example, memory 120 may be a non-volatile memory having the storage capacity of storage 130. Thus, although shown as a separate component, storage 130 may be embedded in or included in memory 120.

[0026] The input devices 135 may be or may include a keyboard, a touch screen or pad, one or more sensors, or other or additional suitable input devices. Any suitable number of input devices 135 may be operably connected to the computing device 100. The output devices 140 may include one or more displays or monitors, and / or any other suitable output devices. Any suitable number of output devices 140 may be operably connected to the computing device 100. As indicated by blocks 135 and 140, any applicable input / output (I / O) devices may be connected to the computing device 100. For example, a wired or wireless network interface card (NIC), a universal serial bus (USB) device, or an external hard drive may be included in the input devices 135 and / or the output devices 140.

[0027] An embodiment of the present invention may include an article such as a computer or processor non-transitory readable medium, such as a memory, disk drive, or USB flash memory, that encodes, includes, or stores instructions, e.g., computer executable instructions, that, when executed by a processor or controller, perform the methods disclosed herein. For example, the article may include a storage medium, such as memory 120, computer executable instructions, such as executable code 125, and a controller, such as controller 105. Such a non-transitory computer readable medium may be, for example, a memory, disk drive, or USB flash memory, that encodes, includes, or stores instructions, e.g., computer executable instructions, that, when executed by a processor or controller, perform the methods disclosed herein. The storage medium may include any type of media suitable for storing electronic instructions, including, but not limited to, any type of disk, including read only memory (ROM) and / or random access memory (RAM), flash memory, semiconductor devices such as electrically erasable programmable read only memory (EEPROM), or programmable storage devices. For example, in some embodiments, memory 120 is a non-transitory machine-readable medium.

[0028] A system according to an embodiment of the present invention may include components such as, but not limited to, multiple central processing units (CPUs) or any other suitable general-purpose or special-purpose processors or controllers (e.g., a controller similar to controller 105), multiple input units, multiple output units, multiple memory units, and multiple storage units. The system may further include other suitable hardware and / or software components. In some embodiments, the system may be or include, for example, a personal computer, a desktop computer, a laptop computer, a workstation, a server computer, a network device, or any other suitable computing device.

[0029] According to some embodiments, systems and methods are provided for personalized computerized cognitive training plans configured to support the cognitive health, and in particular memory function, of adult users.

[0030] Reference is made to Figure 2A, which illustrates a block diagram of a system 200 for cognitive analysis of user feedback in response to a cognitive training plan 210, in accordance with some embodiments. In Figure 2A, the direction of the arrows indicates the direction of information flow, and dashed elements indicate software and / or algorithms.

[0031] The system 200 may include at least one processor 201 (such as the controller 105 shown in FIG. 1), for example a processor in a mobile device and / or a PC, capable of implementing the cognitive training plan 210. The processor 201 may be connected to a database 202 (such as the storage system 130 shown in FIG. 1) that includes a dataset of previously received user feedback 203 of users with known characteristics. For example, users with known characteristics such as age, gender, medical and / or mental condition may provide feedback 203 to the cognitive training plan 210 (e.g., during an initial calibration phase as described in detail herein).

[0032] During training, the processor 201 may collect information related to one or more of the training time per day, the length of the training session, the platform used by the user (e.g., PC, tablet, smartphone), and / or the training location (e.g., at home or a public place) to improve the cognitive training plan 210 for the user's future training. In some embodiments, the processor 201 may collect information from the user feedback 203, such as the user response time (e.g., in a game) and / or the type of answer (e.g., correct / incorrect / miss answer) in various scenarios displayed to the user, and / or the target location on the display, and / or the type of input (e.g., using a keyboard or touch screen), and / or the number of breaks taken by the user. In addition to collecting information related to the type of answer, the processor 201 may collect information related to at least one of the success rate, attention stability, attention deficit, spatial attention, longest streak (e.g., number of consecutive correct answers in a game), learning curve, sleep quality, and / or mood (e.g., determined based on the training session questions or directly from a dedicated device such as a smartwatch or other sensor). In some embodiments, the information collected by the processor 201 may be stored in the database 202 as user feedback 203 .

[0033] In some embodiments, the cognitive training plan 210 may be modified based on cognitive functions (e.g., games, exercises, etc.) identified with low success rates and / or high standard deviations in response times (e.g., above some pre-defined threshold), and / or specific types of errors (e.g., location vs. correct identification), etc. The cognitive functions trained may include mnemonic components such as vision, feature and object binding, information organization, semantic networks, and attention (which are important for memory processes). The user's attention may be trained for attentional focus, attentional orienting, selective attention, visuospatial attention, sustained attention, executive attention and / or attentional control (including, for example, distraction and inhibition), etc. In some embodiments, the processor 201 may monitor user feedback 203 to determine training attention based on overall response time, identification of attention deficiencies (e.g., deviations in response times), and attentional stability (e.g., magnitude of overall standard deviation of response times).

[0034] The processor 201 may execute at least one machine learning algorithm 204 (e.g., using deep learning using a deep neural network) to train with a dataset of user feedback 203 and predict the training success rate 205 of the user. The at least one machine learning algorithm 204 may be trained on the user with previously collected data while running on a predefined rule. In some embodiments, the at least one machine learning algorithm 204 may be trained with supervised learning of a computer network using machine learning (e.g., using a neural network). Supervised learning may include training with a tagged dataset (e.g., examples of human users training with the system) or training with the supervision of a human operator who tags samples and teaches the network. In some embodiments, once a predefined amount of new data has been collected, the at least one machine learning algorithm 204 may be activated for a predefined period of time (e.g., semi-automatically) for retraining the algorithm. In some embodiments, the at least one machine learning algorithm 204 may be implemented on a recurrent neural network (RNN), e.g., using long short-term memory (LSTM) units. RNNs are a class of artificial neural networks in which the connections between nodes form a directed graph along a time sequence. Unlike feedforward neural networks, RNNs with LSTM architecture may have feedback connections to process the input sequence using an internal state (memory).

[0035] In some embodiments, the processor 201 may predict (e.g., using supervised learning) the workout success rate 205, where similar users may be identified from a continuously updated dataset of long-term users based, for example, on similar content (e.g., gender, location, age, education, etc.) and / or similar behavior (e.g., relative to successful training history). Thus, in some embodiments, the workout success rate 205 of a particular user may be calculated and / or predicted by the processor 201 based on the success of similar users for a particular training session.

[0036] In some embodiments, the cognitive training plan 210 may receive input (e.g., directly and / or via the processor 201) from at least one machine learning algorithm 204, including, for example, exercises and / or levels and / or variables to use to receive a desired training success rate 205. In some embodiments, the processor 201 may continually receive user feedback 203 during and / or after training with information regarding the progress of the training according to the provided instructions in order to continually improve the at least one machine learning algorithm 204 and compare the training results to the predicted training success rate 205.

[0037] In some embodiments, the processor 201 may use at least one machine learning algorithm 204 (e.g., execute the algorithm to achieve the result) to generate recommendations to increase (or decrease) the training success rate 205. During training, the processor 201 may modify the cognitive training plan 210 according to the calculated training success rate 205, e.g., if the calculated training success rate 205 is below a predefined threshold, the cognitive training plan 210 may be modified to make it easier for the user. In some embodiments, the processor 201 may generate statistics (e.g., graphs) that are displayed to the user to reflect which variables affect cognitive performance, such as training time (e.g., time of day or day of week), sleep quality (e.g., sleep time optimized for maximum concentration), and / or whether there are differences in training sessions with respect to these variables. In some embodiments, at least some characteristics may be determined by the processor 201 (e.g., success rate or training churn rate are performed by different machine learning algorithms).

[0038] 2B and 2C, which show block diagrams of alternative systems 230 and 240 for determining behavioral patterns 206 in response to a cognitive training plan 210 in accordance with some embodiments. Some elements in Figures 2B and 2C may be the same as or similar to elements shown in Figure 2A, e.g., processor 201.

[0039] According to some embodiments, the processor 201 may determine user behavioral patterns 206 (e.g., patterns of behavior and / or feedback, such as reaction times and / or correct answers, which may reflect cognitive and / or motor skills) from the user feedback 203, for example, using machine learning algorithms 204. In some embodiments, the behavioral patterns 206 may be cognitive behavioral patterns.

[0040] The processor 201 may determine a prediction of the training success rate 205 using at least one machine learning algorithm 204 based on the determined user behavior pattern 206 and / or user characteristics. In some embodiments, the processor 201 may generate an alert when the determined user behavior pattern 206 exceeds a predefined threshold. For example, the machine learning algorithm 204 may compare the user's behavior during training (e.g., from the user feedback 203) with an initial state (e.g., from the user profile 207) to determine if the user behavior pattern 206 meets or exceeds a predefined threshold, such as determining that the training success rate will decrease by 40%. In some embodiments, the information collected in the alert procedure may be fed back to the user behavior pattern 206 algorithm. For example, the sliding window technique may be used with supervised learning (such as RNN) or unsupervised learning by finding the differences between previous windows. In either case, a distance function between the subsequences may be defined and used to calculate the distance from the previous window as an input to some anomaly detection methods.

[0041] For example, the machine learning algorithm 204 may be configured to achieve a predetermined training success rate 205 (e.g., 80%) for each user. The training success rate 205 may be measured, for example, during a training session that causes the user to continue training for a significant period of time (e.g., where a decrease in success rate also indicates a decrease in training persistence) and / or the training success rate 205 may be measured by successfully completing a new training level (e.g., in a game). For example, if a decrease in success rate 205 is identified due to a decrease in training time, the machine learning algorithm 204 may be configured to maintain the user's training by achieving a lower training success rate 205.

[0042] In some embodiments, a set of actions to further increase the training success rate 205 and / or to directly interact with the user if the user's behavior changes significantly may be defined based on the specific user's behavioral patterns 206. User feedback data 203 may be collected by reinforcement and / or supervised learning of the impact of different actions on the user's performance. Based on the collected user feedback data 203, the predefined rules and / or machine learning algorithms may implement the training and / or presented parameters accordingly. For each such action (e.g., initiating a call with the user, providing educational materials, etc.), the impact on the training success rate 205 may be measured to know which action improves the training success rate 205. In some embodiments, once the responses to the actions are learned by the system 200 and / or the system 230 and / or the system 240, the at least one machine learning algorithm 204 may predict for each user which actions may be required and accordingly at which time during the training to apply these actions.

[0043] In some embodiments, the processor 201 may classify the user feedback 203 (and / or the processor 201 may instruct an algorithm to perform the classification) to determine at least one user profile 207, including, for example, age, gender, etc., from a list of predefined profiles (e.g., stored in the database 202), where, for example, the at least one profile may be determined by at least one machine learning algorithm 204. In some embodiments, the determined at least one user profile may be used by at least one of the systems 200, 230, 240, 260, and 270 shown in Figures 2A-2E. In some embodiments, the determined prediction of the user's behavioral pattern 206 may be based on the determined at least one user profile 207. In some embodiments, the at least one user profile 207 may be determined in addition to or instead of at least one user characteristic, such as gender, age, education, location, language, occupation, current occupational status, medical status, and / or marital status. The at least one user profile 207 may also, or alternatively, be determined based on a clustering of the received feedback.

[0044] Reference is made to Figure 2D, which illustrates a block diagram of another system 260 for determining a training churn rate 264 in response to a cognitive training plan 210 according to some embodiments. Some elements in Figure 2D may be the same as or similar to elements shown in Figure 2A, e.g., the processor 201.

[0045] According to some embodiments, the processor 201 may use a machine learning algorithm 204 to predict a training churn rate 264. A user's training churn rate may be defined at various levels of ongoing engagement (e.g., based on training duration and / or time of day).

[0046] In some embodiments, by collecting continued usage and / or user engagement data (e.g., if a user closes their account or stops training), the machine learning algorithm 204 may be used to predict the user's training habits and / or desired training churn rate 264. In some embodiments, to predict the desired training churn rate 264, the machine learning algorithm 204 may, for example, further receive as input data of other users previously identified as declining engagement and / or ceasing training, to compare with the user's collected new training data, based on the user profile 207.

[0047] According to some embodiments, the processor 201 may detect changes and / or anomalies in the user's behavior, for example, using unsupervised learning. The processor 201 may monitor the user's performance and define a profile for each user, with expected behavior for each profile. In some embodiments, non-trivial or significant deviations from expected behavior (e.g., pre-defined prior to training) detected in a new training session may be flagged and alerted, for example, to initiate contact with the user (e.g., calling the user to understand the cause of the anomaly or if there is a major change such as a medical issue or sadness).

[0048] In some embodiments, measurements of a user's behavior may be performed at predetermined intervals, for example once a month, as an objective measurement or assessment to ascertain whether there is a change in cognitive performance.

[0049] In some embodiments, to determine a change in behavior, e.g., to determine a training churn rate 264, the machine learning algorithm 204 may receive as input data of a user's behavioral patterns 206 (shown in FIG. 2C).

[0050] Reference is made to Figure 2E, which illustrates a block diagram of another system 270 for determining cognitive decline 274 in response to a cognitive training plan 210 according to some embodiments. Some elements in Figure 2E may be the same as or similar to elements shown in Figure 2A, e.g., processor 201.

[0051] In some embodiments, the processor 201 may use machine learning algorithms 204 to predict and / or detect cognitive decline 274 associated with mild cognitive impairment (MCI). MCI can cause a noticeable and measurable decline in cognitive abilities, including memory and thinking (judgment, making good decisions, etc.). People with MCI are at increased risk of developing Alzheimer's disease or another type of dementia.

[0052] In some embodiments, if users with different stages of MCI are initially tagged, e.g., by an external medical diagnosis, at least one machine learning algorithm 204 may learn the behavioral patterns of such users, e.g., to later identify similar patterns of users who are not tagged with a stage of MCI. Thus, prediction of MCI may be available by system 200 and / or system 270. In some embodiments, multi-label time series may be used with attention mechanisms or minority class prediction algorithms (for new users), such as LSTM. Oversampling or Generative Adversarial Networks (GANs) mechanisms may be used to enhance the set of examples. In some embodiments, unsupervised detection may be used with cluster-based algorithms, such as Local Outlier Factor (LOF), Kernel Density Estimation (KDE), K-Means, etc., to identify the MCI level of the user.

[0053] In some embodiments, for example, to predict the desired cognitive decline 274, the machine learning algorithm 204 may receive as input data of other users previously identified as having cognitive decline (e.g., having MCI or dementia) to compare with the user's collected new training data, also based on, for example, the user profile 207.

[0054] In some embodiments, to determine behavioral changes, for example to determine cognitive decline 274, the machine learning algorithm 204 may receive as input data of a user's behavioral patterns 206 (shown in FIG. 2C).

[0055] 3, which illustrates a block diagram of a system 300 for cognitive data collection according to some embodiments. In some embodiments, system 300 may further include some or all of the elements of system 200 (e.g., processor 201 and database 202), with the addition of elements of system 300 for collecting cognitive data from user 30.

[0056] In some embodiments, the system 300 may include at least one electroencephalogram (EEG) sensor 301 connected to the processor 201 for measuring EEG signals. The processor 201 is configured to monitor cognitive signals of the user 30 using the at least one EEG sensor 301. In some embodiments, the user profile 207 may further be determined based on the measured EEG signals. For example, the user 30 may wear a headset with the at least one EEG sensor 301 and collect measurements related to brainwaves and specific activities using commercial EEG channels (1-16) or clinical EEG channels (16-64), respectively, for personal use or when authorized by a clinician. In some embodiments, the determined training success rate 205 may be improved based on data collected by the at least one EEG sensor 301.

[0057] In some embodiments, the EEG sensor 301 may also provide neurofeedback according to different brain waves (e.g., alpha, beta, theta) and the relationships between them, for example, used to find correlations between brain waves in response to the cognitive training plan 210. In some embodiments, the measured signals may be integrated into a training session (e.g., a game) with specific responses to thresholds of the measured waves and / or wave relationships. In some embodiments, the training may include a dual task option with neurofeedback based on brainwave activity (e.g., based on alpha or theta / beta levels) and a predetermined level and / or means of maintaining during training.

[0058] In some embodiments, the system 300 may include, for example, at least one imager 302 coupled to the processor 201. The processor 201 is configured to monitor eye movements of the user 30 with respect to content displayed on the display 310 using the at least one imager 302 and determine the concentration and / or attention of the user 30 during training accordingly. In some embodiments, the determined training success rate 205 may be improved, for example, based on data collected by the at least one imager 302.

[0059] In some embodiments, the at least one imager 302 may track eye movements and / or pupil size using a camera of a computerized device (such as the computing device 100 shown in FIG. 1 ), such as a tablet, smartphone, or by a clinical eye tracker. Eye tracking data may be collected during training and in association with conditions presented on the training display 310. In some embodiments, the processor 201 may analyze the collected eye tracking data to ascertain saccades, fixations, pupil size, etc. that correlate with content presented on the display 310 to determine quality of attention, measures of attention, and measures of memory.

[0060] In some embodiments, at least one training session may be performed in a virtual reality environment. For example, a single wearable device (e.g., a headset) may include an EEG sensor 301 and / or an imager 302 and / or virtual reality imaging displayed on the headset to combine biofeedback with pulse rate and sweat monitoring.

[0061] In some embodiments, the processor 201 may perform analysis of data collected from external devices (such as the EEG sensor 301 and / or imager 302) and other external devices used by the user, such as activity trackers, smart watches, smartphones, clinical data, and test results to improve the cognitive training plan 210 and increase the training success rate 205 accordingly. The additional data collected may relate to sleep quality, daily activity, location (e.g., using GPS data), stability (e.g., hand stability while holding the device), and / or emotional state (e.g., based on voice, voice recognition, and / or nutrition, medication, etc.). In some embodiments, this collected data may be computed using at least one machine learning algorithm 204 to provide, for example, more accurate personalized training, personal recommendations, and / or cognitive flagging.

[0062] According to some embodiments, the processor 201 may calculate the training success rate 205 and / or general training progress based on the accuracy rate and / or response time, and may measure how the user distributes attention in the surrounding space, for example based on the detection of spatial attention. Thus, in some embodiments, the training may include targets in different areas of the display 310 and compare the responses received between those areas (e.g., registered as user feedback 203) to, for example, create a spatial attention map and identify areas of "neglect" (within the display area). These areas may be marked and trained to improve the user's spatial attention.

[0063] Reference is made to FIG. 4A, which illustrates a flowchart of a method for analyzing user feedback 203 in response to a cognitive training plan 210 according to some embodiments.

[0064] At step 401, at least one machine learning algorithm 204 may be trained (e.g., by the processor 201) using a predefined data set to predict a training success rate 205. The predefined data set may include previously received user feedback of users with known characteristics. New user feedback may be received at step 402, and at least one machine learning algorithm 204 may be used to determine a prediction of the training success rate 205 based on the new user feedback received (e.g., by the processor 201) at step 403. In some embodiments, at least one machine learning algorithm 204 may be trained with reinforcement learning. In some embodiments, a transfer learning algorithm may be used to build a predictive model for people with cognitive decline using data from healthy people.

[0065] Reference is made to 4B, which illustrates a flowchart of a method for analyzing user feedback 203 in response to a cognitive training plan 210 according to some embodiments. In some embodiments, at step 404, at least one machine learning algorithm 204 may be trained (e.g., by the processor 201) using a predefined data set to predict a training success rate 205. The predefined data set may include previously received user feedback of users with known characteristics. The training set and / or training variables may be determined (e.g., using a predefined threshold) to meet the prediction of the training success rate 205. At step 405, the training variables may be updated according to the prediction of the training success rate using the at least one machine learning algorithm 204. Upon receiving new user feedback at step 406, the training variables may be re-updated at step 405.

[0066] According to some embodiments, at least one machine learning algorithm 204 may be trained (e.g., by the processor 201) with a predefined data set to, for example, determine a user's behavioral patterns 206. The predefined data set may include previously received user feedback of users with known characteristics and previously calculated behavioral patterns of other users. In some embodiments, new user feedback may be received. At least one machine learning algorithm 204 may be used (e.g., by the processor 201) to perform a comparison of the user's behavioral patterns 206 with the newly received data to identify anomalies in the behavioral patterns 206.

[0067] According to some embodiments, the at least one machine learning algorithm 204 may be trained (e.g., by the processor 201) with a predefined data set to, for example, determine a user's behavioral patterns 206. The predefined data set may include previously received user feedback of users with known characteristics and previously calculated behavioral patterns of other users. The at least one machine learning algorithm 204 may be trained to appropriately predict user behavior in other situations, such as predicting a particular user's behavior under stress conditions.

[0068] Reference is now made to FIG. 5, which illustrates a flowchart of a method for analyzing user feedback 203 in response to a cognitive training plan 210 to determine a training churn rate 264 according to some embodiments.

[0069] In some embodiments, at step 501, at least one machine learning algorithm 204 may be trained (e.g., by the processor 201) with a predefined data set to predict a training churn rate 264. The predefined data set may include previously received user feedback of users with known characteristics (e.g., user feedback regarding number of training sessions, frequency of training, time / date of training, etc.). New user feedback may be received at step 502. Based on the new user feedback received (e.g., by the processor 201) at step 503, at least one machine learning algorithm 204 may be used to determine a prediction of the training churn rate 264.

[0070] Reference is now made to FIG. 6, which illustrates a flowchart of a method for analyzing user feedback 203 in response to a cognitive training plan 210 to determine cognitive decline 274 according to some embodiments.

[0071] In some embodiments, at step 601, at least one machine learning algorithm 204 may be trained using a predefined data set (e.g., by the processor 201) to flag possible cognitive decline and / or predict cognitive decline 274. The predefined data set may include previously received user feedback of users with known characteristics. The predefined data set may include previously calculated patterns characterizing different cognitive deterioration states based on previously received user feedback of users with known characteristics, including, for example, cognitive clinical diagnoses. New user feedback may be received at step 602. Based on the new user feedback received at step 603 (e.g., by the processor 201), at least one machine learning algorithm 204 may be used to determine a prediction of cognitive decline 274.

[0072] While certain features of the invention have been illustrated and described herein, many modifications, substitutions, changes and equivalents may occur to those skilled in the art, and it is therefore to be understood that the appended claims are intended to cover all such modifications and changes which fall within the true scope of the invention.

[0073] Various embodiments have been described, each of which of course includes features of the other illustrated embodiments, and embodiments not specifically described may include various features described herein.

Claims

1. receiving user feedback in response to the cognitive training plan, said feedback selected from a length of the training session, attention stability, number of freezing periods, location, training platform, and number of breaks in the training session; predicting, by at least one machine learning algorithm, a training success rate based on the feedback; modifying the type or level of exercises of the cognitive training plan in response to the training success rate; A method of cognitive training by a processor, comprising:

2. The method of claim 1 , wherein the at least one machine learning algorithm is implemented on a recurrent neural network with a long short-term memory unit.

3. predicting a training churn rate using the at least one machine learning algorithm, the training churn rate defining a level of continued engagement of the user in the cognitive training plan; further modifying the cognitive training plan based on the predicted training churn rate. The method of claim 1 further comprising:

4. Identifying at least one variable that affects the user's cognitive ability based on the training success rate; generating displayed statistics indicating which variables affect the user's cognitive performance; The method of claim 1 further comprising:

5. The method described in claim 4, wherein the at least one variable is selected from training duration, training time, and sleep quality.

6. The method of claim 1, further comprising a step of training the at least one machine learning algorithm using a predetermined dataset including previously received user feedback for users having known characteristics.

Images