Artificial intelligence-driven cognitive disorder early screening and intervention integrated platform

By using multimodal data perception and collection, and dynamic causal analysis by the central AI processing and analysis unit, an individualized causal chain map of cognitive function decline is generated. This solves the problems of insufficient temporal coordination and incomplete functional coverage of multimodal data, and realizes a closed-loop linkage for early screening and intervention of cognitive impairment.

CN121583567AActive Publication Date: 2026-02-27QINGDAO UNIV OF TECH
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202610105622.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-01-27
Publication Date
2026-02-27
Estimated Expiration
2046-01-27

AI Technical Summary

Technical Problem

Existing technologies lack time-series collaborative processing of multimodal data, fail to reflect dynamic evolution characteristics in causal analysis, have incomplete functional coverage, and do not form a closed-loop linkage between screening and targeted intervention.

Method used

A multimodal data perception and acquisition unit is employed to collect data and generate temporally labeled data based on eye-tracking and EEG synchronous recording technology. The central AI processing and analysis unit generates an individualized causal chain map of cognitive function decline through cross-modal temporal alignment, dynamic heterogeneous graph construction, and differentiable causal discovery mechanism. Combined with LSTM-attention network, personalized intervention strategies are generated, and the intervention strategies are optimized through effect tracking and feedback closed-loop unit.

Benefits of technology

It accurately captures the core pathways of cognitive impairment progression, achieving a closed-loop linkage between screening and targeted intervention, and fully covering the entire process of cognitive impairment management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121583567A_ABST
    Figure CN121583567A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of early screening of cognitive impairment, in particular to an artificial intelligence-driven early screening and intervention integrated platform for cognitive impairment. Comprising a multi-modal data sensing and collecting unit; the central AI processing and analysis unit introduces a differentiable causal discovery mechanism, adopts an end-to-end structure search algorithm based on Gumbel-Sigmoid to jointly optimize the existence probability and causal direction of edges in the graph, and embeds an improved Granger causal loss function and neurophysiological priori constraints; a personalized intervention strategy generation unit; and an effect tracking and feedback closed loop unit. According to the method, time sequence cooperative processing based on a cognitive task key event timestamp is carried out on multi-modal data, a dynamic heterogeneous graph construction and causal analysis mechanism is combined, an individualized causal chain graph reflecting cognitive function decline dynamic evolution characteristics is formed, a core path of cognitive impairment development can be accurately captured, and the cognitive impairment development efficiency is improved. The problems that multi-modal data time sequence collaboration is insufficient, and causal analysis lacks dynamics are solved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of early screening of cognitive impairment, in particular to an artificial intelligence driven early screening and intervention integrated platform for cognitive impairment. BACKGROUND

[0002] Early identification and dynamic intervention of cognitive impairment is the key to reduce the risk of disease progression and improve the quality of life of patients. Its pathological mechanism presents the characteristics of multi-dimension and time sequence evolution, and needs to rely on multi-source data fusion and accurate analysis technology to realize whole-process management.

[0003] In the prior art, related patents have explored in the field of cognitive impairment screening. For example, Chinese patent CN202511189298.X discloses an early screening and diagnosis system for cognitive impairment based on multi-modal data, which includes a multi-modal data acquisition module (acquiring image, gene, behavior and clinical narrative information) and a causal purification module (filtering pseudo-correlation through clinical narrative anchoring and reverse intervention deduction), realizing the upgrade from "correlation" to "causality" in diagnosis and treatment. For another example, Chinese patent CN202510258074.3 discloses a cognitive impairment screening method and system based on face analysis, which collects the facial movement features of the user when watching a video containing a funny point, inputs a preset model to output a screening result, and has the characteristics of non-invasive and less dependence on professional personnel.

[0004] Although the above technical solutions have corresponding design advantages, the above technical solutions still have the following technical defects: first, multi-modal data lacks time sequence collaborative processing, and causal analysis does not reflect the dynamic evolution characteristics: CN202511189298.X realizes the causal purification of multi-modal data, but does not collaboratively process the time sequence consistency of multi-source data, and the causal relationship analysis does not combine the dynamic evolution law of cognitive function decline, so it is difficult to accurately capture the core path of pathological progression; CN202510258074.3 only analyzes single dimension features within a fixed time window, without considering the time sequence association and long-term evolution trend of data, and cannot reflect the dynamic changes of cognitive function. Second, the function coverage is not complete, and the closed-loop linkage of screening and targeted intervention is not realized: CN202511189298.X focuses on screening and causal analysis, and does not design a targeted intervention and effect feedback mechanism directly related to the analysis result; CN202510258074.3 only realizes the screening function, without extending to the personalized intervention and dynamic tracking link, and cannot form whole-process management. In view of this, we propose an artificial intelligence driven early screening and intervention integrated platform for cognitive impairment. SUMMARY

[0005] The present application aims to provide an artificial intelligence driven cognitive impairment early screening and intervention integrated platform to solve the problems of lack of time sequence collaborative processing of multi-modal data, incomplete functional coverage and failure to realize closed-loop linkage of screening and targeted intervention in the background art.

[0006] To achieve the above technical problems, the present application aims to provide an artificial intelligence driven cognitive impairment early screening and intervention integrated platform, comprising: A multi-modal data perception and acquisition unit, which acquires synchronous eye movement signals, electroencephalogram signals and behavioral task data streams of a cognitive impairment risk group based on eye movement electroencephalogram synchronous recording technology, associates cognitive task key events to generate time stamps, completes time sequence labeling of multi-modal physiological and behavioral data perception and acquisition, and transmits the output time sequence labeled multi-modal data to a central AI processing and analysis unit; A central AI processing and analysis unit, which receives the time sequence labeled multi-modal data transmitted by the multi-modal data perception and acquisition unit, completes cross-modal time sequence alignment of eye movement, electroencephalogram and behavioral data streams with cognitive task key event time stamps as anchor points, constructs a dynamic heterogeneous graph structure, maps physiological and behavioral variables as graph nodes, initializes a directed edge table with time delay weights to represent potential interaction between variables, generates a time sequence graph sequence evolving with task progress, introduces a differentiable causal discovery mechanism, uses an end-to-end structure search algorithm based on Gumbel-Sigmoid to jointly optimize the existence probability and causal direction of the edges in the graph, embeds an improved Granger causal loss function and neurophysiological prior constraint, and automatically learns to obtain a time sequence causal weight matrix with biological rationality; based on the time sequence causal weight matrix, a driving decline mode is identified, an individualized cognitive function decline causal chain graph is generated, a personalized baseline is established based on the first detection data, and the longitudinal deviation degree of the intensity of each causal path in the subsequent detection data is calculated; an LSTM-attention network is used to model the multi-round causal path intensity sequence, and an individualized cognitive function decline causal chain graph and key driving path are output to the personalized intervention strategy generation unit, and a standardized clinical report is also output; A personalized intervention strategy generation unit, which receives the individualized cognitive function decline causal chain graph and key driving path output by the central AI processing and analysis unit, generates a personalized cognitive intervention strategy for targeted blocking of the decline path, and synchronizes the generated personalized cognitive intervention strategy to the effect tracking and feedback closed-loop unit; The effect tracking and feedback closed-loop unit receives personalized cognitive intervention strategies synchronized by the personalized intervention strategy generation unit, dynamically monitors the implementation process and effects of the personalized cognitive intervention strategies, collects multimodal physiological and behavioral data after intervention, and transmits the collected post-intervention multimodal data back to the central AI processing and analysis unit. The central AI processing and analysis unit iterates the cognitive decline causal chain map and modeling results based on the transmitted post-intervention multimodal data, and feeds back the iterated results to the personalized intervention strategy generation unit, which then corrects the intervention strategy parameters.

[0007] As a further improvement to this technical solution, the multimodal data sensing and acquisition unit includes a signal synchronization acquisition module, a task event timestamp association module, and a data format standardization module, wherein: The signal synchronization acquisition module is based on eye-tracking and electroencephalography (EEG) synchronization recording technology to simultaneously acquire eye-tracking signals, EEG signals, and behavioral task data streams from individuals at risk of cognitive impairment. The task event timestamp association module associates key events of the cognitive task and generates corresponding timestamp markers for the collected eye movement signals, electroencephalogram signals and behavioral task data streams. The data format standardization module performs format standardization processing on the eye movement signals, EEG signals and behavioral task data streams after marking the timestamps, and transmits the processed time-marked multimodal physiological and behavioral data to the central AI processing and analysis unit.

[0008] As a further improvement to this technical solution, the central AI processing and analysis unit includes a cross-modal temporal alignment module, a dynamic heterogeneous graph construction module, a differentiable causal discovery module, a cognitive decline causal chain modeling module, and a sequence prediction and output module, wherein: The cross-modal temporal alignment module receives temporally tagged multimodal data transmitted by the multimodal data perception and acquisition unit, and completes cross-modal temporal alignment of eye-tracking, EEG and behavioral data streams using the timestamps of key events in the cognitive task as anchor points. The dynamic heterogeneous graph construction module constructs a dynamic heterogeneous graph structure based on aligned multimodal data, maps physiological and behavioral variables as graph nodes, initializes directed edges with time delay weights to represent potential interaction relationships between variables, and generates a time series graph sequence that evolves with the task progress. The differentiable causal discovery module introduces a differentiable causal discovery mechanism to process the time series graph sequence and jointly optimize the existence probability of edges and causal direction in the graph. The cognitive decline causal chain modeling module, based on the output of the differentiable causal discovery module, identifies driving decline patterns, generates an individualized cognitive function decline causal chain map, establishes a personalized baseline, and calculates the longitudinal deviation of the causal path strength. The sequence prediction and output module adopts an LSTM-attention network to model the multi-round causal path intensity sequence, outputs an individualized cognitive function decline causal chain graph and a key driving path to the individualized intervention strategy generation unit, and simultaneously outputs a standardized clinical report.

[0009] As a further improvement of the technical solution, the cross-modal time alignment module comprises a cognitive task anchor reference determination sub-module and a multi-modal data timestamp calibration sub-module, wherein: The cognitive task anchor reference determination sub-module extracts the trigger time of stimulus presentation and response instruction in the cognitive task, and takes the trigger time as the reference time point for multi-modal data alignment. The multi-modal data timestamp calibration sub-module matches the sampling time of the eye movement signal, the electroencephalogram signal and the behavior task data stream with the reference time point, and the time deviation of each modality data after calibration does not exceed 1 / 2 of the corresponding data sampling period.

[0010] As a further improvement of the technical solution, the dynamic heterogeneous graph construction module comprises the following steps in the process of initial value calculation and time sequence graph sequence generation of directed edge time delay weight when constructing a dynamic heterogeneous graph: S22.1, determine a preset time delay window, and obtain the time sequence data sequence corresponding to the graph nodes; S22.2, calculate the correlation coefficients of different node time sequence data sequences under the time delay window; S22.3, normalize the correlation coefficients of all node pairs to obtain the initial value of the time delay weight of the edges in the graph ; wherein, , are the node indexes in the dynamic heterogeneous graph; S22.4, taking as the initial weight of the directed edges of the dynamic heterogeneous graph, a time sequence graph sequence evolving with the task process is generated.

[0011] As a further improvement of the technical solution, the differentiable causal discovery module comprises the following steps in the process of optimizing the existence probability and causal direction of the graph edges based on the time sequence graph sequence by constructing a joint optimization objective function: S23.1, determine the predicted value of the node time sequence at the target time, and the parent node set of the node at the target time, and clarify the fitting basis of the causal relationship; S23.2, construct a prediction error term representing the fitting accuracy of the causal relationship to ensure the accuracy of the causal inference; S23.3, add a sparsity regularization term to constrain the redundancy of the causal relationship; S23.4 Integrate the prediction error term and the sparsity regularization term to form an improved Granger causal loss function LGranger, and simultaneously optimize the existence probability and causal direction of edges in the graph based on the improved Granger causal loss function LGranger.

[0012] As a further improvement to this technical solution, the cognitive decline causal chain modeling module, after generating a cognitive decline causal chain map, calculates the longitudinal deviation of the causal path strength based on a personalized baseline, including the following steps: S24.1 Based on the initial detection data, determine the first... Initial strength value of causal path , for the first Establish personalized baselines based on causal paths; S24.2, Obtain the first The first test Current strength value of the causal path Capture cross-cycle change data; S24.3, based on and Calculate the first Longitudinal deviation of causal paths .

[0013] As a further improvement to this technical solution, the sequence prediction and output module, based on a multi-round causal path strength sequence, utilizes an LSTM-attention network to calculate temporal step attention weights to achieve sequence modeling. The process includes the following steps: S25.1, Obtaining the multi-round causal path strength sequence after inputting it into the LSTM network to generate the first... Step Hidden State and context vectors representing global features of the sequence. This forms the basis for constructing a two-dimensional input of local temporal features and global features; S25.2, based on and The association mapping relationship is calculated for the first Attention score for each time step; S25.3. Normalize the attention scores for all time steps to obtain the first... Attention weights for each time step This enables the modeling of multi-round causal path strength sequences.

[0014] As a further improvement to this technical solution, the personalized intervention strategy generation unit includes an intervention input parsing module, a target path blocking strategy generation module, and an intervention strategy synchronization module, wherein: The intervention input analysis module receives the individualized cognitive function decline causal chain graph and the key driving path output by the central AI processing and analysis unit, and analyzes the path association relationship in the causal chain graph and the core features of the key driving path; The targeted path blocking strategy generation module generates a personalized cognitive intervention strategy for blocking the decline path based on the analysis result of the intervention input analysis module. The intervention strategy synchronization module synchronizes the personalized cognitive intervention strategy generated by the targeted path blocking strategy generation module to the effect tracking and feedback closed loop unit.

[0015] As a further improvement of the technical solution, the effect tracking and feedback closed loop unit comprises an intervention strategy receiving module, an intervention process monitoring module, a feedback data acquisition module, and a data back transmission and iteration connection module, wherein: The intervention strategy receiving module receives the personalized cognitive intervention strategy synchronized by the personalized intervention strategy generation unit; The intervention process monitoring module monitors the implementation process of the personalized cognitive intervention strategy and the corresponding physiological behavior change based on the personalized cognitive intervention strategy obtained by the intervention strategy receiving module; The feedback data acquisition module acquires the post-intervention multi-modal physiological and behavioral data within the monitoring range of the intervention process monitoring module; The data back transmission and iteration connection module transmits the post-intervention multi-modal data collected by the feedback data acquisition module to the central AI processing and analysis unit, and receives the cognitive decline causal chain graph and modeling result iterated based on the back transmission data by the central AI processing and analysis unit, and synchronizes to the personalized intervention strategy generation unit.

[0016] Compared with the prior art, the beneficial effects of the present application are: 1. The present application carries out time sequence collaborative processing based on cognitive task key event timestamp on multi-modal data, combines dynamic heterogeneous graph construction and causal analysis mechanism, forms individualized causal chain graph reflecting the dynamic evolution characteristics of cognitive function decline, and can accurately capture the core path of cognitive impairment progression, solving the problems of insufficient multi-modal data time sequence collaboration and lack of dynamic causal analysis. 2. The present application relies on the above-mentioned individualized causal chain graph to build an integrated platform of “early screening-targeted intervention-effect feedback”, directly associates the screening analysis result with the targeted intervention strategy, and iteratively optimizes the scheme through feedback data, completely covering the whole process of cognitive impairment management, solving the problem of incomplete function coverage and the lack of closed loop linkage between screening and targeted intervention. BRIEF DESCRIPTION OF DRAWINGS

[0017] Fig. 1 The system framework diagram of the present application; Fig. 2 This is a schematic diagram of the macroscopic technical link process of the central AI processing and analysis unit in this invention; Fig. 3 This is a schematic diagram illustrating the application scenarios of the present invention; The meanings of the labels in the diagram are as follows: 1. Multimodal data sensing and acquisition unit; 11. Signal synchronization acquisition module; 12. Task event timestamp association module; 13. Data format standardization module; 2. Central AI Processing and Analysis Unit; 21. Cross-modal Temporal Alignment Module; 22. Dynamic Heterogeneous Graph Construction Module; 23. Differentiable Causality Discovery Module; 24. Cognitive Decline Causal Chain Modeling Module; 25. Sequence Prediction and Output Module; 3. Personalized intervention strategy generation unit; 31. Intervention input parsing module; 32. Targeted pathway blocking strategy generation module; 33. Intervention strategy synchronization module; 4. Effect tracking and feedback closed-loop unit; 41. Intervention strategy receiving module; 42. Intervention process monitoring module; 43. Feedback data collection module; 44. Data feedback and iterative connection module. Detailed Implementation

[0018] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present invention.

[0019] like Figs. 1-3 As shown, this embodiment provides an integrated platform for early screening and intervention of cognitive impairment driven by artificial intelligence, including: Multimodal data perception and acquisition unit 1, based on eye-tracking and EEG synchronous recording technology, acquires synchronous eye-tracking signals, EEG signals and behavioral task data streams of cognitive impairment risk groups, associates key events of cognitive tasks to generate timestamps, completes the perception and acquisition of time-marked multimodal physiological and behavioral data, and transmits the output time-marked multimodal data to the central AI processing and analysis unit 2. In this embodiment, the multimodal data sensing and acquisition unit 1 includes a signal synchronization acquisition module 11, a task event timestamp association module 12, and a data format standardization module 13, wherein: The signal synchronization acquisition module 11 is based on eye-tracking and electroencephalogram (EEG) synchronization recording technology to simultaneously acquire eye-tracking signals, EEG signals, and behavioral task data streams of people at risk of cognitive impairment. Specifically, the signal synchronization acquisition module 11 adopts a general eye movement electroencephalogram synchronization acquisition scheme: an eye movement acquisition device supporting a sampling rate of ≥100 Hz, such as a desktop non-invasive eye movement acquisition device, and an electroencephalogram acquisition device supporting a sampling rate of ≥250 Hz, such as a non-invasive electroencephalogram acquisition device based on scalp electrodes, are selected as core acquisition devices, and a cognitive task execution program, such as a digital working memory task, a visual search task program, is deployed on a PC end to acquire behavioral task data streams; the eye movement acquisition device, the electroencephalogram acquisition device, and the PC end task program are connected through a hardware trigger line, when the PC end task program starts, a trigger signal is sent to the eye movement and electroencephalogram acquisition devices synchronously, so that the three types of devices start data acquisition based on the same trigger signal, ensuring that the acquisition starting time sequence of the eye movement signal, the electroencephalogram signal, and the behavioral task data stream is consistent; wherein the acquisition of the behavioral task data stream is real-time bound with the operation events of the task program, such as stimulus presentation and user reaction, and is recorded synchronously with the task process.

[0020] The task event timestamp association module 12 associates cognitive task key events to generate corresponding timestamp labels for the acquired eye movement signal, electroencephalogram signal, and behavioral task data stream. Specifically, the cognitive task key events include four types of core nodes: “task start”, “stimulus target presentation”, “user reaction submission”, and “task phase end”; the PC end cognitive task program generates a marking instruction containing the event type and the system time when the above key events occur, and sends it to the acquisition software of the eye movement acquisition device, the electroencephalogram acquisition device, and the behavioral data recording module of the PC end itself; after receiving the marking instruction, each device embeds the same event timestamp (format: UNIX timestamp + millisecond level offset) in the acquisition data at the corresponding time, for example: when the “stimulus target presentation” event occurs, the task program generates a timestamp “1690000000123_stimulus presentation”, and the eye movement, electroencephalogram, and behavioral data all add this mark in the sampling data at this time, realizing the time sequence binding of the three types of data and the cognitive task key events.

[0021] The data format standardization module 13 performs format standardization processing on the eye movement signal, the electroencephalogram signal, and the behavioral task data stream after marking the timestamp, and transmits the processed time sequence marked multi-modal physiological and behavioral data to the central AI processing and analysis unit 2.

[0022] Specifically, the original data format of each device is: the eye movement acquisition device outputs a.csv file containing “timestamp, gaze point X coordinate, gaze point Y coordinate, and gaze duration”, the electroencephalogram acquisition device outputs an.edf file containing “timestamp, potential value of each lead (such as F3, F4, C3)”, and the behavioral task program outputs a.json file containing “timestamp, reaction time, and task accuracy”; The data format standardization module 13 converts the three types of data into structured data tables indexed by "unified task event timestamps" through Python script calls to corresponding data parsing libraries (such as pandas for parsing.csv, mne for parsing.edf, and json library for parsing.json). The data table fields include "unified timestamp, data type (eye movement / EEG / behavior), data content (such as eye movement: fixation X / Y; EEG: F3 lead potential; behavior: reaction time)", and the standardized data is finally stored as an HDF5 format file and transmitted to the central AI processing and analysis unit 2.

[0023] The central AI processing and analysis unit 2 receives the time-series labeled multi-modal data transmitted by the multi-modal data perception and acquisition unit 1, and performs cross-modal time-series alignment of eye movement, EEG, and behavior data streams with cognitive task key event timestamps as anchor points. A dynamic heterogeneous graph structure is constructed, physiological and behavioral variables are mapped as graph nodes, a directed edge table with time delay weight is initialized to represent the potential interaction between variables, and a time-series graph sequence evolving with task progress is generated. A differentiable causal discovery mechanism is introduced, an end-to-end structure search algorithm based on Gumbel-Sigmoid is used to jointly optimize the existence probability and causal direction of the edges in the graph, an improved Granger causal loss function and neurophysiological prior constraints are embedded, and a time-series causal weight matrix with biological rationality is automatically learned. Based on the time-series causal weight matrix, a driving decline pattern is identified, an individualized cognitive function decline causal chain map is generated, a personalized baseline is established based on the first detection data, and the longitudinal deviation degree of each causal path intensity in the subsequent detection data is calculated. An LSTM-attention network is used to model the multi-round causal path intensity sequence, and an individualized cognitive function decline causal chain map and key driving path are output to the personalized intervention strategy generation unit 3, as well as a standardized clinical report. The central AI processing and analysis unit 2 includes a cross-modal time-series alignment module 21, a dynamic heterogeneous graph construction module 22, a differentiable causal discovery module 23, a cognitive decline causal chain modeling module 24, and a sequence prediction and output module 25, wherein: In this embodiment, the cross-modal time-series alignment module 21 receives the time-series labeled multi-modal data transmitted by the multi-modal data perception and acquisition unit 1, and performs cross-modal time-series alignment of eye movement, EEG, and behavior data streams with cognitive task key event timestamps as anchor points. The cross-modal time-series alignment module 21 includes a cognitive task anchor reference determination sub-module and a multi-modal data timestamp calibration sub-module, wherein: The cognitive task anchor reference determination sub-module extracts the trigger time of stimulus presentation and response instruction in the cognitive task, and takes the trigger time as the reference time point for multi-modal data alignment; Specifically, the cognitive task anchor reference determining submodule extracts the triggering time of two types of core key events, "stimulus presentation" and "response instruction", in the cognitive task, and the specific implementation is as follows: the event log in the cognitive task execution process is parsed from the time sequence tokenization multi-modal data, and the system time stamp corresponding to the "stimulus presentation identifier" and "response instruction identifier" in the log is screened, denoted as a set of reference time points , (satisfying ), wherein denotes the triggering time of the th key event (N is the total number of key events, which is dynamically adjusted according to the cognitive task design), and the set serves as a unified reference for multi-modal data alignment.

[0024] The multi-modal data timestamp calibration submodule matches the sampling time of the eye movement signal, the electroencephalogram signal and the behavior task data stream with the reference time points, and the time deviation of each modality data after calibration does not exceed 1 / 2 of the corresponding data sampling period.

[0025] Specifically, the multi-modal data timestamp calibration submodule precisely matches the sampling time of the eye movement signal, the electroencephalogram signal and the behavior task data stream with the reference time point set , and the specific implementation is as follows: Let the sampling rate of the eye movement signal be (unit: Hz), and the corresponding sampling period be ; the sampling rate of the electroencephalogram signal be , and the corresponding sampling period be ; and the sampling rate of the behavior task data stream be , and the corresponding sampling period be ; For the sampling time of any modality data, find the reference time point closest to in the reference time point set , and calculate the time deviation ; If ( is the sampling period of the modality data, corresponds to , , respectively), then the sampling time is corrected by the fixed offset calibration method, and the correction formula is: ; Wherein is a sign function, used to maintain the time sequence direction of the sampling time relative to the reference time point; If If the original sampling time of the modal data is , it is directly retained.

[0026] After the sampling time calibration is completed, the sampling time is corrected , and the corresponding modal data value is calculated by linear interpolation. Assuming that the nearest sampling time earlier than in the modal is , the corresponding data value is , the nearest sampling time later than is , and the corresponding data value is , then , the corresponding value is ; If the sampling time is earlier than the first reference point of the reference time point set or later than the last reference point , the original sampling time is retained and marked as a "non-reference alignment sampling point". The time sequence attribute needs to be marked separately in subsequent module processing.

[0027] After calibration, the deviation of all sampling times in the eye movement signal, electroencephalogram signal and behavior task data stream from the corresponding reference time points satisfies , ensuring the time sequence consistency of the multi-modal data.

[0028] In the embodiment, the dynamic heterogeneous graph construction module 22 constructs a dynamic heterogeneous graph structure based on the aligned multi-modal data, maps physiological and behavioral variables to graph nodes, initializes a directed edge table with a time delay weight to represent the potential interaction relationship between variables, and generates a time sequence graph sequence evolving with the task process. When constructing the dynamic heterogeneous graph, the dynamic heterogeneous graph construction module 22 includes the following steps in the process of initial value calculation of the time delay weight of the directed edge and generation of the time sequence graph sequence: S22.1, determine a preset time delay window and obtain a time sequence data sequence corresponding to a graph node. Specifically, the specific implementation of the preset time delay window determination and time sequence data sequence acquisition is as follows: The length of the preset time delay window is determined according to the time scale of the cognitive task and the physiological signal response characteristics, and the value range is In the embodiment, it is set that The value is based on the academic research conclusions of cognitive neuroscience, referring to the time window theory of cognitive processing in "Temporal Windows" as Logistical Basis for Cognitive Processing (Institutional Knowledge Base of the Institute of Psychology, Chinese Academy of Sciences), combined with the neural timing representation research in Neural Representation of Time across Complementary Reference Frames (MPG.PuRe 2025), 0.5s can completely cover the core correlation period (0.4-0.6s) of "stimulus-physiology-behavior" in cognitive tasks, which not only avoids missing key signals due to too short window, but also prevents introducing noise due to too long window, and is the regular adaptive value for multi-modal timing correlation analysis.

[0029] The aligned multi-modal data is divided into continuous time segments along the time dimension, and the length of each time segment is equal to the preset time delay window , forming a time window sequence ( is the total number of time windows); The nodes of the dynamic heterogeneous graph are physiological and behavioral variables, and the total number of nodes is , the time series data sequence of the th node in the th time window is , wherein is the value of the th sampling point in the th node , and is the sampling point index, is the sampling rate of the node corresponding to the modal data.

[0030] S22.2, calculate the correlation coefficient of different node time series data sequences under the time delay window; Specifically, the specific operation of the node time series data sequence correlation coefficient calculation is as follows: For any two nodes and ( ), in the th time window , the correlation coefficient of the time series data sequences and is calculated, and the Pearson correlation coefficient is used in this embodiment, and the calculation formula is: ; wherein, (Time window) (Total number of sampling points within) for The mean, for The mean; Correlation coefficient The value range is [-1, 1]. The larger the absolute value, the stronger the correlation between the two nodes within that time window.

[0031] S22.3. Normalize the correlation coefficients of all node pairs to obtain the initial values ​​of the time delay weights of the edges in the graph. ;in, , All are node indices in a dynamic heterogeneous graph; Specifically, correlation coefficient normalization and initial value calculation of time delay weights. For all node pairs In the Time window Correlation coefficient within Normalization is performed using the Min-Max normalization method, mapping the values ​​to the [0,1] interval to obtain the initial values ​​for the delay weights. (correspond In the The specific values ​​for each time window are calculated using the following formula: ; in, For all node pairs in The minimum value of the internal correlation coefficient. For all node pairs in The maximum value of the internal correlation coefficient; Indicates the first Within a time window, from node Pointing to node The initial values ​​of the time delay weights of the directed edges. , All are node indices in a dynamic heterogeneous graph. ), representing the nodes within this time window For nodes The initial strength of potential interaction relationships.

[0032] S22.4, will As the initial weights of the directed edges in the dynamic heterogeneous graph, a sequence of time graphs that evolves with the progress of the task is generated.

[0033] Specifically, the generation of dynamic heterogeneous graph time series sequences involves the following steps: For each time window Using all physiological and behavioral variables as nodes, Construct a static heterogeneous graph with initial weights for directed edges. ,in ( For the first (nodes). (directed edge) Corresponding node To the node Potential interaction relationships); Concatenate all the static heterogeneous graphs corresponding to the time windows in chronological order to form a sequence of time-series graphs that evolve with the task progress. This sequence fully preserves the dynamic changes in the potential interaction relationships between nodes within different time windows.

[0034] In this embodiment, the differentiable causal discovery module 23 introduces a differentiable causal discovery mechanism to process the time series graph sequence and jointly optimize the existence probability and causal direction of edges in the graph. The process by which the differentiable causal discovery module 23 optimizes the existence probability and causal direction of graph edges based on the time series graph sequence by constructing a joint optimization objective function includes the following steps: S23.1 Determine the predicted value of the node time series data at the target time, and the set of parent nodes of the node corresponding to the target time, to clarify the basis for causal relationship fitting; Specifically, the implementation of determining the node prediction value and the set of parent nodes is as follows: Target time definition: Let the current processing time window be... The target time is The first Each sampling time ( ), denoted as ; node At the target time The true value is Predicted value It is predicted by combining its historical sampling data and the historical data of its parent node set; Parent node set definition: Let node The set of parent nodes is , indicating a node At the target time The set of nodes whose values ​​have potential causal influence. (excluding nodes) (Itself), the initial set of parent nodes is composed of dynamic heterogeneous graphs Medium weight nodes Construct (0.3 is an empirical threshold value for preliminary screening of strong correlation nodes). Among them, the value of 0.3 refers to the classical classification standard of correlation coefficient strength in “Applied Multivariate Statistical Analysis” (Johnson & Wichern), which also meets the research conclusion of “Bactrocera dorsalis oviposition resistance / susceptibility non-volatile decision trait screening and evaluation” (Chinese Journal of Agricultural Sciences, 2023) - when the absolute value of the correlation coefficient is greater than or equal to 0.3, there is a statistically significant correlation between variables, which can eliminate random noise and retain core features. It is a common dividing line between “weak correlation” and “moderate correlation” in feature selection, widely used in multi-field filtering screening tasks.

[0035] S23.2, construct a prediction error term representing the fitting accuracy of the causal relationship, to ensure the accuracy of causal inference; Specifically, the specific implementation of the construction of the prediction error term is as follows: The prediction error term is used to represent the fitting accuracy of the causal relationship, which is constructed based on the deviation between the true value of the node and the predicted value , and the formula is: ; Wherein, , is the causal weight (to be optimized) of node to node , is the causal time delay of node to node (determined by the time offset when the correlation coefficient is maximum in S22.2), is the bias term of node ; is the total number of time windows of the dynamic heterogeneous graph time sequence, is the total number of sampling points in a single time window, is the total number of nodes of the dynamic heterogeneous graph. The smaller the value is, the closer the prediction result based on the parent node set is to the true value, and the higher the fitting accuracy of the causal relationship is.

[0036] S23.3, add a sparsity regularization term to constrain the redundancy of the causal relationship; Specifically, the specific operation of constructing the sparsity regularization term is as follows: The sparsity regularization term is used to constrain the redundancy of the causal relationship to avoid too many false causal edges. L1 regularization is adopted, and the formula is: ; Wherein, ​is the regularization coefficient, with a value range of [0.001, 0.01]. In this embodiment, it is set as follows: This value originates from the academic consensus in the field of sparse causal discovery. Referring to research findings in "Sparse Causal Discovery in MultivariateTime Series" (ar5iv 2025) and "A Sparsity Principle for Partially Observable Causal Representation Learning" (arXiv 2024), the typical parameter range for sparse regularization in causal models is 0.001-0.01. 0.005 falls in the middle of this range, balancing model sparsity with the preservation of causal relationships, which is consistent with... The parameter optimization logic based on 1,2-norm regularization has been proven effective in dynamic Granger causal learning tasks.

[0037] Introducing L1 regularization can make most causal weights The value approaches 0, retaining only a few significant causal edges, which aligns with the sparsity characteristic of causal relationships in cognitive decline.

[0038] S23.4 Integrate the prediction error term and the sparsity regularization term to form an improved Granger causal loss function LGranger, and simultaneously optimize the existence probability and causal direction of edges in the graph based on the improved Granger causal loss function LGranger.

[0039] Specifically, the construction and optimization of the improved Granger causal loss function are as follows: Integrating prediction error terms With sparsity regularization term and embedding neurophysiological prior constraints This leads to an improved Granger causality loss function. The formula is: ; in, These are neurophysiological prior constraints used to ensure the biological plausibility of causal relationships. For example, based on common sense in neuroscience, eye-tracking signal nodes do not directly drive EEG signal nodes; therefore, they constrain the causal weights of such node pairs. The formula is (Ω represents the set of node pairs that do not conform to common sense in neurophysiology); Joint optimization objective: Employ an end-to-end structure search algorithm based on Gumbel-Sigmoid to simultaneously optimize the existence probability of edges in the graph. The probability of the existence of an edge is related to the causal direction. Calculation, where For the Sigmoid function, For random noise that follows a Gumbel distribution, The temperature parameter (initially 1.0, decaying to 0.1 with iteration); Optimization process: Minimize using the stochastic gradient descent (SGD) algorithm The number of iterations was set to 1000, the learning rate was set to 0.001, and the final convergence yielded a biologically plausible temporal causal weight matrix. and the probability matrix of the existence of edges ,when At that time, it is determined that there is a slave node. To the node The causal edge, the causal direction is → .

[0040] In this embodiment, the cognitive decline causal chain modeling module 24, based on the output of the differentiable causal discovery module 23, identifies driving decline patterns, generates an individualized cognitive function decline causal chain map, establishes a personalized baseline, and calculates the longitudinal deviation of the causal path strength. The process by which the cognitive decline causal chain modeling module 24 calculates the longitudinal deviation of the causal path strength based on the personalized baseline after generating the cognitive decline causal chain map includes the following steps: S24.1 Based on the initial detection data, determine the first... Initial strength value of causal path , for the first Establish personalized baselines based on causal paths; Specifically, the steps for establishing a personalized baseline are as follows: Causal path definition: The first in the causal chain diagram of individualized cognitive function decline causal path ( , The total number of causal paths (where is the total number of causal paths) consists of continuous causal edges, denoted as . ,in path length ( ); Initial intensity value calculation: based on the temporal causal weight matrix corresponding to the first detection data. Calculate the first Initial strength value of causal path The formula is: ; in, For the initial detection data, from node To the node Causal weights; Personalized baseline: As the first The personalized baseline of the causal path is denoted as This is used for subsequent comparative analysis of the changing trends of path intensity.

[0041] S24.2, Obtain the first The first test Current strength value of the causal path Capture cross-cycle change data; Specifically, obtain the current intensity value. The specific steps are as follows: No. Second test ( , The number of tests, the first test After completion, the temporal causal weight matrix corresponding to this detection is obtained through the differentiable causal discovery module 23. ; Using the same formula as S24.1, calculate the first... The causal path in the first Current intensity value in this test: ; in, For the first In the second detection data, from node To the node Causal weights; Directly reflects the first During the second test, the first The intensity of causal influence of each causal path.

[0042] S24.3, based on and Calculate the first Longitudinal deviation of causal paths .

[0043] Specifically, calculate the longitudinal deviation. The specific steps are as follows: Longitudinal deviation Used to characterize the The formula for the degree of change in the strength of a causal path relative to a personalized baseline is: ; in, The range of values ​​is , The larger the value, the more significant the change in the strength of the causal path; like ( To avoid deviation from the threshold, this embodiment sets If the value is within the specified range, the causal path is determined to be a driving path of cognitive decline and included in the core path set of the individualized cognitive decline causal chain map. This value conforms to the clinical criteria for cognitive impairment assessment, refers to the diagnostic criteria for mild cognitive impairment (MCI) in the "Chinese Guidelines for the Diagnosis and Treatment of Dementia and Cognitive Impairment (2025 Edition)," and aligns with the clinical consensus of the Australian Dementia Society webinar (2025)—a 20% change in cognitive indicators can effectively distinguish between "physiological decline" and "pathological deviation," cover measurement errors (approximately ±10%), and accurately identify substantial decline trends; it is a commonly used threshold for early cognitive impairment screening.

[0044] In this embodiment, the sequence prediction and output module 25 uses an LSTM-attention network to model the multi-turn causal path strength sequence, outputting an individualized cognitive function decline causal chain map and key driving paths to the personalized intervention strategy generation unit 3, while also outputting a standardized clinical report. The sequence prediction and output module 25, based on the multi-turn causal path strength sequence, utilizes an LSTM-attention network to calculate the attention weights at each time step to achieve sequence modeling, including the following steps: S25.1, Obtaining the multi-round causal path strength sequence after inputting it into the LSTM network to generate the first... Step Hidden State and context vectors representing global features of the sequence. This forms the basis for constructing a two-dimensional input of local temporal features and global features; Specifically, to obtain the first Step Hidden State and context vector The specific steps are as follows: Definition of multi-round causal path strength sequence: Assume that multiple rounds of causal path strength sequence are performed. The first test (including the first test), the The intensity sequence of the causal path is The intensity sequences of all causal paths constitute the input matrix. (dimension is) ); LSTM network input: Input matrix Input the data into the LSTM network in the detection order, at each time step... The input is The Column (corresponding to all causal paths in the first column) The intensity of the second detection, the dimension is ×1); The hidden layer dimension of the LSTM network is set to 64, the activation functions of the forget gate, input gate, and output gate are all Sigmoid functions, and the cell state update uses the tanh function; No. Step Hidden State LSTM network processing After the intensity sequence of the second detection, output the first... Step Hidden State (Dimensions are 64×1) Including the Local temporal characteristics of the strength of all causal paths during the second detection; Context vector For all Hidden state Perform average pooling to obtain a context vector representing the global features of the sequence. (Dimensions are 64×1), the formula is: .

[0045] S25.2, based on and The association mapping relationship is calculated for the first Attention score for each time step; Specifically, the steps for calculating attention scores are as follows: Based on hidden state With context vector The association mapping relationship is calculated. Attention score at each time step The formula is: ; in, (Dimensions are 1×64) (1×64 dimension) is the weight matrix. (1×1 dimension) is the bias term. For activation functions; Attention score Used to measure the The correlation strength between local features and global features at each time step. The larger the value, the greater the contribution of the intensity data of that time step to sequence modeling.

[0046] S25.3. Normalize the attention scores for all time steps to obtain the first... Attention weights for each time step This enables the modeling of multi-round causal path strength sequences.

[0047] Specifically, attention weights The specific operations for computation and sequence modeling are as follows: Attention weight : Attention score for all time steps Normalization is performed, and the softmax function is used to obtain the first... Attention weights for each time step The formula is: ; in: Indicates the total number of detections (including the first detection and the length of the corresponding multi-round causal path strength sequence). Indicates the time step index (value range is...) , corresponding to the (the timing step corresponding to the next detection) The time step traversal variable (range and...) represents the time step traversal variable in the summation process. Consistent); This represents the natural exponential function, used to map attention scores to non-negative values; The value range of is [0,1], and This ensures the normalization property of the weights, that is, the sum of the attention weights of all time steps is 1; Sequence modeling: Incorporating attention weights Hidden state corresponding to the timing step Weighted summation yields the sequence modeling result that integrates local and global features. The formula is: ; Output results: Based on modeling results Filter out attention weights The causal path corresponding to (0.2 as an empirical threshold) is used as the key driving path. Combined with the individualized cognitive function decline causal chain map, a standardized clinical report is generated, which includes the trend of path strength changes, analysis of driving decline patterns, and intervention suggestions. This report is then simultaneously output to the personalized intervention strategy generation unit 3. The value of 0.2 is based on academic research on attention feature selection. According to the algorithm logic of "Sequential Attention for Feature Selection" (ResearchGate 2022), 0.2 is a general dividing value that distinguishes between "core weights" and "secondary weights". Features with weights ≥ 0.2 contribute more than 80% to the model output. This approach can control computational complexity while focusing on key causal paths and has been widely validated in feature selection tasks using efficient attention mechanisms.

[0048] Personalized intervention strategy generation unit 3 receives the individualized cognitive function decline causal chain map and key driving path output by the central AI processing and analysis unit 2, generates a personalized cognitive intervention strategy that targets and blocks the decline path, and synchronizes the generated personalized cognitive intervention strategy to the effect tracking and feedback closed loop unit 4. In this embodiment, the personalized intervention strategy generation unit 3 includes an intervention input parsing module 31, a target pathway blocking strategy generation module 32, and an intervention strategy synchronization module 33, wherein: The intervention input analysis module 31 receives the individualized cognitive function decline causal chain map and key driving paths output by the central AI processing and analysis unit 2, and analyzes the path associations and core features of the key driving paths in the causal chain map. Specifically, the intervention input parsing module 31 receives the individualized cognitive function decline causal chain graph (GraphML format) and key driving path list output by the central AI processing and analysis unit 2, as follows: Graph structured analysis: Extracting the modal types (eye movement / EEG / behavioral) and core feature indicators of nodes in the graph, clarifying the start-end association and causal strength of causal edges. Timely delay We will analyze the complete chain of each key driving path and associate it with the corresponding cognitive function dimensions (such as EEG-attention, eye movement-visual search, and behavior-executive function). Core Feature Extraction: Extracting the initial intensity value of each key driving path. Current intensity value and longitudinal deviation ,according to Determine intervention priority by sorting in descending order; identify the core sensitive features of the starting drive node of the pathway (such as EEG nodes). Wave power ratio, eye movement node fixation stability), as intervention effect monitoring indicators; Output: Structured analysis report, including node-feature mapping table, path-cognitive dimension association table, intervention priority ranking table and sensitive monitoring indicator list.

[0049] The targeted path blocking strategy generation module 32 generates a personalized cognitive intervention strategy for blocking the targeted decline path based on the analysis results of the intervention input analysis module 31; Specifically, the targeted path blocking strategy generation module 32 generates intervention strategies based on the analysis report of the intervention input analysis module 31 according to the "path type-intervention target-task selection-personalized configuration" logic, and the specific implementation is as follows: Intervention target setting: for each key driving path, the core target is to "block abnormal causal transmission, weaken abnormal activation of driving nodes, and optimize target node function"; Classification of tasks: Physiological-behavioral path: select targeted physiological regulation training + behavior optimization training (such as fixation control training + response inhibition training); Multi-modal serial path: select cross-modal collaborative training + single-modal targeted training (such as neurofeedback training + visual-decision collaborative training); Physiological-physiological path: select rhythm regulation training (such as auditory / visual stimulation training based on neural rhythm); Personalized configuration: training duration, frequency and initial difficulty are based on individual baseline , path priority The greater, the higher the training frequency) is set; adjustment rules are based on changes in sensitive indicators after intervention, causal strength changes as the basis for dynamically adapting individual intervention effects; Output: Personalized intervention scheme package, including intervention target, task list, parameter configuration, monitoring indicator and adjustment rule.

[0050] The intervention strategy synchronization module 33 synchronizes the personalized cognitive intervention strategy generated by the targeted path blocking strategy generation module 32 to the effect tracking and feedback closed-loop unit 4.

[0051] Specifically, the intervention strategy synchronization module 33 is responsible for synchronizing the personalized intervention scheme package to the effect tracking and feedback closed-loop unit 4, and the specific implementation is as follows: Format standardization: convert the intervention scheme package to structured JSON format, including intervention strategy ID, user identification, associated path ID, task details, monitoring indicators and synchronization timestamp, to ensure that the receiving end can be directly parsed; Secure transmission: use HTTPS protocol combined with encryption mechanism to transmit data to prevent tampering or leakage; Synchronization guarantee: Set up a receiving confirmation and retry mechanism, automatically retry when no confirmation signal is received; record synchronization logs (including synchronization time, status, and verification results) to support subsequent tracing; Output: Synchronize the standardized personalized intervention strategy to the effect tracking and feedback closed loop unit 4 to complete the accurate delivery of the intervention strategy.

[0052] The effect tracking and feedback closed loop unit 4 receives the personalized cognitive intervention strategy synchronized by the personalized intervention strategy generation unit 3, dynamically monitors the implementation process and effect of the personalized cognitive intervention strategy, collects multi-modal physiological and behavioral data after intervention, and returns the collected multi-modal data after intervention to the central AI processing and analysis unit 2; the central AI processing and analysis unit 2 iterates the cognitive decline causal chain graph and modeling results based on the returned multi-modal data after intervention, and feeds back the iterated results to the personalized intervention strategy generation unit 3, which corrects the intervention strategy parameters.

[0053] In this embodiment, the effect tracking and feedback closed loop unit 4 includes an intervention strategy receiving module 41, an intervention process monitoring module 42, a feedback data collection module 43, and a data return and iteration connection module 44, wherein: The intervention strategy receiving module 41 receives the personalized cognitive intervention strategy synchronized by the personalized intervention strategy generation unit 3; Specifically, the core function of the intervention strategy receiving module 41 is to accurately receive the personalized cognitive intervention strategy synchronized by the personalized intervention strategy generation unit 3, which is implemented as follows: Receiving mechanism: Use a communication protocol (HTTPS protocol) that matches the intervention strategy synchronization module 33 to receive structured JSON format personalized intervention strategy data; Data verification: Verify the integrity and format of the received data, check whether the core fields (intervention strategy ID, user unique identifier, associated key path ID, intervention task list, and monitoring index list) are complete, and whether the format conforms to the preset specification. If the verification is passed, it is stored in the local cache, and if the verification fails, a retransmission request is returned to the personalized intervention strategy generation unit 3; Data analysis and storage: Analyze the JSON format data, extract key information such as intervention task type, implementation parameters (duration, frequency), and core monitoring indicators, and store them according to the "user identifier-strategy ID" index to provide direct callable strategy basis for the subsequent intervention process monitoring module 42.

[0054] The intervention process monitoring module 42 monitors the implementation process of the personalized cognitive intervention strategy and the corresponding physiological and behavioral changes based on the personalized cognitive intervention strategy obtained by the intervention strategy receiving module 41; Specifically, the intervention process monitoring module 42 dynamically monitors the intervention implementation process and the individual physiological behavior response based on the intervention strategy parsed by the intervention strategy receiving module 41, and the specific implementation is as follows: Implementation process monitoring: according to the task type and parameters in the intervention strategy, the compliance of intervention implementation is monitored, including whether the intervention is implemented according to the preset time length and frequency, whether the task difficulty is adjusted according to the rules, and the completion of the intervention implementation is recorded (such as "completion rate" and "number of interruptions"); Physiological behavior dynamic monitoring: based on the core monitoring indicators (such as the power ratio of the EEG node , the fixation stability of the eye movement node, and the reaction time of the behavior node) specified in the intervention strategy, the physiological and behavioral data changes in the intervention process are captured in real time through non-invasive monitoring equipment (consistent with the type of the collection equipment of the multi-modal data perception and collection unit 1), and the data is recorded in a time window of 100ms-500ms to ensure that the data is synchronized with the timing of the intervention process; Abnormal early warning: if it is monitored that the intervention implementation deviates from the preset parameters (such as the single intervention time is less than 80% of the preset value) or the physiological behavior data appears extreme abnormality (such as the EEG signal noise exceeds the standard), real-time warning is triggered to prompt the intervention implementer (such as medical staff, individual) to adjust the implementation method or troubleshoot equipment problems.

[0055] The feedback data collection module 43 collects the post-intervention multi-modal physiological and behavioral data within the monitoring range of the intervention process monitoring module 42; Specifically, the feedback data collection module 43 collects the post-intervention multi-modal physiological and behavioral data based on the monitoring range of the intervention process monitoring module 42, and provides data support for the iterative analysis of the central AI processing and analysis unit 2, and the specific implementation is as follows: Collection timing: start data collection according to the cycle set in the intervention strategy (such as collecting immediately after a single intervention or collecting centrally after each weekly intervention cycle); Collection content: consistent with the collection dimensions of the multi-modal data perception and collection unit 1, including eye movement signals (fixation point coordinates, fixation time), EEG signals (specified lead potential, feature frequency band power ratio), and behavior data (reaction time, task accuracy), to ensure the continuity of the data dimensions; Data preprocessing: standardize and preprocess the collected raw data, including denoising (EEG signal 5-30Hz band-pass filtering, eye movement signal outlier rejection), timestamp labeling (using the intervention end time as the basis to add a uniform timestamp to each data), and format conversion (converted to the same format as the time series labeled multi-modal data), to ensure that the data can be directly parsed by the central AI processing and analysis unit 2.

[0056] The data feedback and iteration connection module 44 feeds back the multimodal data collected by the feedback data acquisition module 43 after intervention to the central AI processing and analysis unit 2, and receives the cognitive decline causal chain map and modeling results after the central AI processing and analysis unit 2 iterates based on the fed-back data, and synchronizes them to the personalized intervention strategy generation unit 3.

[0057] Specifically, the data feedback and iteration connection module 44 is responsible for the feedback of data and the connection of iteration results, constructing a closed-loop link of "collection-analysis-correction", which is implemented as follows: Feedback data transmission: The multimodal data after intervention, which is preprocessed by the feedback data collection module 43, is associated and marked according to "user identifier-strategy ID-collection timestamp" and transmitted back to the central AI processing and analysis unit 2 through an encrypted transmission mechanism (the same encryption method as the intervention strategy synchronization module 33). The transmission is accompanied by a record of the intervention implementation status (completion rate, abnormal situations). Iteration result reception: Receive the results of the central AI processing and analysis unit 2 after iteration based on the feedback data, including the updated individualized cognitive function decline causal chain map, key driving path adjustment results, and updated values ​​of longitudinal deviation of causal path strength; Iterative Integration: The iteration results are synchronized to the personalized intervention strategy generation unit 3 in a structured format, with the "iteration version number" and "core adjustment point" (such as "causal strength of key driving path A") marked during synchronization. "Reducing by 15%" provides a clear basis for the target pathway blocking strategy generation module 32 to modify the intervention strategy parameters; Closed-loop logging: Records data feedback status, iteration result reception status, and time nodes for synchronization to personalized intervention strategy generation unit 3. Log files are established according to "user identifier - iteration cycle" to support subsequent traceability and closed-loop effect evaluation.

[0058] Those skilled in the art will understand that the process of implementing all or part of the steps of the above embodiments can be carried out by hardware or by a program instructing the relevant hardware.

[0059] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely preferred examples and are not intended to limit the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the present invention as claimed. The scope of protection of the present invention is defined by the appended claims and their equivalents.

Claims

1. An integrated platform for early screening and intervention of cognitive impairment driven by artificial intelligence, characterized in that: include: Multimodal data perception and acquisition unit (1) is based on eye-tracking and EEG synchronous recording technology to collect synchronous eye-tracking signals, EEG signals and behavioral task data streams of cognitive impairment risk groups, associate key events of cognitive tasks to generate timestamps, complete the perception and acquisition of time-marked multimodal physiological and behavioral data, and transmit the output time-marked multimodal data to the central AI processing and analysis unit (2). The central AI processing and analysis unit (2) receives time-stamped multimodal data transmitted by the multimodal data perception and acquisition unit (1), and completes cross-modal temporal alignment of eye-tracking, EEG and behavioral data streams with the key event timestamps of the cognitive task as anchor points; constructs a dynamic heterogeneous graph structure, maps physiological and behavioral variables as graph nodes, initializes directed edges with time delay weights to represent the potential interaction relationships between variables, and generates a time-series graph sequence that evolves with the task progress; introduces a differentiable causal discovery mechanism, and uses an end-to-end structure search algorithm based on Gumbel-Sigmoid to jointly optimize the existence probability of edges in the graph. With the causal direction, an improved Granger causal loss function and neurophysiological prior constraints are embedded to automatically learn a biologically reasonable temporal causal weight matrix; based on the temporal causal weight matrix, the driving decline pattern is identified, and an individualized cognitive function decline causal chain map is generated. A personalized baseline is established based on the first detection data, and the longitudinal deviation of the intensity of each causal path in the subsequent detection data is calculated; the LSTM-attention network is used to model the multi-round causal path intensity sequence, and the individualized cognitive function decline causal chain map and key driving paths are output to the personalized intervention strategy generation unit (3), while a standardized clinical report is output at the same time; Personalized intervention strategy generation unit (3) receives the individualized cognitive function decline causal chain map and key driving path output by the central AI processing and analysis unit (2), generates a personalized cognitive intervention strategy that targets and blocks the decline path, and synchronizes the generated personalized cognitive intervention strategy to the effect tracking and feedback closed loop unit (4). The effect tracking and feedback closed-loop unit (4) receives the personalized cognitive intervention strategy synchronized by the personalized intervention strategy generation unit (3), dynamically monitors the implementation process and effect of the personalized cognitive intervention strategy, collects multimodal physiological and behavioral data after intervention, and transmits the collected multimodal data after intervention back to the central AI processing and analysis unit (2); the central AI processing and analysis unit (2) iterates the cognitive decline causal chain map and modeling results based on the transmitted multimodal data after intervention, and feeds back the iterated results to the personalized intervention strategy generation unit (3), which then corrects the intervention strategy parameters.

2. The AI-driven integrated platform for early screening and intervention of cognitive impairment according to claim 1, characterized in that, The multimodal data sensing and acquisition unit (1) includes a signal synchronization acquisition module (11), a task event timestamp association module (12), and a data format standardization module (13), wherein: The signal synchronization acquisition module (11) is based on eye-tracking and electroencephalogram (EEG) synchronization recording technology to simultaneously acquire eye-tracking signals, EEG signals and behavioral task data streams of people at risk of cognitive impairment. The task event timestamp association module (12) associates key events of cognitive tasks and generates corresponding timestamp markers for the collected eye movement signals, EEG signals and behavioral task data streams; The data format standardization module (13) performs format standardization processing on the eye movement signal, EEG signal and behavioral task data stream after the timestamp is marked, and transmits the processed time-marked multimodal physiological and behavioral data to the central AI processing and analysis unit (2).

3. The AI-driven integrated platform for early screening and intervention of cognitive impairment according to claim 2, characterized in that, The central AI processing and analysis unit (2) includes a cross-modal temporal alignment module (21), a dynamic heterogeneous graph construction module (22), a differentiable causal discovery module (23), a cognitive decay causal chain modeling module (24), and a sequence prediction and output module (25), wherein: The cross-modal temporal alignment module (21) receives the temporally marked multimodal data transmitted by the multimodal data perception and acquisition unit (1) and completes the cross-modal temporal alignment of eye movement, EEG and behavioral data streams with the key event timestamps of cognitive tasks as anchor points. The dynamic heterogeneous graph construction module (22) constructs a dynamic heterogeneous graph structure based on the aligned multimodal data, maps physiological and behavioral variables to graph nodes, initializes directed edges with time delay weights to represent the potential interaction relationships between variables, and generates a time sequence graph sequence that evolves with the task progress. The differentiable causal discovery module (23) introduces a differentiable causal discovery mechanism to process the time series graph sequence and jointly optimize the existence probability of edges and causal direction in the graph. The cognitive decline causal chain modeling module (24) identifies driving decline patterns based on the output of the differentiable causal discovery module (23), generates an individualized cognitive function decline causal chain map, establishes a personalized baseline, and calculates the longitudinal deviation of the causal path strength. The sequence prediction and output module (25) uses an LSTM-attention network to model the intensity sequence of multi-round causal paths, outputs an individualized cognitive function decline causal chain map and key driving paths to the personalized intervention strategy generation unit (3), and outputs a standardized clinical report.

4. The AI-driven integrated platform for early screening and intervention of cognitive impairment according to claim 3, characterized in that, The cross-modal temporal alignment module (21) includes a cognitive task anchor benchmark determination submodule and a multimodal data timestamp calibration submodule, wherein: The cognitive task anchor benchmark determination submodule extracts the triggering time of stimulus presentation and response instructions in the cognitive task, and uses the triggering time as the benchmark time point for multimodal data alignment; The multimodal data timestamp calibration submodule matches the sampling times of eye-tracking signals, electroencephalogram signals, and behavioral task data streams with the reference time points. After calibration, the time deviation of each modality data does not exceed 1 / 2 of the corresponding data sampling period.

5. The AI-driven integrated platform for early screening and intervention of cognitive impairment according to claim 4, characterized in that, The dynamic heterogeneous graph construction module (22) performs the following steps when constructing the dynamic heterogeneous graph: initial value calculation of directed edge time delay weights and time series graph sequence generation. S22.1 Determine the preset time delay window and obtain the time series data sequence corresponding to the graph node; S22.2 Calculate the correlation coefficient of time-series data sequences at different nodes under the time delay window; S22.

3. Normalize the correlation coefficients of all node pairs to obtain the initial values ​​of the time delay weights of the edges in the graph. ;in, , All are node indices in a dynamic heterogeneous graph; S22.4, will As the initial weights of the directed edges in the dynamic heterogeneous graph, a sequence of time graphs that evolves with the progress of the task is generated.

6. The AI-driven integrated platform for early screening and intervention of cognitive impairment according to claim 5, characterized in that, The differentiable causal discovery module (23), based on the time series graph sequence, optimizes the probability of graph edge existence and causal direction by constructing a joint optimization objective function, including the following steps: S23.1 Determine the predicted value of the node time series data at the target time, and the set of parent nodes of the node corresponding to the target time, to clarify the basis for causal relationship fitting; S23.2 Construct a prediction error term to characterize the fitting accuracy of causal relationships, ensuring the accuracy of causal inference; S23.3, Add a sparsity regularization term to constrain the redundancy of causal relationships; S23.4 Integrate the prediction error term and the sparsity regularization term to form an improved Granger causal loss function LGranger, and simultaneously optimize the existence probability and causal direction of edges in the graph based on the improved Granger causal loss function LGranger.

7. The AI-driven integrated platform for early screening and intervention of cognitive impairment according to claim 6, characterized in that, The cognitive decline causal chain modeling module (24), after generating the cognitive decline causal chain map, calculates the longitudinal deviation of the causal path strength based on the personalized baseline in the following steps: S24.1 Based on the initial detection data, determine the first... Initial strength value of causal path , for the first Establish personalized baselines based on causal paths; S24.2, Obtain the first The first test Current strength value of the causal path Capture cross-cycle change data; S24.3, based on and Calculate the first Longitudinal deviation of causal paths .

8. The AI-driven integrated platform for early screening and intervention of cognitive impairment according to claim 7, characterized in that, The sequence prediction and output module (25) uses an LSTM-attention network to calculate the attention weights of time steps to achieve sequence modeling based on a multi-round causal path strength sequence. The process includes the following steps: S25.1, Obtaining the multi-round causal path strength sequence after inputting it into the LSTM network to generate the first... Step Hidden State and context vectors representing global features of the sequence. This forms the basis for constructing a two-dimensional input of local temporal features and global features; S25.2, based on and The association mapping relationship is calculated for the first Attention score for each time step; S25.

3. Normalize the attention scores for all time steps to obtain the first... Attention weights for each time step This enables the modeling of multi-round causal path strength sequences.

9. The AI-driven integrated platform for early screening and intervention of cognitive impairment according to claim 8, characterized in that, The personalized intervention strategy generation unit (3) includes an intervention input parsing module (31), a target pathway blocking strategy generation module (32), and an intervention strategy synchronization module (33), wherein: The intervention input analysis module (31) receives the individualized cognitive function decline causal chain map and key driving path output by the central AI processing and analysis unit (2), and analyzes the path association relationship and core features of the key driving path in the causal chain map; The targeted path blocking strategy generation module (32) generates a personalized cognitive intervention strategy for targeting and blocking the decline path based on the analysis results of the intervention input analysis module (31). The intervention strategy synchronization module (33) synchronizes the personalized cognitive intervention strategy generated by the target path blocking strategy generation module (32) to the effect tracking and feedback closed-loop unit (4).

10. The AI-driven integrated platform for early screening and intervention of cognitive impairment according to claim 9, characterized in that, The effect tracking and feedback closed-loop unit (4) includes an intervention strategy receiving module (41), an intervention process monitoring module (42), a feedback data acquisition module (43), and a data feedback and iteration connection module (44), wherein: The intervention strategy receiving module (41) receives the personalized cognitive intervention strategy synchronized by the personalized intervention strategy generation unit (3); The intervention process monitoring module (42) monitors the implementation process of the personalized cognitive intervention strategy and the corresponding physiological behavior changes based on the personalized cognitive intervention strategy obtained by the intervention strategy receiving module (41). The feedback data acquisition module (43) acquires post-intervention multimodal physiological and behavioral data within the monitoring scope of the intervention process monitoring module (42); The data feedback and iteration connection module (44) feeds back the multimodal data after intervention collected by the feedback data acquisition module (43) to the central AI processing and analysis unit (2), and receives the cognitive decline causal chain map and modeling results after the iteration of the feedback data from the central AI processing and analysis unit (2), and synchronizes them to the personalized intervention strategy generation unit (3).

Citation Information

Patent Citations

  • Cognitive disorder screening method and system based on face analysis

    CN120220977A

  • System for early screening and diagnosis of cognitive impairment based on multi-modal data

    CN120783980B

  • Accurate learning data mining method based on cognitive calculation driving

    CN120523850A

  • Multi-modal large model information cooperative processing method, device, equipment and medium

    CN120708014A

  • Cognitive disorder non-invasive screening system and method based on multi-modal characteristics

    CN120708905A