A marking system and device for superscanning of brain functional imaging modalities

Abstract

The present application provides a marking system and device for superscanning of brain function imaging modalities. Through the coordinated cooperation of input device-marking device-several signal acquisition modules-processing device, when a signal acquisition module with a first sampling rate having a lower sampling rate is used, the marking device can sample the marking trigger signal of the input device at a second sampling rate higher than the first sampling rate to obtain the second marking timing data containing the relevant time information of each event of interest. The first marking brain function parameter timing data and the second marking timing data corresponding to each signal acquisition module obtained at the first sampling rate are transmitted to the processing device for display and analysis. In this way, the relevant time information of the respective events of interest of different subjects in the superscanning scene can be comprehensively marked, the occurrence time difference of the corresponding events of interest of different subjects can be accurately evaluated, and the omission and loss of labels in the superscanning scene can be reduced.

Description

Technical Field

[0001] The present application relates to the technical field of near-infrared brain function imaging, and in particular to a marking system, device and computer-readable storage medium for superscanning of brain function imaging modalities. Background Art

[0002] In neuroscience research, understanding the brain activity patterns of individuals in social interactions is crucial to revealing the neural basis of human social behavior. In the hyperscanning scenario, that is, synchronously recording the brain activity of two or more individuals at the same time, it is possible to reveal the correlation of neural activity between individuals during communication, cooperation or competition, which is of great significance for understanding the neural basis of human social behavior.

[0003] Hyperscanning studies conducted in natural interaction scenarios allow researchers to identify and distinguish individual behaviors in social interactions through labeling. Labeling also helps to extract meaningful data from these natural scenarios, thereby improving the ecological validity of the research.

[0004] However, most existing labeling technologies rely on manual operations, which are inefficient and difficult to expand to complex and diverse data sets such as those required in hyperscanning scenarios. Manual labeling may also introduce subjective judgments by researchers, reducing the objectivity of the data. Especially for brain functional imaging devices with low sampling rates, when synchronously collecting brain data from two or more subjects in hyperscanning scenarios, it is impossible to perform comprehensive labeling when labeling and recording the behaviors of different subjects. There are problems such as missing labels and missing labels, making it difficult to accurately assess the time differences in the behaviors of different subjects and to capture rapid changes in the subjects' neural activity. Summary of the invention

[0005] This application is proposed to solve the above technical problems in the prior art. This application aims to provide a labeling system and device for superscanning of brain function imaging modality, which can comprehensively label the events of interest associated with the behavior of each subject when using a low sampling rate brain function imaging device to collect brain function parameter time series data of multiple subjects in a superscanning scenario, reduce missed labels and lost labels, and thus more accurately evaluate the differences in neural activity changes of different subjects.

[0006] According to the first scheme of the present application, a marking system for superscanning of brain function imaging modality is provided, wherein the marking system is used in conjunction with several signal acquisition modules and processing devices of the brain function imaging modality, wherein the several signal acquisition modules all work at a first sampling rate to respectively acquire brain function parameter time series data corresponding to several subjects to achieve superscanning. The marking system comprises an input device and a marking device. The input device is configured to: transmit a marking trigger signal to the marking device in response to each marking trigger operation, wherein each marking trigger operation is associated with an event of interest. The marking device is configured to: generate a marking electrical signal based on each marking trigger signal and transmit it to each signal acquisition module respectively, so as to respectively generate first marking brain function parameter time series data corresponding to each signal acquisition module; and sample the marking trigger signal at a second sampling rate higher than the first sampling rate to obtain second marking time series data. In the superscanning scenario, when the occurrence time difference of the events of interest corresponding to each subject is less than a threshold, the second marking time series data contains relevant time information of each event of interest. Among them, the first marked brain function parameter timing data from each signal acquisition module and the second marked timing data from the marking device are used to be transmitted to the processing device for display or analysis.

[0007] According to the second scheme of the present application, a marking device for superscanning of brain function imaging modality is provided, and the marking device can be used in conjunction with several signal acquisition modules and processing devices of the brain function imaging modality, and the several signal acquisition modules all work at a first sampling rate to respectively acquire the time series data of brain function parameters corresponding to several subjects to achieve superscanning. The marking device is wired to an input device or includes the input device, and is configured to: generate a marking electrical signal based on a marking trigger signal associated with an event of interest from the input device and transmit it to each signal acquisition module respectively; and sample the marking trigger signal at a second sampling rate higher than the first sampling rate to obtain and output second marking time series data. In the superscanning scenario, when the occurrence time difference of the events of interest corresponding to each subject is less than a threshold, the second marking time series data contains the relevant time information of each event of interest.

[0008] According to the third scheme of the present application, a processing device for superscanning of brain function imaging modality is provided, and the processing device can be used in conjunction with several signal acquisition modules and marking devices of the brain function imaging modality, and the several signal acquisition modules all work at a first sampling rate to respectively collect the brain function parameter timing data corresponding to several subjects to achieve superscanning. The processing device includes a communication interface and a processor. The communication interface is configured to: obtain each first marked brain function parameter timing data from each of the signal acquisition modules, and each second marked timing data from the marking device, wherein each second marked timing data is obtained by the marking device sampling each marking trigger signal from the input device at a second sampling rate higher than the first sampling rate, and contains relevant time information of each event of interest. The processor is configured to: based on the first marked brain function parameter timing data and the second marked timing data, display the brain function parameter timing data of each subject and the timing mark of each event of interest on the display.

[0009] According to the fourth scheme of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor performs the following processing. Acquire each first marked brain function parameter timing data from each signal acquisition module, and each second marked timing data from a marking device, wherein each second marked timing data is obtained by the marking device sampling each marking trigger signal from an input device at a second sampling rate higher than the first sampling rate, and contains relevant time information of each event of interest. On a display, the brain function parameter timing data in the time domain and the timing mark of the event of interest represented by the first marked brain function parameter timing data are displayed, and the second marked timing data is saved. Alternatively, on a display, the brain function parameter timing data in the time domain and the timing mark of the event of interest represented by each of the first marked brain function parameter timing data and the second marked timing data are displayed.

[0010] Compared with the prior art, the beneficial effects of the embodiments of the present application are:

[0011] The embodiment of the present application provides a marking system and device for superscanning of brain function imaging modality. In the superscanning scenario, the marking trigger signal of the input device is sampled and marked by the marking device at a second sampling rate higher than the first sampling rate, and the second marking timing data containing the relevant time information of each event of interest can be obtained. The second marking timing data and the first marking brain function parameter timing data corresponding to each signal acquisition module obtained at the first sampling rate can be transmitted to the processing device for display and comparative analysis. Through the above coordination of the input device-marking device-several signal acquisition modules-processing device, it is possible to detect the events of interest of each subject with a time difference less than a threshold, that is, it is possible to detect the events of interest with a time difference less than a threshold that cannot be detected together at the first sampling rate of the signal acquisition module itself, and comprehensively mark them, thereby significantly reducing or even eliminating the omission and loss of labels at the first sampling rate in the superscanning scenario. In addition, it is possible to more accurately evaluate the differences in neural activity changes among different subjects.

[0012] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above description and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In the drawings, which are not necessarily drawn to scale, the same reference numerals may describe similar parts in different views. Similar reference numerals with letter suffixes or different letter suffixes may represent different examples of similar components. The accompanying drawings generally illustrate various embodiments by way of example and not by way of limitation, and together with the description and claims, are used to illustrate the disclosed embodiments. Such embodiments are illustrative and exemplary and are not intended to be exhaustive or exclusive embodiments of the present method, apparatus, system, or non-transitory computer-readable medium having instructions for implementing the method.

[0014] Figure 1 A schematic diagram showing a marking system for a brain functional imaging modality in a hyperscanning scenario according to an embodiment of the present application;

[0015] Figure 2 A framework diagram of a marking system for superscanning of brain functional imaging modalities according to an embodiment of the present application is shown;

[0016] Figure 3 A schematic diagram showing the communication between the marking system, the signal acquisition module and the processing device in a super scanning scenario according to an embodiment of the present application is shown;

[0017] Figure 4A communication schematic diagram of timing alignment between a marking system, a signal acquisition module and a processing device in a super scanning scenario according to an embodiment of the present application is shown;

[0018] Figure 5 A schematic structural diagram of a marking device according to an embodiment of the present application is shown;

[0019] Figure 6 A flowchart showing a process performed by a marking device according to an embodiment of the present application;

[0020] Figure 7 A schematic diagram showing the structure of a processing device according to an embodiment of the present application is shown;

[0021] Figure 8 A flowchart showing a process performed by a processing device according to an embodiment of the present application;

[0022] Fig. 9 A schematic diagram showing an example of a display interface of a processing device according to an embodiment of the present application. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the technical solution of the present application, the present application is described in detail below in conjunction with the accompanying drawings and specific implementation examples. The embodiments of the present application are further described in detail below in conjunction with the accompanying drawings and specific implementation examples, but are not intended to limit the present application.

[0024] It should be understood that various modifications may be made to the embodiments of the invention herein. Therefore, the above description should not be considered as limiting, but only as an example of an embodiment. Other modifications within the scope and spirit of the present application will occur to those skilled in the art.

[0025] It should also be understood that although the present application has been described with reference to some specific examples, those skilled in the art will be able to readily implement many other equivalent forms of the present application.

[0026] The words "first", "second" and similar words used in this application do not indicate any order, quantity or importance, but are only used to distinguish. The words "include" or "comprises" and similar words used in this application mean that the elements before the word include the elements listed after the word, and do not exclude the possibility of also including other elements.

[0027] In the present application, the arrows shown in the figures of each step are merely examples of the execution order, not limitations. The technical solution of the present application is not limited to the execution order described in the embodiments. The various steps in the execution order can be combined for execution, can be decomposed for execution, and can be reordered, as long as the logical relationship of the execution content is not affected.

[0028] The various embodiments of the present application may be implemented independently or in combination with each other to achieve different technical effects.

[0029] All terms (including technical terms or scientific terms) used in this application have the same meaning as those understood by ordinary technicians in the field to which this application belongs, unless otherwise specifically defined. It should also be understood that terms defined in general dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an idealized or extremely formal sense, unless explicitly defined here. Techniques and equipment known to ordinary technicians in the relevant field may not be discussed in detail, but where appropriate, the techniques and equipment should be considered as part of the specification.

[0030] Figure 1 The schematic diagram of a marking system 100 for superscanning of brain function imaging modalities provided by an embodiment of the present application in a superscanning scenario is shown, and the collaborative use of two signal acquisition modules 200 is used as an example for explanation. The marking system 100 is used in collaboration with several signal acquisition modules 200 and a processing device 300 of the brain function imaging modality, and the several signal acquisition modules 200 all work at a first sampling rate to respectively collect the time series data of brain function parameters corresponding to several subjects to achieve superscanning. Figure 2 As shown, the marking system 100 includes an input device 102 and a marking device 101. Figure 3 As shown, it is a communication diagram between the marking system, the signal acquisition module and the processing device in the hyperscanning scenario. The input device 102 is configured to transmit a marking trigger signal to the marking device 101 in response to each marking trigger operation, and each marking trigger operation is associated with an event of interest. The marking device 101 is configured to generate a marking electrical signal based on each marking trigger signal and transmit it to each signal acquisition module 200 respectively, so as to generate first marking brain function parameter time series data corresponding to each signal acquisition module 200 respectively. The marking device 101 is also configured to sample the marking trigger signal at a second sampling rate higher than the first sampling rate to obtain second marking time series data. In the hyperscanning scenario, when the occurrence time difference of the respective events of interest corresponding to the subjects is less than a threshold, the second marking time series data contains the relevant time information of each event of interest. Among them, the first marking brain function parameter time series data from each signal acquisition module 200 and the second marking time series data from the marking device 101 are used to be transmitted to the processing device 300 for display or analysis.

[0031] The marking system 100 for superscanning of brain function imaging modality provided by the embodiment of the present application, in the superscanning scenario, can obtain the second marking time series data containing the relevant time information of each event of interest by sampling and marking the marking trigger signal of the input device 102 at a second sampling rate higher than the first sampling rate through the marking device 101. The second marking time series data and the first marking brain function parameter time series data corresponding to each signal acquisition module 200 obtained at the first sampling rate can be transmitted to the processing device 300 for display and comparative analysis. Through the above coordination of the input device 102-marking device 101-several signal acquisition modules 200-processing device 300, it is possible to detect the events of interest with a time difference less than the threshold of each subject, that is, it is possible to detect the events of interest with a time difference less than the threshold that cannot be detected together at the first sampling rate of the signal acquisition module 200 itself, and comprehensively mark them, thereby significantly reducing or even eliminating the omission and loss of labels at the first sampling rate in the superscanning scenario. In addition, it is possible to more accurately evaluate the differences in neural activity changes among different subjects.

[0032] In some embodiments, the brain functional imaging modality includes at least one of fNIRS imaging, electroencephalography, and magnetoencephalography.

[0033] Specifically, brain functional imaging modalities are methods that use different physical principles and technical means to observe and record brain activity, including functional near-infrared spectroscopy (fNIRS), electroencephalogram (EEG) and magnetoencephalography (MEG). Functional near-infrared spectroscopy (fNIRS) is a non-invasive imaging technology that uses near-infrared light to measure cerebral cortical blood flow and oxygenation levels. Near-infrared light has strong penetrating power and can reach a depth of 2-3 cm under the cerebral cortex and is selectively absorbed by oxygenated hemoglobin (HbO2) and deoxygenated hemoglobin (Hb) in the blood. fNIRS measures changes in light absorption through a light source and detector placed on the subject's scalp, thereby inferring changes in cerebral blood flow and oxygenation levels. fNIRS is insensitive to motion artifacts, has good electromagnetic compatibility, high temporal and spatial resolution, and can be used in combination with multiple modalities, such as EEG, TMS and other technologies. Electroencephalography (EEG) is a technology that reflects the functional state of the brain by measuring the brain's electrical activity. It captures the electrical signals generated by neuronal discharges through electrodes attached to the subject's scalp. It has high temporal resolution and can be accurate to milliseconds. Magnetoencephalography (MEG) is a technology that measures the changes in weak magnetic fields generated by brain activity and can provide high spatial resolution images of brain activity.

[0034] Specifically, different brain functional imaging modalities have their unique application scenarios and advantages. Researchers can choose the appropriate imaging modality according to specific research goals and conditions. For example, fNIRS is suitable for research in natural scenes because of its high tolerance to motion. Different brain functional imaging modalities have different sampling rates. Since fNIRS measures slower changes in blood oxygen, its sampling rate is relatively low. EEG and MEG measure rapid changes in potential and magnetic field, so a higher sampling rate is required to ensure the accuracy and integrity of the signal.

[0035] In some embodiments, the plurality of signal acquisition modules 200 of the brain function imaging modality refers to two or more signal acquisition modules 200, and all operate at a first sampling rate to respectively acquire brain function parameter time series data corresponding to two or more subjects to achieve superscanning.

[0036] In some embodiments, when the brain function imaging modality is fNIRS imaging, two or more signal acquisition modules 200 are near-infrared brain function imaging data acquisition devices, which are used to collect the corresponding near-infrared brain function parameter time series data of two or more subjects to achieve super scanning. Specifically, the first sampling rate of the near-infrared brain function imaging data acquisition device is 1Hz-200Hz, preferably, the first sampling rate is 10Hz, and the second sampling rate is at least twice the first sampling rate, so that the behavior-related events of interest of each subject can be comprehensively marked to reduce missed and lost labels.

[0037] In some embodiments, brain function parameter time series data refers to the data changes of brain function parameters such as brain blood flow and oxygenated hemoglobin of the subject obtained by the signal acquisition module 200 of the brain function imaging modality, as well as the time series data corresponding to these brain function parameters. These data can reflect the brain function activity status of the subject's brain when performing a specific task or in a specific state.

[0038] In some embodiments, two events of interest with a time difference less than a threshold value cannot be collected and detected together at the first sampling rate. Specifically, the value of the threshold value can be set to be associated with the first sampling rate, for example, in an inverse relationship as needed. In some embodiments, the threshold value can also be tested and preset by conducting a preliminary experiment on two events of interest with different time differences at the first sampling rate. Among them, the time difference that two events of interest usually have will be tested in the hyperscanning scenario, the loss of the label will be checked, and then the threshold value will be set accordingly. The goal is to introduce the second sampling rate to supplement the labeling, so that the loss of the event of interest with a time difference slightly less than the threshold value at the first sampling rate can also be significantly alleviated or eliminated. Exemplarily, when the first sampling rate is 10Hz, the threshold value is 10ms. When the time difference between the occurrence of different events of interest corresponding to different subjects is only 10ms, it is impossible to detect the time difference between the occurrence of different events of interest corresponding to different subjects, but the time difference of 10ms needs to be identified in the actual hyperscanning scenario.

[0039] In some embodiments, in a hyperscanning scenario, when the time difference of the occurrence of the events of interest corresponding to each subject is less than a threshold, the marking device 101 samples the marking trigger signal at a second sampling rate higher than the first sampling rate to obtain second marking timing data, and the second marking timing data contains relevant time information of each event of interest. In this way, the marking device 101 can sample the marking trigger signal at the second sampling rate to detect the occurrence time and the time difference of the events of interest corresponding to different subjects. In this way, when using a brain function imaging device with a low sampling rate to collect brain function parameter timing data of multiple subjects, it is still possible to comprehensively mark the events of interest associated with the behavior of each subject.

[0040] In some embodiments, for example, in a hyperscanning scenario, the events of interest corresponding to each subject include at least one of the following: each subject's behavior in response to the same prompt event, each subject's behavior in response to sequential prompt events, the same or sequential prompt events issued by the processing device 300 to the subject, or interference events from the external environment.

[0041] In some embodiments, the subjects' respective behaviors in response to the same prompt event refer to the subjects receiving the same stimulus or prompt (such as pictures, sounds or text instructions) and reacting or showing stress behavior thereto, so as to facilitate the operator's subsequent research on the subjects' brain function activity in response to the same stimulus or prompt.

[0042] In some embodiments, the subject's respective behavior in response to sequential prompt events means that the prompt events received by the subject are in order, such as in a specific time sequence or based on a certain logical order, and each subject responds to different prompt events in the sequence, which helps the operator analyze the impact of the event sequence on the subject's brain function activities.

[0043] In some embodiments, the same or sequential prompt events issued by the processing device 300 to the subject means that the processing device 300 provides the same or sequentially arranged prompt events to the subject, and there is no specific limitation on this, as long as the prompt event can be used to trigger the subject to respond.

[0044] In some embodiments, interference events in the external environment refer to unpredictable factors from the external environment in addition to prompt events controlled by the operator, such as sudden noise or other sensory stimulation. These interference events may affect the subject's attention and behavior. The operator should consider the impact of these interference events on the subject and pay special attention to them by identifying marks.

[0045] In some embodiments, the input device 102 includes a speech recognition module and / or a gesture recognition module. In some preferred embodiments, the speech recognition module generates a marking trigger signal when recognizing that the speech contains a preset keyword. The gesture recognition module generates a marking trigger signal by recognizing the operator's gesture. By providing a variety of interaction methods, it can adapt to the operating habits and preferences of different operators.

[0046] In some embodiments, the marking trigger signal includes a marking trigger level signal, i.e., a signal with a high or low state of a specific voltage or current. The marking device 101 is further configured to: based on each marking trigger level signal, generate a marking electrical signal including a pulse amplitude, respectively, to transmit to each signal acquisition module 200.

[0047] Specifically, for each received marking trigger level signal, the marking device 101 will generate a corresponding marking electrical signal including a pulse amplitude, and the marking electrical signal has a specific amplitude. Each signal acquisition module 200 receives the corresponding marking electrical signal and generates corresponding first marking brain function parameter time series data.

[0048] In some embodiments, the marking trigger signal may also include an optical signal or other types of signals, such as sound, light, current, etc., which can trigger the marking operation. There is no specific limitation on this, and it is intended to provide flexibility to adapt to different application scenarios and needs.

[0049] The marking system 100 and device for superscanning of brain function imaging modality provided by the present application, in the superscanning scenario, the marking trigger signal of the input device 102 is sampled and marked by the marking device 101 at a second sampling rate higher than the first sampling rate, and the second marking time series data containing the relevant time information of each event of interest can be obtained. The second marking time series data and the first marking brain function parameter time series data corresponding to each signal acquisition module 200 obtained at the first sampling rate can be transmitted to the processing device 300 for display and comparative analysis. Through the above coordination of the input device-marking device-several signal acquisition modules-processing devices, it is possible to detect the events of interest of each subject with a time difference less than a threshold, that is, it is possible to detect the events of interest with a time difference less than a threshold that cannot be detected together at the first sampling rate of the signal acquisition module itself, and comprehensively mark them, thereby significantly reducing or even eliminating the omission and loss of labels at the first sampling rate in the superscanning scenario. In addition, it is possible to more accurately evaluate the differences in neural activity changes among different subjects.

[0050] In some embodiments, the input device 102 includes a plurality of operating parts and is wired or integrated to the marking device 101 to receive a marking trigger operation made by an operator in response to an event of interest. Alternatively, in some embodiments, each marking trigger operation is automatically triggered by the occurrence of a corresponding event of interest. Alternatively, in some embodiments, the occurrence time of each event of interest is pre-set, and each marking trigger operation is automatically triggered at the pre-set occurrence time of each event of interest.

[0051] In some embodiments, the plurality of operating parts refers to two or more identical or different operating parts, and the operator can set them according to actual needs, and there is no specific limitation on this.

[0052] In some embodiments, the operating unit may be a keyboard, which is used as the input unit of the marking device 101 to input text and commands. In other embodiments, the operating unit may be different buttons or controls on the software interface, and the operator may control the marking device 101 by clicking the buttons or controls. In addition, the operating unit may also be a remote controller or a mobile device, etc., which can establish good communication with the marking device 101, and this is not specifically limited.

[0053] In some embodiments, the input device 102 may be wired to the marking device 101 via a physical cable, or may be integrated with the marking device 101 to ensure that the input device 102 can accurately transmit the marking trigger signal to the marking device 101 in response to each marking trigger operation.

[0054] In other embodiments, the marking trigger operation may be automatically triggered according to the occurrence of a corresponding event of interest, without requiring direct intervention by an operator.

[0055] In some embodiments, the marking trigger operation can be automatically triggered by the pre-set occurrence time of the event of interest, that is, the marking trigger operation can be automatically started at a preset time point. This method of pre-setting the occurrence time of the event of interest is helpful for automated process management.

[0056] In some embodiments, the plurality of operating parts include a plurality of buttons, each button has a set association with each type of event of interest, and the input device 102 is further configured to: receive the marking trigger operation of the operator on each button, and transmit a marking trigger signal representing the type of event of interest and the trigger operation time to the marking device 101. The marking device 101 is further configured to: generate each marking electrical signal including the type of event of interest and the trigger operation time based on each marking trigger signal.

[0057] In some embodiments, the operator sets the association between each button and a specific type of event of interest. For example, button A is related to the subject's left hand movement, and button B is related to the subject's blinking behavior. The specific settings can be made according to the operator's research needs and are not specifically limited.

[0058] In some embodiments, the marking trigger signal contains relevant information about the specific event type that triggered it, such as a rest event, a walking event, a running event, etc. The marking trigger signal is used to characterize this information, making it easier for the operator to identify and distinguish between different types of events.

[0059] In some embodiments, the marking trigger signal also includes information about the time when the trigger operation occurs, for example, the specific time when a rest event, a walking event, etc. occurs.

[0060] In some embodiments, the marking device 101 generates marking electrical signals including the above-mentioned event type information and trigger operation time based on each marking trigger signal.

[0061] In some embodiments, the marking device 101 is further configured to: be communicatively connected to the processing device 300; and encode the time information of each marking trigger operation and the type information of the corresponding event of interest in the second marking timing data. The processing device 300 is further configured to: receive the second marking timing data, decode and obtain the time information of each marking trigger operation as the time information of each event of interest that occurs, and decode and obtain the type of each event of interest.

[0062] In some embodiments, the marking device 101 is communicatively connected to each signal acquisition module 200 in a first communication mode, and the first communication mode is a wireless or wired connection, and the specific connection mode is not specifically limited.

[0063] In some embodiments, the marking device 101 is communicatively connected to the processing device 300 in a second communication mode, and the second communication mode is a wireless or wired connection. According to the second communication mode, the time information of each marking trigger operation and the type information of the corresponding event of interest are encoded in the second marking timing data. Specifically, the encoding method includes but is not limited to encoding using a timestamp or a frame index.

[0064] In some embodiments, the marking device 101 is further configured to perform clock synchronization processing with each signal acquisition module 200 and processing device 300 in advance. In some embodiments, the marking device 101 can be further configured to transmit a timestamp to each signal acquisition module 200 and processing device 300, and / or receive a timestamp from each signal acquisition module 200 and processing device 300. In this way, the timing alignment of each marking trigger operation can be achieved, thereby achieving the timing alignment of the second marking timing data and each first marking brain function parameter timing data.

[0065] In some embodiments, a timestamp refers to a numerical value indicating a specific time point. Specifically, the timestamp is used to record the numerical value of the precise time at which each subject's respective event of interest occurs.

[0066] In some embodiments, before the event of interest occurs, the internal clocks of the marking device 101, the signal acquisition module 200, and the processing device 300 are pre-adjusted to the same frequency and phase to ensure time consistency.

[0067] In some embodiments, the marking device 101 transmits a timestamp to the signal acquisition module 200 and the processing device 300. Alternatively, the internal clocks of the signal acquisition module 200 and the processing device 300 generate timestamps when acquiring or processing data, and send the timestamp information to the marking device 101. In this way, the marking device 101 can receive timestamp information from different signal acquisition modules 200 and processing devices 300 to achieve time alignment.

[0068] In some embodiments, Figure 4As shown, the input device 102 is further configured to: transmit a preset marking trigger signal to the marking device 101 in response to a set of preset marking trigger operations. The marking device 101 is further configured to: generate a preset marking electrical signal based on the preset marking trigger signal and transmit it to each signal acquisition module 200 respectively, so as to generate each preset first marking brain function parameter timing data. Among them, the time difference of each preset marking trigger operation in a set of preset marking trigger operations is greater than the threshold value, so that it can be fully detected by each signal acquisition module 200. The marking device 101 is also configured to: sample the preset marking trigger signal at a second sampling rate to obtain the preset second marking timing data. Among them, each preset first marking brain function parameter timing data and the preset second marking timing data are used to be transmitted to the processing device 300 to perform the timing alignment of each preset marking trigger operation. Specifically, a series of sequential timings of each preset marking trigger operation in this set of preset marking trigger operations can be accurately detected at the first sampling rate and the second sampling rate. Then, by aligning this series of timings in sequence, the timing calibration of the sampling marking at the second sampling rate of the marking device 101 and the sampling marking at the first sampling rate of each signal acquisition module 200 can be aligned. After calibration and alignment, the actual marking trigger operation other than the preset can be marked, and the corresponding timing mark still maintains good synchronization, and the effect is as follows: Fig. 9 shown.

[0069] In some embodiments, when two events of interest whose time difference of the marking trigger operation is less than a threshold cannot be collected and detected together at the first sampling rate, the marking device 101 samples the preset marking trigger signal at the second sampling rate to obtain the preset second marking timing data containing the relevant time information of each event of interest. The processing device 300 receives the preset second marking timing data and each preset first marking brain function parameter timing data, and displays or analyzes them through the display 303. Fig. 9 As shown, in the display interface of the processing device, the preset second marking time series data includes all timing marks corresponding to each event of interest, such as Mark1, Mark2 and Mark3, while the preset first marking brain function parameter time series data only includes the timing marks Mark1 and Mark3 of each event of interest. The second marking time series data can be used to supplement the events of interest with a time difference less than the threshold that cannot be detected together at the first sampling rate of the signal acquisition module itself, and comprehensively mark the events of missed and lost marks.

[0070] The various embodiments of the present application may be implemented independently or in combination with each other to achieve different technical effects, and the specific implementation methods are not described in detail here.

[0071] In combination with the above-mentioned embodiments, in a hyperscanning scenario, the marking trigger signal of the input device 102 can be sampled and marked by the marking device 101 at a second sampling rate higher than the first sampling rate, and the second marking time series data containing the relevant time information of each event of interest can be obtained. The second marking time series data and the first marking brain function parameter time series data corresponding to each signal acquisition module 200 obtained at the first sampling rate can be transmitted to the processing device 300 for comparison display and comparative analysis. Through the above coordination of the input device-marking device-several signal acquisition modules-processing device, it is possible to detect the events of interest of each subject whose time difference is less than the threshold, that is, it is possible to detect the events of interest whose time difference is less than the threshold that cannot be detected together at the first sampling rate of the signal acquisition module itself, and comprehensively mark them. Thereby significantly reducing or even eliminating the missed and lost labels at the first sampling rate in the hyperscanning scenario, and thus being able to more accurately evaluate the differences in neural activity changes among different subjects.

[0072] In some embodiments, the marking device 101 can be used in conjunction with a plurality of signal acquisition modules 200 and a processing device 300 of a brain function imaging modality, and the plurality of signal acquisition modules 200 all operate at a first sampling rate to respectively acquire time series data of brain function parameters corresponding to a plurality of subjects to achieve hyperscanning. The marking device 101 is wiredly connected to an input device 102 or includes an input device 102, such as Figure 6 As shown, it is a process flow chart executed by the marking device 101, which mainly includes the following steps:

[0073] S101 : Based on a marking trigger signal associated with an event of interest from the input device 102 , a marking electrical signal is generated and transmitted to each signal acquisition module 200 .

[0074] S102: Sampling the marking trigger signal at a second sampling rate higher than the first sampling rate to obtain and output second marking timing data. In the hyperscanning scenario, when the occurrence time difference of the respective events of interest corresponding to the subjects is less than a threshold, the second marking timing data contains relevant time information of each event of interest. In S102, the second marking timing data can be output to a target device intended to analyze or display the complete timing mark, such as but not limited to the processing device 300, and can also be transmitted to other terminals to view or analyze the complete timing mark.

[0075] In some embodiments, the marking device 101 includes a sampling module 1011, a signal processing module 1012, a signal output module 1013, and input and output interfaces, such as Figure 5Specifically, the marking device 101 can be communicatively connected with the signal acquisition module 200 and the processing device 300 through the output interface, such as communicating with the signal acquisition module 200 and the processing device 300 independently through two independent output interfaces, or communicating with the signal acquisition module 200 and the processing device 300 in a time-division manner through a single output interface, which will not be described in detail here. The input interface can be a wired interface for connecting to the input device 102 and receiving a marking trigger signal associated with the event of interest from it.

[0076] In some embodiments, the signal processing module 1012 processes the marking trigger signal. Specifically, there are two signal processing paths. The signal processing module 1012 can generate a marking electrical signal based on the marking trigger signal associated with the event of interest from the input device, and transmit it to each signal acquisition module under the action of the signal output module 1013 (see Figure 6 Specifically, the generated marking electrical signal can be transmitted to each signal acquisition module via the output interface. The signal processing module 1012 can enable the sampling module 1011 to sample each received marking trigger signal at a higher second sampling rate to obtain the second marking timing data, and output the second marking timing data to the processing device 300 via the output interface under the action of the signal output module 1013.

[0077] Please note, Figure 5 The structure is only used as an example. In some embodiments, the marking device 101 may also have a variety of suitable hardware configurations, as long as it can realize the conversion of the marking trigger signal to the marking electrical signal, signal sampling, and branching through the communication interface to corresponding output and other operations, which will not be repeated here.

[0078] In some embodiments, the processing device 300 can be used in conjunction with several signal acquisition modules 200 and the marking device 101 of the brain function imaging modality, and the several signal acquisition modules 200 all work at the first sampling rate to respectively acquire the brain function parameter time series data corresponding to several subjects to achieve super scanning. Figure 7 As shown, the processing device 300 includes a communication interface 302 , a processor 301 , a display 303 and a storage module 304 .

[0079] like Figure 8 As shown, it is a process flow chart executed by the processing device 300, which mainly includes the following steps.

[0080] In S201, each first marked brain function parameter timing data from each of the signal acquisition modules 200 and each second marking timing data from the marking device 101 can be obtained, wherein each second marking timing data is obtained by the marking device 101 sampling each marking trigger signal from the input device 102 at a second sampling rate higher than the first sampling rate, and includes relevant time information of each event of interest.

[0081] In S202 , the brain function parameter time series data of each subject and the timing marks of each event of interest may be displayed on the display 303 based on the first labeled brain function parameter time series data and the second labeled time series data.

[0082] In some embodiments, the storage module 304 is used to store the first marked brain function parameter timing data from each signal acquisition module 200 and the second marked timing data from the marking device 101 and the mark of the relevant time information of each event of interest.

[0083] In some embodiments, the type and number of the communication interface 302 can be set according to the interfaces equipped by the signal acquisition module 200 and the marking device 101. For example, when the signal acquisition module 200 is equipped with a USB interface and the marking device 101 is equipped with a serial port, the communication interface 302 is configured with a corresponding USB interface and serial port, so that independent parallel transmission between the signal acquisition module 200 and the marking device 101 can be achieved, that is, while USB communication transmission is performed with the signal acquisition module 200, serial port transmission can also be performed with the marking device 101.

[0084] Please note that the "interface" mentioned herein may be a socket or an insert that complies with a communication protocol, which is not described in detail here. In some embodiments, the type of each interface may be a Universal Serial Bus (USB) interface, an RS232 interface, etc., which is not described in detail here.

[0085] In some embodiments, the processing device 300 performs the timing alignment of each preset marking trigger operation based on each preset first marking brain function parameter timing data from each signal acquisition module 200 and the preset second marking timing data from the marking device 101. Wherein, each preset first marking brain function parameter timing data is obtained by sampling the preset marking electrical signal from the marking device 101 at a first sampling rate by each signal acquisition module 200, and the preset second marking timing data is obtained by sampling the preset marking trigger signal from the input device 102 by the marking device 101 at a second sampling rate higher than the first sampling rate. The preset marking trigger signal is generated by the input device 102 in response to a set of preset marking trigger operations, and the preset marking electrical signal is generated by the marking device 101 based on the preset marking trigger signal. The time difference of each preset marking trigger operation in a set of preset marking trigger operations is greater than the threshold, so that it can be fully collected and detected by each of the signal acquisition modules 200. In this way, specifically, a series of sequential timings of each preset marking trigger operation in this set of preset marking trigger operations can be accurately detected at the first sampling rate and the second sampling rate. Then, by aligning the timings of the series in sequence, the timings of the sampling marking at the second sampling rate of the marking device 101 and the sampling marking at the first sampling rate of each signal acquisition module 200 can be aligned. After the alignment, the actual marking trigger operation other than the preset can be marked, and the corresponding timing marks still maintain good synchronization, and the effect is as follows: Fig. 9 shown.

[0086] In some embodiments, the processing device 300 displays a time series curve of brain function parameters in the time domain and a mark of relevant time information of each event of interest for each subject on the first time axis.

[0087] In some embodiments, the processing device 300 generates a first time axis (eg, Fig. 9 The brain function parameter time series curve in the time domain and the time mark of the event of interest represented by the first labeled brain function parameter time series data are displayed on the time axis in the middle and lower part, and the time axis in the second time axis (e.g. Fig. 9 The time axis in the upper middle part) displays the time mark of the event of interest represented by the second marked timing data.

[0088] In some embodiments, based on the first labeled brain function parameter timing data, a brain function parameter timing curve in the time domain is displayed on the first time axis, and the time mark of the event of interest represented by the first labeled brain function parameter timing data is displayed in a first manner, and the time mark of the event of interest not represented in the first labeled brain function parameter timing data but represented by the second labeled timing data is displayed in a second manner different from the first manner.

[0089] The examples described in this application can be implemented at least in part by a machine or computer. In some embodiments, the present application also provides a computer-readable storage medium, on which a computer program instruction is stored, and the computer program instruction performs the following processing when executed by a processor. Obtain each first marked brain function parameter timing data from each signal acquisition module 200, and each second marked timing data from the marking device 101. Among them, each second marking timing data is obtained by sampling each marking trigger signal from the input device 102 by the marking device 101 at a second sampling rate higher than the first sampling rate, and contains relevant time information of each event of interest. The brain function parameter timing data in the time domain and the timing mark of the event of interest represented by the first marking brain function parameter timing data are displayed on the display 303, and the second marking timing data is saved. Alternatively, the brain function parameter timing data in the time domain, as well as the timing mark of the event of interest represented by the first marking brain function parameter timing data and the second marking timing data are displayed on the display 303.

[0090] In the hyperscanning scenario, in addition to the first labeled brain function parameter timing data from each signal acquisition module 200, the above processing can also obtain the second labeled timing data containing the relevant time information of each event of interest. Therefore, the second labeled timing data and the first labeled brain function parameter timing data can be summarized and combined for display and comparative analysis. In this way, it is possible to detect the events of interest of each subject whose occurrence time difference is less than the threshold, that is, it is possible to detect the events of interest whose occurrence time difference is less than the threshold that cannot be detected together at the first sampling rate of the signal acquisition module 200 itself, and comprehensively mark them, thereby significantly reducing or even eliminating the missed and lost labels at the first sampling rate in the hyperscanning scenario. Therefore, the differences in changes in neural activity among different subjects can be more accurately evaluated.

[0091] This application describes various operations or functions that may be implemented as software codes or instructions or defined as software codes or instructions. Such content may be source code or differential code ("incremental" or "patch" code) that can be directly executed ("object" or "executable" form). Software codes or instructions may be stored in a computer-readable storage medium, and when executed, may cause a machine to perform the described functions or operations, and include any mechanism for storing information in a form accessible to a machine (e.g., a computing device, an electronic system, etc.), such as recordable or non-recordable media (e.g., read-only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, etc.).

[0092] The implementation of such computer program instructions may include software codes, such as microcode, assembly language code, high-level language code, etc. Various software programming techniques may be used to create various programs or program modules. For example, a program portion or program module may be designed with or by means of Java, Python, C, C++, assembly language, or any known programming language. One or more of such software portions or modules may be integrated into a computer system and / or a computer-readable medium. Such software codes may include computer-readable instructions for performing various methods. The software code may form a part of a computer program product or a computer program module. In addition, in an example, the software code may be tangibly stored on one or more volatile, non-temporary or non-volatile tangible computer-readable media, such as during execution or at other times. Examples of these tangible computer-readable media may include, but are not limited to, hard disks, removable disks, removable optical disks (such as optical disks and digital video disks), cassettes, memory cards or memory sticks, random access memories (RAMs), read-only memories (ROMs), etc.

[0093] It is understandable that the processor 301 is a processing device including one or more general-purpose processing devices (such as a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), etc.). More specifically, the processor 301 can be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor running other instruction sets, or a processor running a combination of instruction sets. The processor 301 can also be one or more special-purpose processing devices, such as an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), a system on a chip (SoC), etc.

[0094] In some embodiments, the processor 301 may be a dedicated processor rather than a general purpose processor. The processor 301 may execute a sequence of computer program instructions stored in the storage module 304 to perform various operations, processes, and steps disclosed in the present application.

[0095] In addition, although exemplary embodiments have been described herein, the scope includes any and all embodiments based on the present application with equivalent elements, modifications, omissions, combinations (e.g., various embodiments intersecting schemes), adaptations or changes. The elements in the claims will be interpreted broadly based on the language adopted in the claims, and are not limited to the examples described in this specification or during the implementation of the application, and the examples will be interpreted as non-exclusive. Therefore, this specification and examples are intended to be considered as examples only, and the true scope and spirit are indicated by the following claims and the full scope of their equivalents.

[0096] The above description is intended to be illustrative rather than restrictive. For example, the above examples (or one or more of them) can be used in combination with each other. For example, those of ordinary skill in the art can use other embodiments when reading the above description. In addition, in the above-mentioned specific embodiments, various features can be grouped together to simplify the application. This should not be interpreted as an intention that a disclosed feature that does not require protection is necessary for any claim. On the contrary, the subject matter of the present application may be less than all the features of a specific disclosed embodiment. Thus, the claims are incorporated into the specific embodiments as examples or embodiments, wherein each claim is independently used as a separate embodiment, and it is considered that these embodiments can be combined with each other in various combinations or arrangements. The scope of the present application should be determined with reference to the full scope of the equivalent forms of the attached claims and these claims.

[0097] The above embodiments are only exemplary embodiments of the present application and are not intended to limit the present application. The protection scope of the present application is defined by the claims. Those skilled in the art may make various modifications or equivalent substitutions to the present application within the essence and protection scope of the present application, and such modifications or equivalent substitutions shall also be deemed to fall within the protection scope of the present application.

Claims

1. A marking system for superscanning of brain functional imaging modalities, characterized in that: The marking system is used in coordination with several signal acquisition modules and processing devices of the brain function imaging modality, and the several signal acquisition modules all work at a first sampling rate to respectively acquire brain function parameter time series data corresponding to several subjects to achieve super scanning. The marking system includes an input device and a marking device. The input device is configured to: transmit a marking trigger signal to the marking device in response to each marking trigger operation, wherein each marking trigger operation is associated with an event of interest; The marking device is configured as follows: Based on each marking trigger signal, a marking electrical signal is generated and transmitted to each signal acquisition module respectively, so as to generate first marking brain function parameter time series data corresponding to each signal acquisition module respectively; The marking trigger signal is sampled at a second sampling rate higher than the first sampling rate to obtain second marking timing data. In a hyperscanning scenario, when the occurrence time difference of the respective events of interest corresponding to the subjects is less than a threshold, the second marking timing data includes relevant time information of each event of interest. Among them, the first marked brain function parameter timing data from each signal acquisition module and the second marked timing data from the marking device are used to be transmitted to the processing device for display or analysis.

2. The marking system according to claim 1, characterized in that: The brain functional imaging modality includes at least one of near infrared brain functional imaging fNIRS, electroencephalogram and magnetoencephalogram.

3. The marking system according to claim 1, characterized in that: The input device includes a plurality of operating parts and is wiredly connected to or integrated with the marking device to receive a marking trigger operation made by an operator in response to the event of interest; or, Each marking trigger operation is automatically triggered by the occurrence of the corresponding event of interest, or; The occurrence time of each event of interest is preset, and each marking trigger operation is automatically triggered at the preset occurrence time of each event of interest.

4. The marking system according to any one of claims 1 to 3, characterized in that: In the hyperscanning scenario, the events of interest corresponding to each subject include at least one of the following: each subject's behavior in response to the same prompt event, each subject's behavior in response to sequential prompt events, the same or sequential prompt events issued by the processing device to the subject, or interference events from the external environment.

5. The marking system according to any one of claims 1 to 3, characterized in that: The threshold is configured such that two events of interest whose time difference is smaller than the threshold cannot be collected and detected together at the first sampling rate.

6. The marking system according to claim 1, characterized in that: The marking trigger signal includes a marking trigger level signal, and the marking device is further configured to: based on each marking trigger level signal, generate a marking electrical signal containing a pulse amplitude, respectively, to transmit to each signal acquisition module.

7. The marking system according to claim 3, characterized in that: The plurality of operating parts include a plurality of buttons, each button having a set association with a respective type of event of interest, The input device is further configured to: receive a marking trigger operation of each key by an operator, and transmit a marking trigger signal representing the event type and the trigger operation time to the marking device; The marking device is further configured to generate, based on each marking trigger signal, each marking electrical signal including information on the type of event of interest and the trigger operation time.

8. The marking system according to claim 1, characterized in that: The marking device is further configured to: be communicatively connected to the processing device; encode the time information of each marking trigger operation and the type information of the corresponding event of interest in the second marking timing data; The processing device is further configured to: receive the second marking timing data, decode to obtain time information of each marking triggering operation as time information of each event of interest that occurs, and decode to obtain a type of each event of interest.

9. The marking system according to claim 1, characterized in that: The marking device is further configured as follows: Pre-perform clock synchronization processing with each of the signal acquisition modules and the processing device; and / or Transmitting a timestamp to each signal acquisition module and the processing device, or receiving a timestamp from each signal acquisition module and the processing device.

10. The marking system according to claim 1, characterized in that: The input device is further configured to: transmit a preset marking trigger signal to the marking device in response to a set of preset marking trigger operations; The marking device is further configured to: based on the preset marking trigger signal, generate a preset marking electrical signal and transmit it to each signal acquisition module respectively, so as to generate each preset first marking brain function parameter timing data, wherein the time difference of each preset marking trigger operation in a set of preset marking trigger operations is greater than the threshold value, so that it can be fully detected by each of the signal acquisition modules; sample the preset marking trigger signal at a second sampling rate to obtain the preset second marking timing data; Among them, each preset first marking brain function parameter timing data and each preset second marking timing data are used to be transmitted to the processing device to perform the timing alignment of each preset marking trigger operation.

11. A marking device for superscanning of brain functional imaging modality, characterized in that: The marking device can be used in conjunction with a plurality of signal acquisition modules and a processing device of the brain function imaging modality, wherein the plurality of signal acquisition modules all work at a first sampling rate to respectively acquire brain function parameter time series data corresponding to a plurality of subjects to achieve superscanning. The marking device is wired to the input device or includes the input device and is configured as follows: Based on the marking trigger signal associated with the event of interest from the input device, generating a marking electrical signal and transmitting the signal to each signal acquisition module respectively; and The marking trigger signal is sampled at a second sampling rate higher than the first sampling rate to obtain and output second marking timing data. In a super-scanning scenario, when the time difference between the occurrence events of interest corresponding to each subject is less than a threshold, the second marking timing data contains relevant time information of each event of interest.

12. The marking device according to claim 11, characterized in that: In the hyperscanning scenario, the events of interest corresponding to each subject include at least one of the following: each subject's behavior in response to the same prompt event, each subject's behavior in response to sequential prompt events, the same or sequential prompt events issued by the processing device to the subject, or interference events from the external environment.

13. The marking device according to claim 11, characterized in that: The threshold is configured such that two events of interest whose time difference is smaller than the threshold cannot be collected and detected together at the first sampling rate.

14. The marking device according to any one of claims 11 to 13, characterized in that: The marking trigger signal includes a marking trigger level signal, and the marking device is further configured to: generate a marking electrical signal including a pulsed amplitude based on each marking trigger level signal.

15. The marking device according to any one of claims 11 to 13, characterized in that: The marking device is further configured to generate, based on each marking trigger signal, each marking electrical signal including trigger operation time and event type information of interest.

16. The marking device according to any one of claims 11 to 13, characterized in that: The marking device is further configured as follows: Preliminarily performing clock synchronization processing with each of the signal acquisition modules and the processing device; Transmitting a timestamp to each signal acquisition module and processing device, or receiving a timestamp from each signal acquisition module and processing device.

17. A processing device for superscanning of brain functional imaging modality, characterized in that: The processing device can be used in conjunction with a plurality of signal acquisition modules and a marking device of the brain function imaging modality, wherein the plurality of signal acquisition modules all work at a first sampling rate to respectively acquire time series data of brain function parameters corresponding to a plurality of subjects to achieve superscanning, The processing device comprises a communication interface and a processor, The communication interface is configured to: obtain each first marked brain function parameter time series data from each of the signal acquisition modules, and each second marked time series data from the marking device, wherein each second marked time series data is obtained by the marking device sampling each marking trigger signal from the input device at a second sampling rate higher than the first sampling rate, and includes relevant time information of each event of interest; and The processor is configured to display the brain function parameter time series data of each subject and the timing marks of each event of interest on the display based on the first marked brain function parameter time series data and the second marked time series data.

18. The processing device according to claim 17, characterized in that The processing device is further configured to: perform timing alignment of each preset marking trigger operation based on each preset first marking brain function parameter timing data from each signal acquisition module and the preset second marking timing data from the marking device, Among them, each preset first marking brain function parameter timing data is obtained by sampling the preset marking electrical signal from the marking device at the first sampling rate by each signal acquisition module, and the preset second marking timing data is obtained by sampling the preset marking trigger signal from the input device by the marking device at a second sampling rate higher than the first sampling rate. The preset marking trigger signal is generated by the input device in response to a set of preset marking trigger operations, and the preset marking electrical signal is generated by the marking device based on the preset marking trigger signal. The time difference of each preset marking trigger operation in a set of preset marking trigger operations is greater than a threshold, so that it can be fully collected and detected by each of the signal acquisition modules.

19. A computer-readable storage medium, characterized in that: The computer readable storage medium stores a computer program, which, when executed by a processor, performs: Acquire each first marked brain function parameter time series data from each signal acquisition module, and each second marked time series data from the marking device, wherein each second marked time series data is obtained by the marking device sampling each marking trigger signal from the input device at a second sampling rate higher than the first sampling rate, and includes relevant time information of each event of interest; Display the brain function parameter timing data in the time domain and the timing marks of the events of interest represented by the first marked brain function parameter timing data on a display, and save the second marked timing data, or display the brain function parameter timing data in the time domain on a display, and the timing marks of the events of interest represented by the first marked brain function parameter timing data and the second marked timing data respectively.

Images