Nuclear magnetic photoelectric multimodal synchronous brain imaging system

Abstract

This application discloses a multimodal synchronous brain imaging system based on nuclear magnetic resonance-optical-electrical signals, relating to the field of brain imaging technology. The system includes: a PET-MR device, an EEG device, a detector headgear, and an eye tracker. The PET-MR device is an integrated device of a PET device and an MR device. The EEG device includes an EEG receiver and EEG electrodes. The detector headgear includes an NIRS detector and EEG electrodes. The PET-MR device is used for positron emission tomography (PET) and magnetic resonance imaging (MRI). The detector headgear is used to acquire EEG signals and blood flow infrared signals. The eye tracker is used to acquire eye movement trajectories. The PET device, eye tracker, NIRS detector, and EEG device synchronously acquire multimodal data based on a synchronization signal provided by a clock source within the MR device. This application improves the comprehensiveness and accuracy of brain imaging.

Description

Technical Field

[0001] This application relates to the field of brain imaging technology, and in particular to a nuclear magnetic resonance-photoelectric multimodal synchronous brain imaging system. Background Technology

[0002] One of the more mature technologies in multimodal brain imaging systems is the positron emission tomography (PET) / magnetic resonance (MR) system. This system organically combines PET and MR technologies, enabling the simultaneous acquisition of image information from both modalities. PET provides molecular-level information about metabolic activities in the body, while MR generates detailed soft tissue images through magnetic fields and radio waves. Compared to PET / CT, PET / MR offers greater safety and demonstrates unique advantages in brain applications such as brain tumor localization, early diagnosis of neurodegenerative diseases, and localization of brain functional areas. PET / MR provides high-resolution images of neural structures and molecular-level metabolic information, greatly facilitating the diagnosis and research of neurological diseases.

[0003] Electroencephalography (EEG) devices are used to record the brain's electrical activity, offering extremely high temporal resolution and enabling real-time monitoring of changes in brain signals. However, EEG has relatively low spatial resolution and is susceptible to external electrical interference. Near-infrared spectroscopy (NIRS) devices measure changes in blood oxygenation and flow in the cerebral cortex; they are non-invasive and suitable for long-term monitoring, but due to limited penetration, they can only detect superficial brain tissue. Currently, several standalone EEG and NIRS devices exist on the market, but systems combining them are rare, and they are typically manufactured by different companies, posing challenges to device integration.

[0004] While each modal technology plays a role in its respective application area, a more comprehensive approach to monitoring brain function and structure is needed to improve the accuracy of brain function detection. Summary of the Invention

[0005] The purpose of this application is to provide a nuclear magnetic resonance photoelectric multimodal synchronous brain imaging system that can realize the synchronous acquisition of five modal information, thereby improving the comprehensiveness and accuracy of brain imaging.

[0006] To achieve the above objectives, this application provides the following solution:

[0007] In a first aspect, this application provides a simultaneous nuclear magnetic resonance-optoelectronic multimodal brain imaging system, which includes: a PET-MR device, an EEG device, a detector headgear, and an eye tracker. The PET-MR device is an integrated device of a PET device and an MR device. The EEG device includes an EEG receiver and EEG electrodes. The detector headgear includes an NIRS detector and the EEG electrodes. The PET-MR device is used for positron emission tomography (PET) and magnetic resonance imaging. The detector headgear is used to acquire electroencephalogram (EEG) signals and blood flow infrared signals. The eye tracker is used to acquire eye movement trajectories.

[0008] The PET device, the eye tracker, the NIRS detector, and the EEG device perform multimodal data synchronous acquisition based on the synchronization signal provided by the clock source in the MR device.

[0009] Optionally, the nuclear magnetic resonance photoelectric multimodal synchronous brain imaging system further includes an EEG box and an EEG support. The EEG box is mounted on the EEG support and is used to support and fix the EEG receiving device. The EEG box and the EEG support are fixed in the head direction of the examination bed, which is the examination bed of the PET-MR device.

[0010] Optionally, the nuclear magnetic resonance-optical-electrical multimodal synchronous brain imaging system further includes a head coil for fixing the eye tracker, and the head coil is a 64-bit head coil.

[0011] Optionally, the NIRS detector includes NIRS probes and NIRS light sources, and a plurality of NIRS probes, a plurality of NIRS light sources and a plurality of EEG electrodes are distributed on the detector head according to a predetermined distribution position.

[0012] Optionally, the nuclear magnetic resonance photoelectric multimodal synchronous brain imaging system further includes a near-infrared fiber and a near-infrared support. The near-infrared support is used to fix the near-infrared fiber. One end of the near-infrared fiber is connected to the NIRS probe, and the other end is connected to the NIRS light source.

[0013] Optionally, the NIRS detector further includes an EEG channel and an NIRS channel, wherein the EEG channel is used to transmit signals acquired by the EEG electrode, and the NIRS channel is used to transmit signals acquired by the NIRS probe.

[0014] Optionally, the nuclear magnetic resonance-optical-electrical multimodal synchronous brain imaging system further includes a first conversion module and a second conversion module connected in sequence. The first conversion module is connected to the MR device. The first conversion module is used to extract the clock signal of the clock source and convert the clock signal into a TTL signal. The conversion module is used to convert the real-time received TTL signal into a DB25 interface signal and transmit the DB25 interface signal as the synchronization signal to the PET device, the eye tracker, the NIRS detector, and the EEG device through the DB25 interface.

[0015] Optionally, the nuclear magnetic resonance-optical-electrical multimodal synchronous brain imaging system further includes a DB25 distributor. The input end of the DB25 distributor is connected to the DB25 interface of the second conversion module, and the output end of the DB25 distributor is connected to the PET device, the eye tracker, the NIRS detector, and the EEG device, respectively.

[0016] Optionally, the first conversion module extracts the clock signal at a frequency of once every 0.1ms.

[0017] Optionally, the nuclear magnetic resonance-optical-electric multimodal synchronous brain imaging system further includes an imaging platform, which is connected to the PET-MR device, the EEG device, the detector headgear, and the eye tracker, respectively. The imaging platform is used to receive synchronously acquired multimodal data.

[0018] According to the specific embodiments provided in this application, the following technical effects are disclosed:

[0019] This application provides a multimodal synchronous brain imaging system based on nuclear magnetic resonance photoelectric imaging. The system integrates EEG and near-infrared imaging using a detector headgear. The PET-MR device, detector headgear, and eye tracker enable the acquisition of five modalities. Synchronous acquisition of the five modalities is achieved based on the synchronization signal provided by the clock source within the MR device, thereby improving the comprehensiveness and accuracy of brain imaging. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 This is a schematic diagram of the structure of a multimodal synchronous brain imaging system based on nuclear magnetic resonance photoelectric imaging, provided in one embodiment of this application.

[0022] Figure 2This is a top view of the detector headgear and eye tracker provided in an embodiment of this application.

[0023] Figure 3 This is a schematic diagram showing the distribution of EEG electrodes and NIRS detectors on a detector head according to an embodiment of this application.

[0024] Figure 4 This is a schematic diagram of the EEG channel and NIRS channel distribution provided in an embodiment of this application.

[0025] Figure 5 This is a schematic diagram of the detector headgear provided in one embodiment of this application.

[0026] Figure 6 This is a schematic diagram illustrating the principle of synchronous acquisition of five modes provided in one embodiment of this application.

[0027] Figure reference numerals: 1-MR device, 2-PET device, 3-EEG box, 4-EEG support, 5-Eye tracker, 6-Head coil, 7-Detector headgear, 8-Near-infrared fiber optic cable, 9-Near-infrared support, 10-NIRS probe, 11-EEG electrode, 12-NIRS light source, 13-EEG channel, 14-NIRS channel. Detailed Implementation

[0028] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0029] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0030] This application provides a nuclear magnetic resonance-optical-electrical multimodal synchronous brain imaging system, such as... Figure 1 and Figure 2 As shown, the nuclear magnetic resonance-optical-electric multimodal synchronous brain imaging system includes: a PET-MR device, an EEG device, a detector headgear 7, and an eye tracker 5. The PET-MR device is an integrated device of PET device 2 and MR device 1. The EEG device includes an EEG receiver and EEG electrodes 11. The detector headgear 7 includes an NIRS detector and the EEG electrodes 11. The PET-MR device is used for positron emission tomography (PET) and magnetic resonance imaging. The detector headgear 7 is used to acquire electroencephalogram (EEG) signals and blood flow infrared signals. The eye tracker 5 is used to acquire eye movement tracks (EyeTrack, ET).

[0031] The PET device 2, the eye tracker 5, the NIRS detector, and the EEG device perform multimodal data synchronous acquisition based on the synchronization signal provided by the clock source in the MR device 1.

[0032] The nuclear magnetic resonance photoelectric multimodal synchronous brain imaging system also includes an EEG box 3 and an EEG support 4. The EEG box 3 is mounted on the EEG support 4 and is used to support and fix the EEG receiving device. The EEG box 3 and the EEG support 4 are fixed in the head direction of the examination bed, which is the examination bed of the PET-MR device.

[0033] The nuclear magnetic resonance-optical-electrical multimodal synchronous brain imaging system also includes a head coil 6, which is used to fix the eye tracker 5. The head coil 6 is a 64-bit head coil, and the eye tracker 5 is used to acquire and record the eye movement trajectory in real time. The eye tracker 5 is connected to an integrated PET-MR device.

[0034] Regarding electromagnetic interference (EMI) issues, the power supply in this application's MRI-photoelectric multimodal synchronous brain imaging system requires filtering before supplying power to various components. This design primarily considers the EMI of Magnetic Resonance Imaging (MRI) signals, preventing power supply interference from causing image artifacts. MR device 1 is used to acquire MRI signals. Because the ET monitoring camera is mounted on a 64-channel head coil, its power supply unit is mainly located on the system's peripheral adapter to facilitate installation on the coil and ensure its miniaturization. The PET device also has an independent power supply, again considering EMI issues to prevent the PET device's power supply from interfering with MRI signal acquisition and the signal acquisition of other peripheral components (independent power supply to avoid signal crosstalk).

[0035] This application aims to reduce signal interference based on the above considerations. Furthermore, the EEG device, eye tracker, and NIRS detector need to be able to operate normally, stably, and reliably in electromagnetic and ionizing environments, and have a certain lifespan. The EEG device, eye tracker, and NIRS detector transmit the acquired signals to their respective front-end data processing units for data processing to reduce signal interference (independent signal transmission to avoid crosstalk).

[0036] The acquired MRI signals, EEG, and NIRS information are uploaded to the MRI reconstruction computer for reconstruction. Eye-tracking images acquired by the eye tracker are uploaded to the image processing computer for eye position calculation. The control console can retrieve data or images from different subsystems for analysis and processing.

[0037] The electronic clock signals of PET and EEG equipment have frequencies very close to those of MRI signals. In the design process of the equipment in this application, the system clock frequency will be precisely controlled to avoid signal crosstalk.

[0038] This detector headgear 7 is actually an integrated EEG / NIRS detector headgear. Both EEG and NIRS are non-invasive data acquisition methods and can be made into wearable integrated headgear. They operate on different principles and are affected differently by magnetic fields. Compared to EEG, NIRS has strong resistance to electromagnetic interference (such as electrooculography, electromyography, power line interference, and ambient electromagnetic interference), and its signal is more stable. The headgear designed in this application reduces signal interference based on the diameter and spacing of the NIRS probe and EEG electrodes.

[0039] The head coil 6 is used to acquire MRI data. The 64-channel MRI coil has a higher resolution, which greatly improves the imaging time and spatial resolution.

[0040] Traditional head MRI uses 8-32 channels. By using a specially customized 64-channel head coil and developing multi-slice acceleration support technology, gapless multi-slice scanning and whole-brain coverage can be achieved, while simultaneously obtaining high-resolution MRI images. The higher-resolution 64-channel MRI head coil will support up to 7 times the multi-slice acceleration factor, achieving gapless whole-brain coverage. Compared to traditional non-multi-slice acceleration scanning equipment, the temporal resolution decreases from 2s to 0.5s, and the spatial resolution decreases from 0.5-1.0mm to 0.2mm.

[0041] like Figure 3 As shown, the NIRS detector includes NIRS probes 10 and NIRS light sources 12. Multiple NIRS probes 10, multiple NIRS light sources 12 and multiple EEG electrodes 11 are distributed on the detector head cover 7 according to a set distribution position.

[0042] The NMR-optical-electrical multimodal synchronous brain imaging system also includes a near-infrared fiber 8 and a near-infrared support 9. The near-infrared support 9 is used to fix the near-infrared fiber 8. One end of the near-infrared fiber 8 is connected to the NIRS probe 10, and the other end is connected to the NIRS light source 12. Through precise fiber positioning and a stable near-infrared support 9 design, the NIRS device can provide high-quality spectral data. The overall design adopts a modular and compact layout, achieving seamless integration of multiple imaging technologies to improve the overall system efficiency and user experience.

[0043] like Figure 4 As shown, the NIRS detector also includes an EEG channel 13 and an NIRS channel 14. The EEG channel 13 is used to transmit signals acquired by the EEG electrode 11, and the NIRS channel 14 is used to transmit signals acquired by the NIRS probe 10.

[0044] The detector headgear 7 integrates the NIRS detector and EEG electrodes 11 into a wearable, integrated headgear, increasing the device's usability and enhancing its spatial localization and analysis capabilities for EEG and blood flow infrared signals. Therefore, based on the diameter and spacing of the NIRS probe 10 and EEG electrodes 11, this application designs a detector headgear 7 capable of simultaneously acquiring EEG and NIRS data, ensuring optimal layout of the two sensors. This allows for the simultaneous acquisition of neural activity information from different dimensions within the same brain region. The detector headgear 7 is worn by the test subject's head... Figure 5 As shown.

[0045] The nuclear magnetic resonance-photoelectric multimodal synchronous brain imaging system further includes a first conversion module and a second conversion module connected in sequence. The first conversion module is connected to the MR device. The first conversion module is used to extract the clock signal from the clock source and convert the clock signal into a transistor-transistor logic (TTL) signal. The conversion module is used to convert the real-time received TTL signal into a DB25 interface signal and transmit the DB25 interface signal as the synchronization signal through the DB25 interface to the PET device, the eye tracker, the NIRS detector, and the EEG device. The synchronization principle is as follows: Figure 6 As shown, this synchronization method enables the synchronous initiation of the data acquisition process under the same time reference, ensuring time alignment of data from different modalities.

[0046] TTL signals have strong anti-interference capabilities and high transmission speeds, making them suitable for transmission in complex electronic systems. The DB25 interface is a widely used multi-pin interface capable of supporting synchronous transmission of multi-channel signals. In the DB25 interface, clock signals are assigned to specific pins to ensure signal integrity and transmission reliability. Synchronization signals from the DB25 interface are distributed to other imaging devices (such as PET scanners, EEG scanners, NIRS devices, and eye trackers), which receive these synchronization signals to adjust their data acquisition start-up time.

[0047] The nuclear magnetic resonance-optical-electric multimodal synchronous brain imaging system also includes a DB25 distributor. The input end of the DB25 distributor is connected to the DB25 interface of the second conversion module, and the output end of the DB25 distributor is connected to the PET device, the eye tracker, the NIRS detector, and the EEG device, respectively.

[0048] The first conversion module extracts the clock signal at a frequency of once every 0.1ms.

[0049] The nuclear magnetic resonance-optical-electric multimodal synchronous brain imaging system also includes an imaging platform, which is connected to the PET-MR device, the EEG device, the detector headgear, and the eye tracker. The imaging platform is used to receive synchronously acquired multimodal data and fuse the synchronously acquired multimodal data to achieve high-quality brain imaging.

[0050] This application integrates multiple modalities into one imaging platform, improving the system's operational efficiency and the accuracy of data acquisition.

[0051] In one exemplary embodiment, a real-time synchronous acquisition method based on a nuclear magnetic resonance-optical-electrical multimodal synchronous brain imaging system includes the following steps.

[0052] Step 1: Start the system to input the radio frequency signal of the MR device into the Coincidence Control Board (CCB) of the PET device and record it into the raw data of the PET device. Similarly, the trigger information of the physiological signal is simultaneously input into the raw data of the MR device and the PET device to achieve simultaneous imaging of the MR device and the PET device with sub-millisecond high temporal accuracy.

[0053] Step 2: Simultaneously, in this application system, the timestamps of the ET control system, NIRS control system and EEG control system are used to automatically synchronize with the CCB clock every 0.1ms, thereby achieving simultaneous imaging of all modes with a time synchronization accuracy of 0.1ms.

[0054] Step 3: By using the developed multimodal imaging fusion and post-processing software, integrate different forms of information and / or images (such as PET molecular functional images, MRI brain structural functional images, EEG electrical activity information and ET eye movement information, etc.) from PET, MRI, EEG, ET and NIRS to obtain high-quality and efficient integrated and synchronous acquisition results of PET, MR, EEG, NIRS and ET five modalities that are precisely synchronized in time and spatially.

[0055] This application develops an integrated EEG / NIRS detector headgear and a dedicated near-infrared probe for MR imaging; it achieves breakthroughs in precise timing control and clock synchronization in highly heterogeneous multimodal imaging systems, ensuring accurate integration of multimodal information; it combines the advantages of each modality for joint reconstruction, improving image spatial and temporal resolution; and it develops supporting post-processing software to achieve organic fusion of multimodal images. This application realizes the integrated fusion of five advanced technologies, precise data synchronization, real-time fusion of multimodal data, reduced system complexity, and optimized user interface. This enables the system to acquire multidimensional brain activity information in a single scan, including comprehensive data on molecular targets, neural structures, neural discharges, pupillary movements, and microcirculation, significantly improving the comprehensiveness, accuracy, and timeliness of brain imaging. This breakthrough technology not only provides a powerful tool for the early diagnosis, precision treatment, and prognostic assessment of brain diseases, but also opens up new possibilities for neuroscience research, cognitive science exploration, and brain-computer interface development, and is expected to drive significant progress in brain science research and clinical applications.

[0056] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0057] This document uses specific examples to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the methods and core ideas of this application. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A nuclear magnetic-optical multi-modal simultaneous brain imaging system, characterized in that, The nuclear magnetic photoelectric multi-modal synchronous brain imaging system comprises a PET-MR device, an EEG device, a detector head cover and an eye tracker, the PET-MR device is an integrated device of a PET device and a MR device, the EEG device comprises an EEG receiving device and an EEG electrode, the detector head cover comprises a NIRS detector and the EEG electrode, the PET-MR device is used for positron emission tomography and magnetic resonance imaging, the detector head cover is used for collecting electroencephalogram signals and blood flow infrared signals, and the eye tracker is used for collecting eye movement trajectories. The PET device, the eye tracker, the NIRS detector and the EEG device perform multi-modal data synchronous collection according to a synchronization signal provided by a clock source in the MR device; the NIRS detector comprises a NIRS probe and a NIRS light source, a plurality of the NIRS probes, a plurality of the NIRS light sources and a plurality of the EEG electrodes are distributed on the detector head cover according to set distribution positions; wherein, according to diameters and spacings of the NIRS probes and the EEG electrodes, the detector head cover capable of simultaneously performing EEG and NIRS data collection is designed; The nuclear magnetic photoelectric multi-modal synchronous brain imaging system further comprises a head coil, the head coil is used for fixing the eye tracker, and the head coil is a 64-bit head coil; the nuclear magnetic photoelectric multi-modal synchronous brain imaging system further comprises a near-infrared optical fiber and a near-infrared support, the near-infrared support is used for fixing the near-infrared optical fiber, one end of the near-infrared optical fiber is connected with the NIRS probe, and the other end is connected with the NIRS light source; the nuclear magnetic photoelectric multi-modal synchronous brain imaging system further comprises a first conversion module and a second conversion module connected in sequence, the first conversion module is connected with the MR device, the first conversion module is used for extracting a clock signal of the clock source, converting the clock signal into a TTL signal, the second conversion module is used for converting the TTL signal received in real time into a DB25 interface signal, and transmitting the DB25 interface signal as the synchronization signal to the PET device, the eye tracker, the NIRS detector and the EEG device through a DB25 interface. The first conversion module extracts the frequency of the clock signal every 0.1 ms; the nuclear magnetic photoelectric multi-modal synchronous brain imaging system inputs the radio frequency signal of the MR device into the CCB of the PET device when starting, and records the original data of the PET device, and simultaneously inputs the trigger information of the physiological signal into the original data of the MR device and the PET device; through the time stamps of the ET control system, the NIRS control system and the EEG control system, every 0.1 ms is automatically clock-synchronized with the CCB; through the developed multi-modal imaging fusion and post-processing software, different forms of information and / or images of PET, MRI, EEG, ET and NIRS are integrated, and high-quality and efficient time-accurately synchronized and spatially-accurately fused PET, MR, EEG, NIRS and ET five-modal integrated and synchronous acquisition results are obtained.

2. The nuclear magnetic photoelectric multimodality synchronous brain imaging system according to claim 1, characterized in that, The nuclear magnetic photoelectric multi-modal synchronous brain imaging system further comprises an electroencephalogram box and an electroencephalogram support, the electroencephalogram box is arranged on the electroencephalogram support, the electroencephalogram box is used for supporting and fixing the EEG receiving device, and the electroencephalogram box and the electroencephalogram support are fixed in the head direction of the examination bed, and the examination bed is the examination bed of the PET-MR device. 3.The nuclear magnetic photoelectric multimodality synchronous brain imaging system according to claim 1, characterized in that, The NIRS detector further comprises an EEG channel and an NIRS channel, the EEG channel is used for transmitting the signal collected by the EEG electrode, and the NIRS channel is used for transmitting the signal collected by the NIRS probe. 4.The nuclear magnetic photoelectric multimodality synchronous brain imaging system according to claim 1, characterized in that, The nuclear magnetic photoelectric multi-modal synchronous brain imaging system further comprises a DB25 distributor, an input end of the DB25 distributor is connected with a DB25 interface of the second conversion module, and output ends of the DB25 distributor are respectively connected with the PET device, the eye tracker, the NIRS detector and the EEG device.

5. The nuclear magnetic photoelectric multimodality synchronous brain imaging system according to claim 1, wherein, The nuclear magnetic photoelectric multi-modal synchronous brain imaging system further comprises an imaging platform, the imaging platform is connected with the PET-MR device, the EEG device, the detector head cover and the eye tracker, and the imaging platform is used for receiving the multi-modal data collected synchronously.

Images