Multimodal fusion detection device based on optical pumping technology

Abstract

The present invention provides a multimodal fusion detection device based on optical pumping technology, which relates to the field of brain-computer interface. In the device, a laser generating module includes a first laser outlet and a second pulse laser outlet, the first laser outlet is aligned with the first laser inlet of an atomic gas chamber, the second pulse laser outlet is aligned with the path control inlet included in a laser path control module, and the detection port of the atomic gas chamber is aligned with a preset area; the laser path control module also includes a path control outlet, and the path control outlet is aligned with a preset area; the laser receiving port of the photoelectric detection module is aligned with the first laser outlet of the atomic gas chamber; the detection point of the ultrasonic detection module is associated with the preset area; the photoelectric detection module and the ultrasonic detection module are electrically connected to the data processing module respectively. The device can realize multimodal fusion detection at the same position and time through hardware multiplexing, and can also reduce the size of the equipment and try to avoid series disturbance between multimodal sensors.

Description

Technical Field

[0001] The present invention relates to the field of brain-computer interface technology, and in particular to a multimodal fusion detection device based on optical pumping technology. Background Art

[0002] With the progress of neuroscience research and the development of BCI (Brain-Computer Interface) technology, the demand for non-invasive brain-computer interface sensors is growing. These sensors can not only help us deeply understand the complex mechanisms of the brain, but also play an important role in clinical medicine, neurorehabilitation and human-computer interaction. Non-invasive brain-computer interfaces can be divided into two categories according to the type of biological signals detected: electrophysiological signal-dependent sensors and blood oxygen-dependent sensors.

[0003] Electrophysiological signal-dependent sensors mainly capture the electron flow or magnetic field generated by biochemical processes at the cellular level, achieving high temporal resolution at the expense of low spatial resolution, and are suitable for rapid and short-term recording of superficial brain activity. For example, EEG (Electroencephalogram) sensors and MEG (Magnetoencephalography) sensors. Blood oxygen-dependent sensors infer brain activity by monitoring changes in blood oxygen levels in the brain. They have high spatial resolution but high sensing delay, and are suitable for long-term abnormal monitoring. For example, fNIRS (functional near-infrared spectroscopy) sensors and PAI (Photoacoustic Imaging) sensors.

[0004] Currently, OPM-MEG (Optically-Pumped Magnetometers Magnetoencephalography) sensors and PAI sensors have received widespread attention. OPM-MEG technology can be based on the measurement of magnetic fields inside or outside the head. By mathematically modeling these fields, 3D images (called source localization) can be generated to show how the local magnetic field (LMF) changes instantaneously when the brain responds to various experimental scenarios or cognitive needs. PAI technology can use short-pulse lasers to excite tissues and image by detecting ultrasonic signals generated by the photothermal effect. In addition to providing blood sample signals, it can also provide structural and functional information.

[0005] OPM-MEG sensors are considered to have the potential to surpass SQUID-MEG (Superconducting Quantum Interference Device Magnetoencephalography) sensors, which can provide higher quality data, higher coverage uniformity, motion robustness and lower system complexity. PAI sensors are expected to surpass fNIRS sensors, which can provide blood oxygen distribution while achieving deeper three-dimensional imaging of tissues.

[0006] In order to pursue higher temporal and spatial resolution, researchers of non-invasive brain-computer interfaces have chosen the method of multimodal sensor fusion, fusing the data of electrophysiological signal-dependent sensors and blood oxygen-dependent sensors. However, this brings new challenges such as sensor volume, measurement synchronization, measurement co-location, and series disturbance between multimodal sensors.

[0007] Currently, OPM-MEG sensors and PAI sensors are independent devices, which leads to problems such as measurement time asynchrony, position asynchrony, large device size, and series disturbances between multimodal sensors during data fusion of electrophysiological signals and blood oxygen signals. Summary of the invention

[0008] In view of this, the purpose of the present invention is to provide a multimodal fusion detection device based on optical pumping technology, which can realize multimodal fusion detection at the same position and time through hardware multiplexing, while reducing the size of the equipment and avoiding series disturbances between multimodal sensors as much as possible.

[0009] In order to achieve the above purpose, the technical solution adopted by the embodiment of the present invention is as follows:

[0010] In a first aspect, the present invention provides a multimodal fusion detection device based on optical pumping technology, comprising: a laser generating module, a laser path control module, an atomic gas chamber, a photoelectric detection module, an ultrasonic detection module and a data processing module; wherein the laser generating module comprises a first laser outlet and a second pulse laser outlet, the first laser outlet is aligned with a first laser inlet of the atomic gas chamber, the second pulse laser outlet is aligned with a path control inlet included in the laser path control module, and the detection port of the atomic gas chamber is aligned with a preset area; the laser path control module also comprises a path control outlet, the path control outlet is aligned with the preset area; the laser receiving port of the photoelectric detection module is aligned with the first laser outlet of the atomic gas chamber; the detection point of the ultrasonic detection module is associated with the preset area; the photoelectric detection module and the ultrasonic detection module are electrically connected to the data processing module respectively.

[0011] It should be understood that the multimodal fusion detection device provided in the embodiment of the present application has the following beneficial effects:

[0012] Since the first laser output port is aligned with the first laser inlet of the atomic gas chamber, the first laser outlet of the atomic gas chamber is aligned with the laser receiving port of the photoelectric detection module, and the detection port of the atomic gas chamber is aligned with the preset area. In other words, the pulsed laser emitted through the first laser output port will pass through the atomic gas chamber and then be detected by the photoelectric detection module, so that the photoelectric detection module can detect the magnetic field based on the detected signal changes, which is equivalent to being able to realize a brain magnetometer based on optical pumping (for example, OPM-MEG).

[0013] Since the second pulse laser outlet is aligned with the path control inlet, the path control outlet is aligned with the preset area, and the detection point of the ultrasonic detection module is associated with the preset area, that is, the pulse laser emitted through the second pulse laser outlet will pass through the laser path control module and then be emitted to the preset area, and the tissue will generate photoacoustic waves after absorbing the light energy, so that the ultrasonic detection module can realize photoacoustic (PA) detection based on the detected photoacoustic signal changes, which is equivalent to realizing a photoacoustic sensor.

[0014] Moreover, since the detection port of the atomic gas chamber is aligned with the preset area, and the detection point of the ultrasonic detection module is associated with the preset area. That is to say, the pulsed lasers emitted from the first laser outlet and the second pulsed laser outlet can respectively perform magnetic and photoacoustic detection on the same area. Therefore, the present application can realize hardware reuse. In addition, multi-modal fusion detection at the same position and time can be realized through hardware reuse, while the size of the equipment can be reduced, and the series disturbance between multi-modal sensors can be avoided as much as possible.

[0015] In a second aspect, the present invention provides a multimodal fusion detection device based on optical pumping technology, comprising: a laser generating module, used to generate a first laser and a second pulsed laser; a laser path control module, used to configure the irradiation path of the first laser to pass through an atomic gas chamber, and used to configure the irradiation path of the second pulsed laser to point to a preset area; wherein the atomic gas chamber is configured to be associated with the preset area; and a detection module, used to collect the laser intensity and polarization change signal corresponding to the first laser after passing through the atomic gas chamber when the measured part of the object to be measured is associated with the preset area, and to collect the ultrasonic signal corresponding to the second pulsed laser after acting on the measured part; wherein the detection module is also used to determine the physiological signal of the object to be measured based on the laser intensity and polarization change signal and the ultrasonic signal.

[0016] In a third aspect, the present invention provides a multimodal fusion detection device based on optical pumping technology, comprising: a first laser for generating a first laser; a second pulse laser for generating a second pulse laser; a laser path control module for configuring the irradiation path of the first laser to pass through an atomic gas chamber, and for configuring the irradiation path of the second pulse laser to point to a preset area; wherein the atomic gas chamber is configured to be associated with the preset area; and a detection module for collecting a laser intensity and polarization change signal corresponding to the first laser after passing through the atomic gas chamber when a measured part of the measured object is associated with the preset area, and collecting an ultrasonic signal corresponding to the second pulse laser after acting on the measured part; wherein the detection module is also used to determine the physiological signal of the measured object based on the laser intensity and polarization change signal and the ultrasonic signal.

[0017] In a fourth aspect, the present invention provides a multimodal fusion detection device based on optical pumping technology, comprising: a third pulse laser, used to generate a third pulse laser; a spectrometer, used to process the third pulse laser into a first laser and a second pulse laser; a laser path control module, used to configure the irradiation path of the first laser to pass through an atomic gas chamber, and used to configure the irradiation path of the second pulse laser to point to a preset area; wherein the atomic gas chamber is configured to be associated with the preset area; and a detection module, used to collect the laser intensity and polarization change signal corresponding to the first laser after passing through the atomic gas chamber when the measured part of the object to be measured is associated with the preset area, and to collect the ultrasonic signal corresponding to the second pulse laser after acting on the measured part; wherein the detection module is also used to determine the physiological signal of the object to be measured based on the laser intensity and polarization change signal and the ultrasonic signal.

[0018] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the embodiments of the present invention are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments of the present invention are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 A schematic diagram of the structure of a multi-modal fusion detection device based on optical pumping technology provided in an embodiment of the present invention;

[0021] Figure 2 Another structural schematic diagram of a multi-modal fusion detection device based on optical pumping technology provided in an embodiment of the present invention;

[0022] Figure 3 Another structural schematic diagram of a multimodal fusion detection device based on optical pumping technology provided in an embodiment of the present invention.

[0023] Marking Description:

[0024] 11-laser generation module; 12-laser path control module; 13-atomic gas chamber; 14-photoelectric detection module; 15-ultrasonic detection module; 16-data processing module; 21-first laser output port; 22-second pulse laser output port; 23-first laser input port; 24-path control input port; 25-path control output port; 26-first laser output port; 27-detection port; 28-laser receiving port; 29-detection point; 40-preset area;

[0025] 100-multimodal fusion detection device; 110-pulse laser; 111-filter; 112-focusing lens; 113-beam hole; 114-focusing lens; 115-beam splitter; 116-beam splitter; 120-refractive lens; 121-collimating lens; 130-atomic gas chamber; 140-balanced photodetector; 141-beam splitter; 142-photoelectric detection port; 143-photoelectric detection port; 150-signal amplifier; 151-ultrasonic transducer; 153-reference photoelectric detection port; 160-data acquisition equipment; 170-fiber coupler; 171-optical amplifier; 172-diffuser;

[0026] 200-multimodal fusion detection device; 210-second pulse laser; 211-filter; 212-focusing lens; 213-beam hole; 214-focusing lens; 215-first laser; 216-filter; 217-focusing lens; 218-beam hole; 219-focusing lens; 220-refractive lens; 230-atomic gas chamber; 240-balanced photodetector; 241-splitter; 242-photoelectric detection port; 243-photoelectric detection port; 250-signal amplifier; 251-ultrasonic transducer; 253-splitter; 254-reference photoelectric detection port; 260-data acquisition equipment; 270-fiber coupler; 271-optical amplifier; 272-diffuser. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.

[0028] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0030] It should be noted that, in the absence of conflict, the features in the embodiments of the present invention may be combined with each other.

[0031] In the process of implementing the embodiments of the present application, the inventors found that in the prior art, although there are already many projects for EEG, fNIRS, and PAI, the combination of several completely discrete detectors brings several major challenges:

[0032] 1. Synchronicity of position:

[0033] In the application of multimodal brain-computer interfaces, traditional devices such as EEG and fNIRS use wearable soft hats to collect data. However, due to the essential differences in the physical structure and functional principles of these two devices, it is difficult for them to share sensors or measurement points in the same setting. The bulky fNIRS optical fiber and EEG cables and electrodes compete for head space, and there are mechanical challenges in coupling the EEG electrodes and fNIRS sources and detectors to the subject's head.

[0034] 2. Time synchronization:

[0035] The challenge of achieving sufficient time accuracy and synchronization of fNIRS and EEG recordings at the same time. To address the measurement simultaneity issues in these challenges, common methods include aligning timestamps and using a central synchronization control system or sharing certain hardware devices. Aligning timestamps ensures that data collected from different devices can be accurately matched on the time axis, while the central synchronization control system starts all measurement devices at the same time through a unified trigger mechanism to ensure the synchronization of data acquisition. The reuse of hardware devices can include ADC multiplexing, light source multiplexing, etc. However, these methods are still not enough to meet the needs of time synchronization.

[0036] 3. Series disturbance between different devices:

[0037] Customized EEG sensors consisting of Ag / AgCl powder sintered cylinders and silver-plated copper wires are required to ensure that the residual magnetic field is less than 50pT without causing changes in the power spectral density of the OPM. It is also necessary to ensure that the frequency multiplexing of the high-channel light source system does not cause electrical crosstalk to the EEG. However, these methods still result in unsatisfactory series disturbances between devices.

[0038] In view of some or all of the above problems, embodiments of the present invention provide a variety of multimodal fusion detection devices based on optical pumping technology, involving brain-computer interface, quantum mechanics, neuroscience, optics, acoustics and other technical fields, which can be used to realize non-invasive wearable BCI sensors, and can realize multimodal fusion detection at the same position and time through hardware reuse, while reducing the size of the device and avoiding series disturbances between multimodal sensors as much as possible. The technical solution provided by the present invention will be described below in conjunction with the accompanying drawings.

[0039] First, a multi-modal fusion detection device based on optical pumping technology provided by an embodiment of the present invention is introduced. Figure 1 , Figure 1 A schematic diagram of the structure of a multimodal fusion detection device based on optical pumping technology provided in an embodiment of the present invention. The multimodal fusion detection device may include the following modules:

[0040] A laser generating module 11 , a laser path controlling module 12 , an atomic gas chamber 13 , a photoelectric detecting module 14 , an ultrasonic detecting module 15 and a data processing module 16 .

[0041] The laser generating module 11 is used to generate laser. The laser path control module 12 is used to control the propagation path of the laser to realize laser path control. The atomic gas chamber 13 can be a gas chamber based on the principle of optically pumped magnetometer. For example, the atomic gas chamber 13 can be an empty chamber containing 87Rb atoms or 4He, etc.

[0042] According to actual application and implementation requirements, the atomic gas chamber 13 may also include a heating module, a modulation magnetic field generating module, etc., which is not limited.

[0043] According to the actual application and implementation requirements, the laser generation module 11 may also include optical components such as filters and / or polarizers that can be used to control the laser propagation path. The photoelectric detection module 14 can convert the optical signal into an electrical signal for detecting the change in laser intensity. In addition, the photoelectric detection module 14 can cooperate with the atomic gas chamber 13 and the data processing module 16 to realize physiological signal detection based on the optically pumped magnetometer according to the pulsed laser generated by the laser generation module 11.

[0044] The ultrasonic detection module 15 can be used for photoacoustic wave signals, and can cooperate with the data processing module 16 to realize blood oxygen signal detection based on photoacoustic imaging according to the pulsed laser generated by the laser generating module 11.

[0045] The data processing module 16 is used to process the input data according to a preset algorithm program to achieve the corresponding algorithm purpose and output the data calculated according to the algorithm.

[0046] Among them, the laser generating module 11 includes a first laser outlet 21 and a second pulsed laser outlet 22. The laser path control module 12 includes a path control inlet 24 and a path control outlet 25. The atomic gas chamber 13 includes a first laser inlet 23, a first laser outlet 26 and a detection port 27. The photoelectric detection module 14 includes a laser receiving port 28. The ultrasonic detection module 15 includes a detection point 29. The photoelectric detection module 14 and the ultrasonic detection module 15 are electrically connected to the data processing module 16 respectively.

[0047] exist Figure 1 In the embodiment, the first laser output port 21 is aligned with the first laser input port 23, the second pulse laser output port 22 is aligned with the path control input port 24, the path control output port 25 is aligned with the preset area 40, and the detection port 27 is aligned with the preset area 40. The laser receiving port 28 is aligned with the first laser output port 26, and the detection point 29 is associated with the preset area 40.

[0048] For the embodiment, the following contents need to be explained:

[0049] 1. For the embodiments, alignment can be understood as a straight line alignment between A and B, or can be understood as an indirect alignment between A and B through some medium. For example, alignment in this article can be explained as follows: a laser beam is emitted from point A and aligned straight to point B; or a laser beam is emitted from point A and changes direction through some optical devices and then aligned to point B.

[0050] 2. For the embodiment, Figure 1The alignment conditions in the figure are only examples and do not limit the alignment conditions between various modules, units or components. The alignment between one laser entrance and exit and another laser entrance and exit can be linear alignment or indirect alignment.

[0051] 3. For the embodiment, the detection point 29 is associated with the preset area 40, which can be understood as the detection point 29 is set near, around or between the preset area 40, and this is not limited. The detection point 29 is associated with the preset area 40 to enable the ultrasonic detection module 15 to detect the preset area 40.

[0052] In some optional embodiments, in the laser path control module 12 , the laser is incident from the path control incident port 24 and is emitted from the path control outlet 25 . In the atomic gas chamber 13 , the laser is incident from the first laser inlet 23 and is emitted from the first laser outlet 26 .

[0053] In other words, the laser generating module 11 can generate a first laser and a second pulse laser.

[0054] The path of the first laser may include, in order of path sequence: the first laser emission port 21 →the first laser entrance port 23 →the atomic gas chamber 13 →the first laser exit port 26 →the laser receiving port 28 .

[0055] The path of the second pulse laser may be arranged in order from the path to the next step, and may include: the second pulse laser outlet 22 →the path control inlet 24 →the laser path control module 12 →the path control outlet 25 →the preset area 40 .

[0056] for Figure 1 In the multimodal fusion detection device shown, in some embodiments: the laser generating module 11 can be used to generate a first laser and a second pulsed laser. The laser path control module 12 can be used to configure the irradiation path of the first laser to pass through the atomic gas chamber 13, and can be used to configure the irradiation path of the second pulsed laser to point to the preset area 40. Among them, the atomic gas chamber 13 can be configured to be associated with the preset area 40, that is, the atomic gas chamber 13 is configured to detect the preset area.

[0057] In addition, the photoelectric detection module 14, the ultrasonic detection module 15 and the data processing module 16 can be used as a detection module. When the measured part of the measured object is associated with the preset area 40, the detection module can be used to collect the laser intensity and polarization change signal corresponding to the first laser after passing through the atomic gas chamber 13, and collect the ultrasonic signal corresponding to the second pulse laser after acting on the measured part. Then, the physiological signal of the measured object is determined according to the laser intensity and polarization change signal and the ultrasonic signal. Specifically, the detection module can output the physiological signal of the measured object according to the laser intensity and polarization change signal (the physiological signal here can be understood as: the magnetic field change caused by nerve discharge in the local part of the brain of the measured object), and output the blood oxygen signal of the measured object according to the ultrasonic signal.

[0058] Among them, the detection module can be implemented using technologies such as magnetic field modulation and phase-locked detection. For details, please refer to the relevant technical content and will not be repeated here.

[0059] The preset area 40 can be understood as the setting position of the measured part of the measured object. The measured part is associated with the preset area 40, that is, the measured part of the measured object is set in the preset area.

[0060] It can be understood that since the first laser outlet 21 is aligned with the first laser inlet 23 of the atomic gas chamber 13, the first laser outlet 26 of the atomic gas chamber 13 is aligned with the laser receiving port 28 of the photoelectric detection module 14, and the detection port 27 of the atomic gas chamber 13 is aligned with the preset area 40. In other words, the pulsed laser emitted through the first laser outlet 21 will pass through the atomic gas chamber 13 and then be detected by the photoelectric detection module 14, so that the photoelectric detection module 14 can realize OPM-MEG detection based on the detected signal changes, which is equivalent to realizing a brain magnetometer based on optical pumping (for example, OPM-MEG). Since the second pulsed laser outlet 22 is aligned with the path control inlet 24, the path control outlet 25 is aligned with the preset area 40, and the detection point 29 of the ultrasound detection module 15 is associated with the preset area 40. That is to say, the pulse laser emitted through the second pulse laser outlet 22 will pass through the laser path control module 12 and then be emitted to the preset area 40, so that the ultrasonic detection module 15 can realize photoacoustic detection based on the detected photoacoustic signal changes, which is equivalent to realizing a photoacoustic sensor. In addition, since the detection port of the atomic gas chamber 13 is aligned with the preset area 40, and the detection point 29 of the ultrasonic detection module 15 is associated with the preset area 40. In other words, the pulse lasers emitted from the first laser outlet 21 and the second pulse laser outlet 22 can respectively perform magnetic and photoacoustic detection on the same area, thereby realizing hardware multiplexing. In addition, multi-modal fusion detection at the same position and time can be realized through hardware multiplexing, and the device volume can be reduced, and series disturbances between multi-modal sensors can be avoided as much as possible.

[0061] Optionally, the laser emitted from the path control outlet 25 and the detection path of the atomic gas chamber 13 at least partially overlap ( Figure 1 This can further improve the reuse of hardware. For details, please refer to Figure 2 , Figure 3 Description of the illustrated embodiment. It can be understood that in the present invention, at least one of the signal amplifier (AMP) and the data acquisition device (DAQ) can be multiplexed according to actual application requirements, and the specific multiplexing implementation method can be set by the technician according to the requirements, which will not be described in detail here.

[0062] Among them, the balanced photodetector in this article can include some accessories of a two-way signal amplifier (AMP).

[0063] The detection path of the atomic gas chamber 13 may include a path from the detection port 27 to the preset area 40 .

[0064] In some possible embodiments, the laser generating module 11 can be implemented using one laser. After the pulse laser generated by this laser passes through a spectrometer, a first laser (the first laser here can also be understood as a first pulse laser) and a second pulse laser are obtained. The first laser meets the relaxation requirements of the optically pumped magnetometer principle when passing through the atomic gas chamber, and the second pulse laser meets the photoacoustic pressure requirements of photoacoustic imaging. For this embodiment, reference can be made to Figure 2 Description of the multimodal fusion detection device 100 shown.

[0065] Please refer to Figure 2 , Figure 2 Another structural schematic diagram of a multi-modal fusion detection device based on optical pumping technology provided by an embodiment of the present invention. The specific description is as follows:

[0066] The multimodal fusion detection device 100 may include: a pulse laser 110, a filter 111, a focusing lens 112, a beam hole 113, a focusing lens 114, a beam splitter 115, a beam splitter 116, a refracting lens 120, a collimating lens 121, an atomic gas chamber 130, a balanced photodetector 140, a beam splitter 141, a photodetection port 142, a photodetection port 143, a signal amplifier 150, an ultrasonic transducer 151, a reference photodetection port 153, a data acquisition device 160, a fiber coupler 170, an optical amplifier 171, and a diffuser 172. The ultrasonic transducer 151, for example, may be an ultrasonic transducer and a transducer array in various forms.

[0067] It can be understood that, according to actual detection requirements, the multimodal fusion detection device 100 may also include Figure 2More or fewer components not shown in the figure can be flexibly arranged by those skilled in the art and are not limited thereto.

[0068] for Figure 2 For the multimodal fusion detection device 100 shown in FIG. 1 , the positional relationship and connection relationship between each device and component can be found in FIG. Figure 2 The following will describe the embodiment from the perspective of the propagation path of the pulsed laser:

[0069] for Figure 2 Laser propagation path in:

[0070] The pulse laser 110 can generate laser light, which passes through the filter 111, the focusing lens 112, the beam hole 113, and the focusing lens 114, and then is emitted to the beam splitter 115. The beam splitter 115 splits the laser light into two beams: laser light 1 and laser light 2. Among them, laser light 1 is emitted to the beam splitter 116, and laser light 2 is emitted to the reference photodetection port 153. The beam splitter 116 continues to split the laser light 1 into two beams: laser light 11 and laser light 12. The laser light 11 is aimed at the atomic gas chamber 130, and after passing through the atomic gas chamber 130, it is emitted to the beam splitter 141. The beam splitter 141 can split the laser light 11 into two beams, which are emitted to the photodetection port 142 and the photodetection port 143 respectively. The photodetection port 142 and the photodetection port 143 are respectively connected to the balanced photodetector 140. According to the OPM-MEG principle, the laser intensity of the laser 11 after passing through the atomic gas chamber 130 will change due to changes in the physiological signals of the measured part of the object being measured. The photoelectric detection port 142 and the photoelectric detection port 143 can collect the laser intensity and polarization change signals corresponding to the laser 11, and transmit the laser intensity and polarization change signals to the balanced photodetector 140 and the data acquisition device 160.

[0071] The laser 12 is directed toward the refractive lens 120. Then, the laser 12 is refracted by the refractive lens 120 and aligned with the collimating lens 121. After that, the laser 12 passes through the collimating lens 121 and is directed toward the fiber coupler 170. After being received by the fiber coupler 170, the laser 12 is directed to the optical amplifier 171 and the diffuser 172. After being processed by the optical amplifier 171 and the diffuser 172, the laser 12 is directed toward a preset area. In the preset area, the laser 12 can act on the measured part of the object to be measured, and a corresponding ultrasonic signal will be generated after the action. The ultrasonic signal can be collected by the ultrasonic transducer 151, and then the collected signal can be transmitted to the signal amplifier 150 and the data acquisition device 160.

[0072] In the above process, the data acquisition device 160 can respectively collect the laser intensity and polarization change signals corresponding to the laser after passing through the atomic gas chamber 130, and the ultrasonic signal corresponding to the laser acting on the measuring part. In addition, the data acquisition device 160 can output the physiological signal of the measured object according to the laser intensity and polarization change signals based on the OPM-MEG principle, thereby realizing the brain magnetometer based on optical pumping; the data acquisition device 160 can output the blood oxygen signal of the measured object according to the ultrasonic signal based on the PAI principle, thereby realizing the photoacoustic sensor.

[0073] for Figure 2 The multimodal fusion detection device 100, the pulse laser 110 (which may be referred to as the third pulse laser) and the optical splitter 116 etc. can realize the above-mentioned Figure 1 The laser generating module 11 in the embodiment. The emission position of the laser 11 of the beam splitter 116 may correspond to the above Figure 1 The first laser outlet 21 in the beam splitter 116 may have a laser 12 outlet position corresponding to the above Figure 1 The second pulse laser outlet 22 in the refraction lens 120 and the collimation lens 121 can realize the above Figure 1 The incident position of the laser 12 of the refractive lens 120 may correspond to the above Figure 1 The path control entrance 24 in the collimating lens 121 can correspond to the above-mentioned laser 12 exit position Figure 1 The path in the control output port 25. The photodetection port 142, the photodetection port 143 and the balanced photodetector 140 can realize the above Figure 1 The photoelectric detection module 14 in the embodiment. The ultrasonic transducer 151 and the signal amplifier 150 can realize the above Figure 1 The ultrasonic detection module 15 in the embodiment. Figure 1 and Figure 2 There are more or fewer corresponding relationships in the embodiment, which are not described in detail in this embodiment. The specific corresponding relationships can be set according to actual needs.

[0074] according to Figure 2 The embodiment shown and Figure 1 The corresponding relationship of the embodiments shown in the figure, in some optional embodiments, Figure 1 In the multimodal fusion detection device shown, the laser generating module 11 may include a third pulse laser and a spectrometer. The third pulse laser is used to generate a third pulse laser, and the spectrometer is used to process the third pulse laser into a first laser and a second pulse laser. Optionally, the first laser is emitted through a first laser emission port 21 of the spectrometer, and the second pulse laser is emitted through a second pulse laser emission port 22 of the spectrometer.

[0075] Among them, the laser path control module 12 is used to configure the irradiation path of the first laser to pass through the atomic gas chamber 13, and to configure the irradiation path of the second pulse laser to point to the preset area 40. Among them, the atomic gas chamber 13 can be set to be associated with the preset area 40. And the photoelectric detection module 14, the ultrasonic detection module 15 and the data processing module 16 can be used as a detection module. When the measured part of the object to be measured is associated with the preset area 40, the detection module can be used to collect the laser intensity and polarization change signal corresponding to the first laser after passing through the atomic gas chamber 13, and collect the ultrasonic signal corresponding to the second pulse laser after acting on the measured part. Then, the physiological signal of the object to be measured is determined based on the laser intensity and polarization change signal and the ultrasonic signal.

[0076] In some possible embodiments, the laser generating module 11 may be implemented using two lasers, which respectively generate a first laser and a second pulsed laser. Specifically, the laser generating module 11 may include a detection laser and an optical pumping laser, wherein the detection laser serves as the light source of the OPM-MEG, and the optical pumping laser serves as the light source of the PAI. For this embodiment, reference may be made to Figure 3 Description of the multimodal fusion detection device 200 shown.

[0077] Please refer to Figure 3 , Figure 3 Another structural diagram of a multi-modal fusion detection device based on optical pumping technology provided by an embodiment of the present invention is described in detail as follows:

[0078] The multimodal fusion detection device 200 may include: a first laser 210, a filter 211, a focusing lens 212, a beam hole 213, a focusing lens 214, a second pulse laser 215, a filter 216, a focusing lens 217, a beam hole 218, a focusing lens 219, a refracting lens 220, an atomic gas chamber 230, a balanced photodetector 240, a spectrometer 241, a photodetection port 242, a photodetection port 243, a signal amplifier (AMP) 250, an ultrasonic transducer 251, a spectrometer 253, a reference photodetection port 254, a data acquisition device (DAQ) 260, a fiber optic coupler 270, an optical amplifier 271, and a diffuser 272.

[0079] It can be understood that, according to actual detection requirements, the multimodal fusion detection device 200 may also include Figure 3 More or fewer components not shown in the figure can be flexibly arranged by those skilled in the art and are not limited thereto.

[0080] for Figure 3 For the multimodal fusion detection device 200 shown in FIG. 1 , the positional relationship and connection relationship between each device and component can be found in FIG. Figure 3 The following will describe the embodiment from the perspective of the propagation path of the pulsed laser:

[0081] For the first laser propagation path: the first laser 215 can generate a first laser, and the first laser passes through the filter 216, the focusing lens 217, the beam hole 218, and the focusing lens 219, and then is emitted to the beam splitter 253. Then, the beam splitter 253 divides the first laser into two beams: the first laser 1 and the first laser 2. Among them, the first laser 1 is aimed at the atomic gas chamber 230, and after passing through the atomic gas chamber 230, it is emitted to the beam splitter 241. The beam splitter 241 can divide the first laser 1 into two beams, which are emitted to the photodetection port 242 and the photodetection port 243 respectively. The photodetection port 242 and the photodetection port 243 are respectively connected to the balanced photodetector 240. According to the OPM-MEG principle, the laser intensity of the first laser 1 after passing through the atomic gas chamber 230 will change due to the change of the physiological signal of the measured part of the measured object, and the photoelectric detection port 242 and the photoelectric detection port 243 can collect the laser intensity and polarization change signal corresponding to the first laser 1, and transmit the laser intensity and polarization change signal to the balanced photodetector 240 and the data acquisition device 260. The first laser 2 is aligned with the reference photodetection port 254, and the reference photodetection port 254 can transmit the collected first laser 2 to the signal amplifier 250 and the data acquisition device 260.

[0082] For the second laser propagation path: the second pulse laser 210 can generate a second laser, and the second laser passes through the filter 211, the focusing lens 212, the beam hole 213, and the focusing lens 214, and then is directed to the refractive lens 220. Then, the second laser is refracted by the refractive lens 220 and is aligned with the atomic gas chamber 230. After that, the second laser passes through the atomic gas chamber 230 and is directed to the fiber coupler 270. After being received by the fiber coupler 270, the second laser is guided to the optical amplifier 271 and the diffuser 272. After being processed by the optical amplifier 271 and the diffuser 272, the second laser is directed to the preset area. In the preset area, the second laser can act on the measured part of the object to be measured, and a corresponding ultrasonic signal will be generated after the action. The ultrasonic signal can be collected by the ultrasonic transducer 251, and then the collected signal can be transmitted to the signal amplifier 250 and the data acquisition device 260.

[0083] In the above process, the data acquisition device 260 can respectively collect the laser intensity and polarization change signal corresponding to the first laser after passing through the atomic gas chamber 230, and the ultrasonic signal corresponding to the second laser after acting on the measuring part. In addition, the data acquisition device 260 can output the physiological signal of the measured object according to the laser intensity and polarization change signal based on the OPM-MEG principle, thereby realizing the brain magnetometer based on optical pumping; the data acquisition device 260 can output the blood oxygen signal of the measured object according to the ultrasonic signal based on the PAI principle, thereby realizing the photoacoustic sensor.

[0084] In some optional embodiments, the first laser 215 is a detection laser, and the second pulse laser 210 is an optical pump laser. The detection laser can be a continuous laser light source or a pulse laser light source. The wavelength of the laser generated by the detection laser can be set to 795nm, and the wavelength of the pulse laser generated by the optical pump laser can be set to 780nm.

[0085] for Figure 3 The multimodal fusion detection device 200, the first laser 215 and the second pulse laser 210 can realize the above Figure 1 The laser generating module 11 in the embodiment. The first laser 1 may correspond to the above Figure 1 In the embodiment, the emission position of the first laser 1 of the beam splitter 253 may correspond to the above Figure 1 The first laser outlet 21 in the embodiment and the second laser outlet position of the focusing lens 214 may correspond to the above Figure 1 The second pulse laser outlet 22 in the refraction lens 220 can realize the above Figure 1 The incident position of the second laser of the refractive lens 220 may correspond to the above Figure 1 The path control entrance 24 in the refracting lens 220 may correspond to the above-mentioned Figure 1 The path in the control output port 25. The photodetection port 242, the photodetection port 243 and the balanced photodetector 240 can realize the above Figure 1 The photoelectric detection module 14 in the embodiment. The ultrasonic transducer 251 and the signal amplifier 250 can realize the above Figure 1 The ultrasonic detection module 15 in the embodiment. Figure 1 and Figure 3 There are more or fewer corresponding relationships in the embodiment, which are not described in detail in this embodiment. The specific corresponding relationships can be set according to actual needs.

[0086] In some optional embodiments, for Figure 1 and Figure 3The atomic gas chamber can be arranged between the path control outlet and the preset area, and the laser emitted from the path control outlet passes through the atomic gas chamber and then enters the preset area ( Figure 1 In other words, the irradiation path of the second pulse laser is also configured to point to the preset area after passing through the atomic gas chamber. In this way, the hardware reuse of the two detection technologies (OPM-MEG and PAI) can be further improved, and the size of the equipment can be reduced.

[0087] according to Figure 3 The embodiment shown and Figure 1 The corresponding relationship of the embodiments shown in the figure, in some optional embodiments, Figure 1 In the multimodal fusion detection device shown, the laser generating module 11 may include a first laser and a second pulse laser. The first laser includes a first laser outlet 21, and the second pulse laser includes a second pulse laser outlet 22. The first laser is used to generate a first laser, and the second pulse laser is used to generate a second pulse laser.

[0088] Among them, the laser path control module 12 is used to configure the irradiation path of the first laser to pass through the atomic gas chamber 13, and to configure the irradiation path of the second pulse laser to point to the preset area 40. Among them, the atomic gas chamber 13 can be set to be associated with the preset area 40. And the photoelectric detection module 14, the ultrasonic detection module 15 and the data processing module 16 can be used as a detection module. When the measured part of the object to be measured is associated with the preset area 40, the detection module can be used to collect the laser intensity and polarization change signal corresponding to the first laser after passing through the atomic gas chamber 13, and collect the ultrasonic signal corresponding to the second pulse laser after acting on the measured part. Then, the physiological signal of the object to be measured is determined based on the laser intensity and polarization change signal and the ultrasonic signal.

[0089] According to the above Figure 1-Figure 3 In the embodiment shown, in some optional embodiments, the laser path control module 12 may include a refractor, or the laser path control module 12 may include a refractor and a collimating lens. In some optional embodiments, the laser path control module 12 may also include a filter or a polarizer to achieve control of the laser path.

[0090] According to the above Figure 1-Figure 3 In some optional embodiments, the multimodal fusion detection device further includes a fiber guiding module. The laser emitted from the path control outlet 25 is directed to the preset area 40 through the fiber guiding module. The fiber guiding module may include a fiber coupler, an amplifier, and a diffuser. For example, Figure 2 Fiber optic coupler 170, amplifier 171 and diffuser 172 are shown.

[0091] According to the above Figure 1-Figure 3 In the illustrated embodiment, in some optional embodiments, the first laser meets the relaxation requirement of the optically pumped magnetometer principle when passing through the atomic gas chamber 13, and the second pulsed laser meets the photoacoustic pressure requirement of photoacoustic imaging.

[0092] When the first laser passes through the atomic gas chamber 13, it meets the relaxation requirements of the optically pumped magnetometer principle, for example: one or more of the intensity, frequency and wavelength of the first laser meet the relaxation parameter design requirements of OPM-MEG. Specifically, a complete relaxation process can be completed within a single pulse to effectively provide energy for OPM. The setting of specific parameters can be set according to actual design requirements and OPM-MEG design principles, and is not limited or elaborated here.

[0093] The second pulse laser meets the photoacoustic pressure requirements of photoacoustic imaging, for example, one or more of the intensity, frequency and wavelength of the second pulse laser meets the design requirements of PAI. Specifically, when the laser emitted from the path control outlet 25 passes through the optical fiber guide module and is aimed at the preset area 40, it can meet the initial sound pressure of PAI that is sufficiently detected by the ultrasonic probe. The setting of specific parameters can be set according to actual design requirements and PAI design principles, and is not limited or elaborated here.

[0094] The above description is only an embodiment of the present invention and is not intended to limit the protection scope of the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A multi-modal fusion detection device based on optical pumping technology, characterized in that: include: Laser generation module, laser path control module, atomic gas chamber, photoelectric detection module, ultrasonic detection module and data processing module; Wherein, the laser generating module comprises a first laser outlet and a second pulse laser outlet, the first laser outlet is aligned with a first laser inlet of the atomic gas chamber, the second pulse laser outlet is aligned with a path control inlet included in the laser path control module, the detection port of the atomic gas chamber is aligned with a preset area, the atomic gas chamber is a gas chamber based on the principle of an optically pumped magnetometer, the atomic gas chamber is configured to detect the preset area, and the preset area is a setting position of a measured part of the measured object; The laser path control module further comprises a path control outlet, and the path control outlet is aligned with the preset area; The laser receiving port of the photoelectric detection module is aligned with the first laser outlet of the atomic gas chamber; The detection point of the ultrasonic detection module is associated with the preset area, so as to enable the ultrasonic detection module to detect the preset area; The photoelectric detection module and the ultrasonic detection module are electrically connected to the data processing module respectively, and the photoelectric detection module, the ultrasonic detection module and the data processing module serve as detection modules; Among them, the detection module is used to collect the laser intensity and polarization change signal corresponding to the first laser after passing through the atomic gas chamber, and output the magnetic field change caused by local neural discharge in the brain of the object under test according to the laser intensity and polarization change signal; the detection module is also used to collect the ultrasonic signal corresponding to the second pulse laser after it acts on the measured part, and output the blood oxygen signal of the object under test according to the ultrasonic signal.

2. A multi-modal fusion detection device based on optical pumping technology, characterized in that: include: A laser generating module, used for generating a first laser and a second pulse laser; a laser path control module, configured to configure the irradiation path of the first laser to pass through the atomic gas chamber, and configured to configure the irradiation path of the second pulsed laser to point to a preset area; Wherein, the atomic gas chamber is configured to be associated with the preset area, the atomic gas chamber is a gas chamber based on the principle of optical pumping magnetometer, the atomic gas chamber is configured to detect the preset area, and the preset area is the setting position of the measured part of the measured object; and, A detection module, used for collecting the laser intensity and polarization change signal corresponding to the first laser after passing through the atomic gas chamber, and collecting the ultrasonic signal corresponding to the second pulse laser after acting on the measured part, when the measured part of the measured object is associated with the preset area; Wherein, the detection module is also used to output the magnetic field change caused by local neural discharge in the brain of the object under test according to the laser intensity and polarization change signal, and to output the blood oxygen signal of the object under test according to the ultrasonic signal.

3. The multimodal fusion detection device based on optical pumping technology according to claim 2, characterized in that: The laser generating module comprises a first laser and a second pulse laser; The first laser is used to generate the first laser, and the second pulse laser is used to generate the second pulse laser.

4. The multimodal fusion detection device based on optical pumping technology according to claim 3 is characterized in that: The irradiation path of the second pulse laser is also configured to point to the preset area after passing through the atomic gas chamber.

5. The multimodal fusion detection device based on optical pumping technology according to claim 2, characterized in that: The laser generating module includes a third pulse laser and a spectrometer; The third pulse laser is used to generate a third pulse laser, and the beam splitter is used to process the third pulse laser into the first laser and the second pulse laser.

6. The multimodal fusion detection device based on optical pumping technology according to claim 4 or 5, characterized in that: When the first laser passes through the atomic gas chamber, it meets the relaxation requirement of the optically pumped magnetometer principle, and the second pulsed laser meets the photoacoustic pressure requirement of photoacoustic imaging.

Images