Multifunctional photoelectric signal acquisition sensor, multimodal brain signal acquisition device

Abstract

The present application provides a multifunctional photoelectric signal acquisition sensor, a multimodal brain signal acquisition device, and a system. The multifunctional photoelectric signal acquisition sensor comprises: a sensor body with a built-in near-infrared probe sensor for detecting near-infrared light signals reflected or scattered by the cerebral cortex; a groove between the near-infrared probe sensor and the sensor body for placing an absorbent sponge, which passes through the sensor body and contacts the scalp to collect EEG signals; and multiple electrode needles, each of which is arranged along the circumference of a port on the side of the sensor body close to the scalp, and contacts the scalp to collect EEG signals. The multifunctional photoelectric signal acquisition sensor provided by the present application facilitates the simultaneous collection of EEG signals and near-infrared light signals, resolving the problem of point conflicts or sharing.

Description

Technical Field

[0001] This application relates to the field of brain signal acquisition technology, and in particular to a multifunctional photoelectric signal acquisition sensor, a multimodal brain signal acquisition device and system. Background Technology

[0002] Multimodal simultaneous monitoring of brain states is widely used in brain function research. Among these methods, the combination of functional near-infrared spectroscopy (FIR) and electroencephalography (EEG) is receiving increasing attention. While EEG signal acquisition systems have standardized measurement points, and NIR signals have standardized brain regions for measurement, the two methods can sometimes lead to point conflicts or shared measurement areas. Summary of the Invention

[0003] This application provides a multifunctional photoelectric signal acquisition sensor, a multimodal brain signal acquisition device and system, which helps to simultaneously acquire electroencephalogram (EEG) signals and near-infrared light signals, and solves the problem of location conflicts or sharing.

[0004] In a first aspect, this application provides a multifunctional photoelectric signal acquisition sensor for simultaneously acquiring electroencephalogram (EEG) signals and near-infrared light signals for brain function imaging, comprising:

[0005] The sensor body contains a built-in near-infrared probe sensor, which is used to detect near-infrared light signals reflected or scattered by the cerebral cortex. There is a groove between the near-infrared probe sensor and the sensor body, which is used to place an absorbent sponge. The absorbent sponge passes through the sensor body and contacts the scalp to collect electroencephalogram (EEG) signals.

[0006] Multiple electrode needles are arranged around the circumference of the port on the side of the sensor body closest to the scalp. The electrode needles are in contact with the scalp to collect electroencephalogram (EEG) signals.

[0007] In one possible implementation, the electrode needle is an elastic structure that can extend and retract along the sensor body; and / or, the inner wall of the groove is provided with a metal plating layer.

[0008] In a second aspect, this application provides a multimodal brain signal acquisition device, comprising: a multifunctional photoelectric signal acquisition sensor, an electroencephalogram (EEG) signal processor, and an optical signal processor as shown in the first aspect;

[0009] The near-infrared light signal acquired by the multifunctional photoelectric signal acquisition sensor is transmitted to the optical signal processor via optical fiber;

[0010] The EEG signal processor is used to condition the EEG signals acquired by the multifunctional photoelectric signal acquisition sensor; the optical signal processor is used to convert the near-infrared light signals acquired by the multifunctional photoelectric signal acquisition sensor into analog signals and to condition the analog signals, including signal amplification and filtering.

[0011] In one possible implementation, the EEG signal processor includes an analog front-end processing module, a first amplifier module, and a first analog-to-digital converter. The analog front-end processing module is used to denoise the EEG signal, and the denoising process includes at least removing baseline drift, power line interference, and electrooculography interference. The first amplifier module is used to amplify and filter the denoised EEG signal. The first analog-to-digital converter is used to convert the amplified and filtered EEG signal into a first digital signal. The EEG signal processor is also used to transmit the first digital signal to an external host computer.

[0012] The optical signal processor includes a first photodiode, a second amplifier processing module, and a second analog-to-digital converter. The first photodiode is used to convert near-infrared light signals into a first analog signal. The second amplifier processing module is used to amplify and filter the first analog signal to obtain a second analog signal. The second analog-to-digital converter is used to convert the second analog signal into a second digital signal. The optical signal processor is also used to transmit the second digital signal to an external host computer.

[0013] In one possible implementation, the near-infrared probe sensor includes a near-infrared sensor body and an optical fiber interface, and the near-infrared probe sensor is connected to an optical fiber through the optical fiber interface.

[0014] The near-infrared sensor body contains a hollow light guide column, which is used to receive near-infrared light signals and guide them to the optical fiber interface.

[0015] In one possible implementation, the near-infrared probe sensor also includes a front-end processing module;

[0016] The light guide column is connected to the fiber optic interface via the pre-processing module.

[0017] The pre-processing module is used to preprocess the near-infrared light signal guided by the light guide column and output the preprocessed near-infrared light signal to the fiber optic interface.

[0018] In one possible implementation, the front-end processing module includes a second photodiode, a filtering unit, a third analog-to-digital converter, and a digital-to-optical converter;

[0019] The second photodiode is used to convert the near-infrared light signal guided by the light guide post into a third analog signal;

[0020] The filtering unit is used to filter the third analog signal;

[0021] The third analog-to-digital converter is used to convert the filtered third analog signal into a third digital signal;

[0022] A digital-to-optical converter is used to convert a third digital signal into an optical signal; and / or,

[0023] The sensitivity of the second photodiode is higher than that of the first photodiode; and / or,

[0024] The front-end processing module also includes a data verification mechanism unit, which is used to add a preset data verification mechanism to the third digital signal;

[0025] The optical signal processor also includes a data verification mechanism verification unit, which is used to verify whether the second digital signal conforms to the preset data verification mechanism.

[0026] In one possible implementation, the light guide post and the optical fiber interface are connected using optical fiber fusion splicing technology; and / or, the light guide post is a retractable structure used to adjust the distance between the near-infrared probe sensor and the cerebral cortex.

[0027] In one possible implementation, the first photodiode is either separately located in the optical signal processor or integrated into the second amplifier processing module.

[0028] In one possible implementation, the device is a hat-like structure, a helmet structure, or a headband structure; and / or,

[0029] When there are multiple multifunctional photoelectric signal acquisition sensors, the device also includes a control circuit and multiple emitting light sources, each emitting light source corresponding to multiple multifunctional photoelectric signal acquisition sensors;

[0030] It consists of multiple multifunctional photoelectric signal acquisition sensors and multiple emission light sources, forming different multi-channel interfaces. Different multi-channel interfaces form different detection components, and different detection components correspond to different detection areas of the user's brain.

[0031] The control circuit is used to send control signals to the detection components.

[0032] In one possible implementation, the control circuit includes a detection component gating control unit, which is used to select one or more of the multiple detection components for brain signal acquisition.

[0033] In one possible implementation, the detection component gating control unit includes multiple switching components, with each switching component corresponding to a detection component.

[0034] The control circuit includes a main control chip, which is used to send strobe signals to multiple switching components, and control one or more switching components to connect with the corresponding detection components through the strobe signals.

[0035] In one possible implementation, the control signals include power control signals and lighting control signals, and the control circuit also includes a main control chip and a control module, with the control module connected between the main control chip and the multi-channel interface.

[0036] The control module is used to receive the power selection signal sent by the host computer, generate a power control signal based on the power selection signal, and send the power control signal to multiple emitting light sources; it also receives the lighting signal sent by the host computer, generates a lighting control signal based on the lighting signal, and outputs the lighting control signal to the corresponding emitting light source.

[0037] In one possible implementation, the lighting signal includes a first lighting signal and a second lighting signal, and the lighting control signal includes a first lighting control signal and a second lighting control signal; the control module includes: a first multiplexer, multiple range resistors, a second multiplexer and a third multiplexer, the first multiplexer being connected between the main control chip and the multiple range resistors, the second multiplexer being connected between the multiple range resistors and the multiple emitting light sources, and the third multiplexer being connected between the main control chip and the multiple emitting light sources;

[0038] The main control chip is used to send power selection signals to the first multiplexer;

[0039] The first multiplexer is used to generate a gear selection signal based on the power selection signal, and output a power control signal to the second multiplexer through the gear selection resistor corresponding to the gear selection signal.

[0040] The second multiplexer is used to output power control signals to multiple transmitting light sources, and the power control signals are used to control the power of the multiple transmitting light sources;

[0041] The second multiplexer is used to output a first lighting control signal to the corresponding emitting light source based on the first lighting signal output by the main control chip.

[0042] The third multiplexer is used to output a second lighting control signal to the corresponding emitting light source based on the second lighting signal output by the main control chip.

[0043] In one possible implementation, the multi-channel interface includes a first multi-channel interface, a second multi-channel interface, a third multi-channel interface, and a fourth multi-channel interface;

[0044] If the first multi-channel interface forms a detection component, the detection area corresponding to the detection component includes the frontal lobe region; or...

[0045] If the second multi-channel interface forms a detection component, the detection area corresponding to the detection component includes the occipital lobe region; or...

[0046] If the third multi-channel interface and the fourth channel interface form a detection component, the detection area corresponding to the detection component includes the top leaf region.

[0047] Thirdly, this application provides a multimodal brain signal acquisition system, including a multimodal brain signal acquisition device and a host computer as shown in the second aspect, or including a multifunctional photoelectric signal acquisition sensor and a host computer as shown in the first aspect.

[0048] Compared with the prior art, this application has at least the following technical effects:

[0049] This application provides a multifunctional photoelectric signal acquisition sensor for simultaneously acquiring electroencephalogram (EEG) signals and near-infrared light signals for brain function imaging. The sensor includes a sensor body with a built-in near-infrared probe for detecting near-infrared light signals. A groove exists between the near-infrared probe and the sensor body for placing an absorbent sponge. The sponge passes through the sensor body and contacts the scalp to acquire EEG signals. Multiple electrode needles are arranged circumferentially at the port of the sensor body near the scalp, contacting the scalp to acquire EEG signals. This multifunctional photoelectric signal acquisition sensor can acquire multiple photoelectric signals, including various brain function-related signals such as EEG and near-infrared light signals, providing more comprehensive and accurate brain function information. Specifically, EEG signals can be acquired through contact with the scalp using an absorbent sponge or electrode needles, while near-infrared light signals can also be acquired using the near-infrared probe, facilitating the simultaneous acquisition of EEG and near-infrared light signals and resolving issues of point conflicts or shared access.

[0050] Furthermore, this application also provides a multimodal brain signal acquisition device, including a multifunctional photoelectric signal acquisition sensor, an electroencephalogram (EEG) signal processor, and an optical signal processor. The EEG signals acquired by the multifunctional photoelectric signal acquisition sensor are transmitted to the EEG signal processor for signal conditioning. The near-infrared light signals acquired by the multifunctional photoelectric signal acquisition sensor are transmitted to the optical signal processor via optical fiber. The optical signal processor converts the near-infrared light signals into analog signals and conditions the analog signals. Using optical fiber to transmit optical signals results in minimal signal loss to the light source due to the total internal reflection principle of optical fiber. In short-distance applications, the loss along the light transmission path is negligible. Compared to transmitting electrical signals via cables, using optical transmission effectively solves the problems of interference and noise during near-infrared signal transmission, improving the accuracy of signal detection. Attached Figure Description

[0051] Figure 1 This is a schematic diagram of the structure of the multifunctional photoelectric signal acquisition sensor provided in the embodiments of this application;

[0052] Figure 2 for Figure 1 A side view of the multifunctional photoelectric signal acquisition sensor shown;

[0053] Figure 3 This is a schematic diagram of the structure of a multimodal brain signal acquisition device provided in an embodiment of this application;

[0054] Figure 4 This is a schematic diagram of another multimodal brain signal acquisition device provided in an embodiment of this application;

[0055] Figure 5 A schematic diagram of a near-infrared light signal processing flow provided in an embodiment of this application;

[0056] Figure 6 This is a schematic diagram of another near-infrared light signal processing flow provided in an embodiment of this application;

[0057] Figure 7 This is a schematic diagram of the structure of a near-infrared probe sensor provided in an embodiment of this application;

[0058] Figure 8 A schematic diagram of the structure of another multimodal brain signal acquisition device provided in this application embodiment;

[0059] Figure 9 A schematic diagram of the structure of another multimodal brain signal acquisition device provided in this application embodiment;

[0060] Figure 10 This is a schematic diagram of a control circuit provided in an embodiment of this application;

[0061] Figure 11 for Figure 8 A schematic diagram of the specific structure of the multimodal brain signal acquisition device;

[0062] Figure 12 This is a schematic diagram of the illumination of an emitting light source provided in an embodiment of this application. Detailed Implementation

[0063] In the embodiments of this application, unless otherwise specified, the character " / " indicates that the associated objects are in an "or" relationship. For example, A / B can represent A or B. "And / or" describes the relationship between the associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exists simultaneously, or B exists alone.

[0064] It should be pointed out that the words "first", "second", etc. involved in the embodiments of this application are only used for distinguishing description purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated, nor can they be understood as indicating or implying order.

[0065] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. In addition, "at least one of the following" or similar expressions refers to any combination of these items, which may include any combination of single items or plural items. For example, at least one of A, B, or C can represent: A, B, C, A and B, A and C, B and C, or A, B and C. Among them, each of A, B, and C can be an element itself, or a set containing one or more elements.

[0066] In the embodiments of this application, the terms "exemplary," "in some embodiments," and "in another embodiment" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" in this application should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of the word "exemplary" is intended to present concepts in a concrete manner.

[0067] In the embodiments of this application, the terms "of," "corresponding," and "relevant" may sometimes be used interchangeably. It should be noted that, when the distinction between them is not emphasized, the meanings they convey are the same. In the embodiments of this application, the terms "communication" and "transmission" may sometimes be used interchangeably. It should be noted that, when the distinction between them is not emphasized, the meanings they convey are the same. For example, "transmission" may include "sending" and / or "receiving," and may be either a noun or a verb.

[0068] In the embodiments of this application, "equal to" can be used in conjunction with "greater than" and is applicable to the technical solution adopted when "greater than" is used, and can also be used in conjunction with "less than" and is applicable to the technical solution adopted when "less than" is used. It should be noted that when "equal to" is used in conjunction with "greater than", it cannot be used in conjunction with "less than"; and when "equal to" is used in conjunction with "less than", it cannot be used in conjunction with "greater than".

[0069] EEG signal acquisition systems have standard measurement points, and near-infrared light signals have standard brain regions for measurement. During measurement, EEG signals and near-infrared light signals may have point conflicts or shared locations.

[0070] Based on the above problems, this application proposes a multifunctional photoelectric signal acquisition sensor, which helps to simultaneously acquire EEG signals and near-infrared light signals, and solves the problem of location conflicts or sharing.

[0071] Figure 1 This is a schematic diagram of the structure of the multifunctional photoelectric signal acquisition sensor provided in the embodiments of this application. Figure 2 for Figure 1 The side view of the multifunctional photoelectric signal acquisition sensor shown. Figure 1 and Figure 2As shown, the multifunctional photoelectric signal acquisition sensor 10 includes a sensor body 101, which houses a near-infrared probe sensor 102. The near-infrared probe sensor 102 is used to detect near-infrared light signals reflected or scattered by the cerebral cortex. A groove 103 is provided between the near-infrared probe sensor 102 and the sensor body 101, for placing an absorbent sponge 104. The absorbent sponge 104 passes through the sensor body 101 and contacts the scalp to collect electroencephalogram (EEG) signals. The multifunctional photoelectric signal acquisition sensor 10 also includes multiple electrode needles 105, each electrode needle 105 arranged circumferentially along the port of the sensor body near the scalp, contacting the scalp to collect EEG signals. Optionally, the near-infrared probe sensor 102 of the multifunctional photoelectric signal acquisition sensor 10 is connected to an optical fiber 106 to transmit the near-infrared light signal to a light processing device for signal processing.

[0072] There are two methods for acquiring electroencephalogram (EEG) signals: dry electrode acquisition and hydroelectrode acquisition. Figure 1 In the multifunctional photoelectric signal acquisition sensor shown, electrode needle 105 is a probe of a dry electrode, and the method of acquiring EEG signals by contacting the electrode needle with the subject's scalp is a dry electrode acquisition method. A water-absorbing sponge 104, after being soaked in saline solution, is placed in the groove 103 and conducts electrical signals by contacting the subject's scalp through the sensor body 101; this is a water-absorbing electrode acquisition method. The multifunctional photoelectric signal acquisition sensor provided in this application embodiment can acquire EEG signals using either a dry electrode or a water-absorbing electrode method, compatible with both methods and saving space. Meanwhile, dry electrodes have advantages in terms of convenience and comfort, while water electrodes have lower impedance, exhibiting better signal quality and stability, and supporting longer EEG signal recording times. Compatibility with both acquisition methods allows for the selection of the appropriate method according to different application scenarios and needs.

[0073] Optionally, the electrode needle 105 is an elastic structure that can extend and retract along the sensor body 101. That is, the electrode needle is elastic and can extend and retract into the interior of the sensor body 101, allowing it to better penetrate the hair and make repeated contact with the scalp. It is mainly used to collect EEG signals from areas with dense hair, but it is also suitable for collecting signals from areas without hair.

[0074] Optionally, such as Figure 1 and Figure 2 As shown, the groove 103 has a double-arc structure, and its shape is adapted to the absorbent sponge 104. After the absorbent sponge 104 is filled with saline solution, it is placed in the groove 103. The inner wall of the groove 103 is provided with a metal plating layer, which can conduct electricity after contacting the water in the absorbent sponge 104, transmitting the EEG signal to the sensor body, and then through the signal processing board PCB (Printed Circuit Board). Figure 1 and Figure 2 (Not shown in the image) Output signal. It should be noted that the shapes of the groove and the absorbent sponge are for illustrative purposes only and do not limit the scope of the embodiments in this application.

[0075] The multifunctional photoelectric signal acquisition sensor provided in this application can acquire multiple photoelectric signals, including various brain function-related signals such as electroencephalogram (EEG) signals and near-infrared light signals, providing more comprehensive and accurate brain function information. Specifically, EEG signals can be acquired through contact between an absorbent sponge or electrode needle and the scalp, while near-infrared light signals can also be acquired using a near-infrared probe sensor. This facilitates the simultaneous acquisition of EEG signals and near-infrared light signals used for brain function imaging, resolving issues of point conflicts or shared use.

[0076] Near-infrared signal detection requires the cooperation of a light source and a photodiode. The light source emits near-infrared light to the cerebral cortex. Oxygenated and deoxygenated hemoglobins in the cerebral cortex absorb near-infrared light of specific wavelengths. The unabsorbed near-infrared light is reflected or scattered and reaches the photodiode. The photodiode converts the optical signal into an electrical signal, which is then transmitted to the main control unit via a cable. The main control unit analyzes the signal to obtain a near-infrared spectral image of the brain's functional area. However, if the photodiode is placed directly in the brain region being tested and connected to the main control unit via a cable, the weak electrical signal may be interfered with and noise during transmission due to factors such as distributed capacitance and inductance in the cable, changes in the external magnetic field environment, or relative movement of the cable. This reduces the accuracy of signal detection.

[0077] Addressing the issues of location conflicts or sharing between near-infrared signal acquisition and electroencephalogram (EEG) signal acquisition, as well as interference and noise during near-infrared signal transmission, this application proposes a multimodal brain signal acquisition device, such as... Figure 3 As shown, Figure 3 This is a schematic diagram of a multimodal brain signal acquisition device provided in an embodiment of this application. The multimodal brain signal acquisition device includes the multifunctional photoelectric signal acquisition sensor 10, the electroencephalogram (EEG) signal processor 30, and the optical signal processor 20 described in the above embodiment. In the multifunctional photoelectric signal acquisition sensor 10, near-infrared light signals are acquired by a near-infrared probe sensor, and EEG signals are acquired by an electrode needle or absorbent sponge. The near-infrared light signals are transmitted to the optical signal processor via optical fiber. The EEG signals acquired by contacting the scalp with the absorbent sponge or electrode needle are transmitted to the EEG signal processor via a PCB connected to the sensor body and a cable connected to the PCB.

[0078] The EEG signal processor 30 is used to condition the EEG signals acquired by the multifunctional photoelectric signal acquisition sensor; the optical signal processor 20 is used to convert the near-infrared light signals acquired by the multifunctional photoelectric signal acquisition sensor into analog signals and to condition the analog signals, including signal amplification and filtering.

[0079] This application utilizes a multifunctional photoelectric signal acquisition sensor to simultaneously acquire electroencephalogram (EEG) signals and near-infrared light signals for brain functional imaging, helping to resolve issues of location conflicts or shared use. The EEG signals acquired by the multifunctional photoelectric signal acquisition sensor are transmitted to an EEG signal processor for signal conditioning. The near-infrared light signals acquired by the multifunctional photoelectric signal acquisition sensor are transmitted via optical fiber to an optical signal processor, which converts the near-infrared light signals into analog signals and conditions them. Because optical fiber transmits optical signals, and its transmission principle is total internal reflection, the optical signals are not affected by external magnetic field changes, cable capacitance and inductance, relative cable movement, or other interference and noise during transmission. Furthermore, the loss during optical transmission is minimal, helping to solve interference and noise problems during near-infrared signal transmission and improving signal detection accuracy.

[0080] Optionally, the multimodal brain signal acquisition device can be a cap-shaped structure, a helmet-shaped structure, or a headband-shaped structure. Different structural designs can meet the needs of different application scenarios. For example, cap-shaped devices are typically designed to be lightweight and flexible, suitable for use in laboratory or clinical environments. They can be easily worn on the subject's head for long-term monitoring without affecting the subject's daily activities. Helmet-shaped devices are generally more robust and stable, suitable for use in industrial or field environments, such as construction site work or cycling safety, providing additional protection while integrating multiple sensors to monitor the working environment and the worker's physiological state. Headband-shaped devices are generally more comfortable and suitable for long-term wear. They are suitable for scenarios requiring continuous long-term monitoring of brain function, and the headband structure can also be easily adjusted in size to fit people with different head shapes.

[0081] In other alternative embodiments, such as Figure 4 As shown, Figure 4This is a schematic diagram of another multimodal brain signal acquisition device provided in an embodiment of this application. The EEG signal processor 30 includes an analog front-end processing module 31, a first amplifier module 32, and a first analog-to-digital converter 33. The analog front-end processing module 31 is used to denoise the EEG signal. The denoising process can be achieved by using high-pass and low-pass filters to remove baseline drift, power line interference, electrooculography interference, and head movement interference, or by using a band-pass filter to extract the effective frequency band of the EEG signal, thereby improving the accuracy and reliability of subsequent EEG signal processing and analysis. The first amplifier module 32 is used to amplify and filter the denoised EEG signal. The first analog-to-digital converter 33 is used to convert the amplified and filtered EEG signal into a first digital signal. The EEG signal processor 30 is also used to transmit the first digital signal to an external host computer. Figure 4 (Not shown in the image). The optical signal processor 20 includes a first photodiode 21, a second amplifier processing module 22, and a second analog-to-digital converter 23. The first photodiode 21 is used to convert near-infrared light signals into a first analog signal; the second amplifier processing module 22 is used to amplify and filter the first analog signal to obtain a second analog signal; the second analog-to-digital converter 23 is used to convert the second analog signal into a second digital signal, and the optical signal processor 20 is also used to transmit the second digital signal to an external host computer.

[0082] Since external host computers cannot directly process analog signals, only digital signals after analog-to-digital conversion can be further processed and analyzed by the host computer. Therefore, the EEG signal processor also includes a first analog-to-digital converter, which converts the amplified and filtered EEG signal into a first digital signal. Similarly, the optical signal processor includes a second analog-to-digital converter, which converts the second analog signal into a second digital signal. The EEG signal processor can transmit the first digital signal to an external host computer for presentation and further processing via wireless or wired means. Likewise, the optical signal processor can also transmit the second digital signal to an external host computer for presentation and further processing via wireless or wired means.

[0083] In some alternative embodiments, such as Figure 5 As shown, Figure 5 This is a schematic diagram of a near-infrared light signal processing flow provided in an embodiment of this application. The near-infrared probe sensor 102 includes a near-infrared sensor body 1021 and an optical fiber interface 1023. The near-infrared probe sensor 102 is connected to an optical fiber through the optical fiber interface 1023. A hollow light guide column is provided inside the near-infrared sensor body 1021. The light guide column is used to receive near-infrared light signals and guide them to the optical fiber interface 1023. Optionally, the light guide column and the optical fiber interface 1023 are connected using optical fiber fusion splicing technology, which can reduce light source loss.

[0084] In this embodiment, near-infrared light sources (light emitter / emitting light source) alternately illuminate, emitting near-infrared light to the brain region being tested. The unabsorbed near-infrared light is reflected or scattered by the light guide column of the near-infrared sensor body 1021, which guides the near-infrared light to the optical fiber interface 1023. The near-infrared light is then transmitted to the optical signal processor 20 via the optical fiber. At this time, a photodiode (i.e., the first photodiode 21) is located in the optical signal processor 20, away from the head. The first photodiode 21 can be located independently in the optical signal processor 20 or integrated into the second amplifier processing module 22. A near-infrared probe sensor 102, located near the head, collects the near-infrared light signal and guides it to the optical fiber interface 1023. The near-infrared light signal is transmitted to the optical signal processor 20 via the optical fiber, and subsequent signal processing is performed in the optical signal processor 20. Using optical fiber to transmit the near-infrared light signal ensures accuracy because the optical fiber's transmission principle is total internal reflection, preventing interference during signal transmission.

[0085] When the optical signal processor 20 receives the near-infrared light signal transmitted through the optical fiber, the first photodiode 21 converts the near-infrared light signal into an electrical signal (specifically, a first analog signal). The first analog signal is input to the second amplifier module 22 for signal amplification and filtering to obtain a second analog signal. Then, the second analog signal is converted into a second digital signal by the second analog-to-digital converter 23. Finally, the second digital signal is sent to the host computer for presentation and further processing via wired or wireless means.

[0086] In some alternative embodiments, such as Figure 6 As shown, Figure 6 This is a schematic diagram of another near-infrared light signal processing flow provided in an embodiment of this application. The near-infrared probe sensor 102 includes a near-infrared sensor body 1021, a pre-processing module 1022, and an optical fiber interface 1023. The near-infrared probe sensor 102 is connected to an optical fiber through the optical fiber interface 1023. A hollow light guide column is provided inside the near-infrared sensor body 1021. The light guide column is connected to the optical fiber interface 1023 through the pre-processing module 1022. The light guide column is used to receive near-infrared light signals and guide them to the pre-processing module 1022. The pre-processing module 1022 is used to preprocess the near-infrared light signals guided by the light guide column and output the preprocessed near-infrared light signals to the optical fiber interface. The light guide column and the pre-processing module 1022 are adjacent structures in the near-infrared probe sensor 102. There is no wire connection between the light guide column and the pre-processing module 1022, meaning that the light guide column directly guides the light reflected or scattered by the cerebral cortex to the pre-processing module 1022, thus eliminating interference from wires.

[0087] Optionally, such as Figure 7 As shown, Figure 7 This is a schematic diagram of a near-infrared sensor provided in an embodiment of this application. The near-infrared sensor 102 includes a near-infrared sensor body 1021, a front-end processing module 1022, and an optical fiber interface 1023. The front-end processing module 1022 includes a second photodiode 10221, a filtering unit 10222, a third analog-to-digital converter 10223, and a digital-to-optical converter 10224. Specifically, the second photodiode 10221 converts the near-infrared light signal guided by the light guide column within the near-infrared sensor body 1021 into a third analog signal; the filtering unit 10222 filters the third analog signal; the third analog-to-digital converter 10223 converts the filtered third analog signal into a third digital signal; and the digital-to-optical converter 10224 converts the third digital signal into an optical signal.

[0088] In this embodiment, near-infrared light sources (light source emitter / emitting light source) are alternately lit, emitting near-infrared light to the brain region being tested. The unabsorbed near-infrared light is reflected or scattered by the brain region and received by the light guide column of the near-infrared sensor body 1021. The light guide column guides the received near-infrared light to the pre-processing module 1022 adjacent to the light guide column. After preprocessing the near-infrared light, the pre-processing module 1022 outputs the preprocessed near-infrared light signal to the optical fiber interface 1023, and transmits the preprocessed near-infrared light signal to the optical signal processor 20 through the optical fiber.

[0089] The preprocessing module 1022 specifically preprocesses the near-infrared light signal by: using the second photodiode 10221 to convert the near-infrared light signal guided by the light guide post into an electrical signal (specifically, a third analog signal); then filtering the third analog signal through the filtering unit 10222 to remove noise; then converting the filtered third analog signal into a third digital signal through the third analog-to-digital converter 10223; and finally converting the third digital signal into an optical signal through the digital-to-optical converter 10224. At this point, the signal transmitted via optical fiber is a near-infrared light signal. Because the transmission principle of optical fiber is total internal reflection, the optical signal is not subject to interference during transmission, ensuring the accuracy of signal detection.

[0090] When the optical signal processor 20 receives the near-infrared light signal transmitted through the optical fiber, the first photodiode 21 converts the near-infrared light signal into an electrical signal (specifically, a first analog signal). The first analog signal is input to the second amplifier module 22 for signal amplification and filtering to obtain a second analog signal. Then, the second analog signal is converted into a second digital signal by the second analog-to-digital converter 23. Finally, the second digital signal is sent to the host computer for presentation and further processing via wired or wireless means.

[0091] In this embodiment, the near-infrared probe sensor preprocesses the acquired near-infrared light signal through a pre-processing module. The pre-processing module sequentially converts the light signal into an analog signal, then into a digital signal, and finally back into an optical signal. The preprocessed light signal is then transmitted via optical fiber to an optical signal processor for further signal processing. Because the near-infrared probe performs pre-processing first, the photodiode (i.e., the second photodiode) in the pre-processing module is closer to the brain region being measured, resulting in higher accuracy in receiving and processing the light signal. Therefore, this method is suitable for applications requiring deeper brain region detection.

[0092] Optionally, the second photodiode has a higher sensitivity than the first photodiode. For example, the second photodiode could be an avalanche photodiode (APD), which internally amplifies the light signal, providing higher sensitivity than a conventional photodiode. The second photodiode is located near the near-infrared probe sensor close to the brain region being tested, while the first photodiode is located in the light signal processor far from the head. The higher sensitivity of the second photodiode improves the accuracy of the light signal obtained after pre-processing.

[0093] Optionally, the front-end processing module further includes a data verification mechanism unit, which is used to add a preset data verification mechanism to the third digital signal; correspondingly, the optical signal processor further includes a data verification mechanism verification unit, which is used to verify whether the second digital signal conforms to the preset data verification mechanism.

[0094] Digital verification refers to the process of ensuring the accuracy, integrity, and validity of data during transmission, storage, or processing. Data verification mechanisms can include parity check, cyclic redundancy check, checksum, etc. Parity check ensures that the total number of 1s in the data is either odd (odd parity) or even (even parity) by adding an extra bit (parity bit). This method can detect single-bit errors but cannot detect an even number of bit errors. Cyclic redundancy check treats the data as a large binary number and performs division using a predefined polynomial (generator polynomial). The remainder is appended to the data. The receiver uses the same polynomial for verification; if the remainder is 0, the data is considered error-free. Checksum is a numerical value obtained by performing arithmetic or logical operations on a block of data. This value is appended to the data. The receiver performs the same operation on the received data and compares it with the transmitted checksum to detect whether the data has been tampered with during transmission. These verification mechanisms can be used individually or in combination to provide different levels of error detection and correction capabilities.

[0095] Taking the checksum data verification mechanism as an example, in the data verification mechanism unit of the front-end processing module, arithmetic or logical operations are performed on the third digital signal to obtain the first check value. After the first check code and the third digital signal are integrated, they are converted into an optical signal by a digital-to-optical converter and then transmitted to the optical signal processor through optical fiber. In the optical signal processor, the optical signal is sequentially converted into a first analog signal, amplified and filtered to obtain a second analog signal, and then converted into a second digital signal. Next, the data verification mechanism verification unit performs the same mathematical operations on the second digital signal to obtain the second check value. The first check value and the second check value are compared. If they are the same, it means that the second digital signal conforms to the checksum data verification mechanism, and the second digital signal is accurate, complete, and valid. By introducing a data verification mechanism, the accuracy, completeness, and validity of data during transmission and processing can be verified.

[0096] Optionally, the outer layer of the optical fiber is provided with a fully enclosed fiber core cladding, which can effectively prevent interference from external light sources.

[0097] Optionally, the diameter of the light guide post is larger than the diameter of the fiber optic interface. Since the near-infrared light reflected or scattered by the cerebral cortex is relatively weak, a larger diameter light guide post receives more near-infrared light. However, the diameter of the light guide post needs to match the fiber optic interface to ensure effective light transmission. If the diameter of the light guide post is too large, it may lead to increased light loss at the fiber optic interface. In Example 1, the light guide post and the fiber optic interface are connected using fiber optic fusion splicing technology, which can reduce light source loss. In Example 2, the light guide post is connected to the fiber optic interface through a pre-processing module. The light guide post can also be configured as a retractable structure, allowing adjustment of the distance between the near-infrared probe sensor and the cerebral cortex, making the light guide post closer to the subject's brain region and enabling it to receive more near-infrared light.

[0098] The multimodal brain signal acquisition device provided in this application can simultaneously acquire electroencephalogram (EEG) signals and near-infrared light signals through a multifunctional photoelectric signal acquisition sensor, which helps to solve the problems of point conflicts or sharing. The EEG signals acquired by the multifunctional photoelectric signal acquisition sensor are transmitted to an EEG signal processor for signal conditioning. The near-infrared light signals acquired by the multifunctional photoelectric signal acquisition sensor are transmitted to an optical signal processor via optical fiber. The optical signal processor converts the near-infrared light signals into analog signals and conditions the analog signals. Because optical fiber transmits optical signals, and the transmission principle of optical fiber is total internal reflection, the optical signals are not affected by external magnetic field changes, distributed capacitance and inductance of cables, relative movement of cables, or other interference and noise during transmission. Furthermore, the loss during optical transmission is relatively small, which helps to solve the interference and noise problems in the near-infrared signal transmission process and improves the accuracy of signal detection.

[0099] Figure 3 The multimodal brain signal acquisition device shown includes a multifunctional photoelectric signal acquisition sensor. In other optional embodiments, the multimodal brain signal acquisition device may also include multiple multifunctional photoelectric signal acquisition sensors and multiple emission light sources. Each emission light source corresponds to multiple multifunctional photoelectric signal acquisition sensors (specifically, near-infrared probe sensors within the multifunctional photoelectric signal acquisition sensors). Multiple multifunctional photoelectric signal acquisition sensors and multiple emission light sources form different multi-channel interfaces, and different multi-channel interfaces form different detection components. Different detection components correspond to different detection areas of the user's brain. The multimodal brain signal acquisition device may also include a control circuit 40, which is used to send control signals to the detection components. The emission light sources are used to sequentially illuminate according to the control signals to send near-infrared light signals to the detection areas. The near-infrared probe sensors within the multifunctional photoelectric signal acquisition sensors are used to receive near-infrared light signals reflected or scattered by the detection areas. A channel is formed between the emission light source and each connected near-infrared probe sensor.

[0100] In the embodiments of this application, different multi-channel interfaces can form different detection components. These detection components are correspondingly positioned in different detection areas of the user's brain. The control circuit 40 sends control signals to the detection components, and the detection components respond to the control signals by acquiring detection signals from the corresponding detection areas and outputting the detection signals. By using different detection components to detect signals from different detection areas, the layout of the detection components is flexible, and the signal acquisition methods are diverse, thereby meeting diverse user needs.

[0101] Figure 8 A schematic diagram of the structure of another multimodal brain signal acquisition device provided in the embodiments of this application is shown below. Figure 8 As shown, as an optional solution, the multimodal brain signal acquisition device includes multiple multi-channel interfaces and a control circuit 40. The multiple multi-channel interfaces include a first multi-channel interface 11, a second multi-channel interface 12, a third multi-channel interface 13, and a fourth multi-channel interface 14. In practical applications, the number of multi-channel interfaces can be set as needed, and this embodiment does not limit this.

[0102] In this embodiment, different multi-channel interfaces from multiple multi-channel interfaces can be combined to form different detection components. Optionally, if the first multi-channel interface 11 forms a detection component, the detection area corresponding to the detection component includes the frontal lobe region; or, if the second multi-channel interface 12 forms a detection component, the detection area corresponding to the detection component includes the occipital lobe region; or, if the third multi-channel interface 13 and the fourth channel interface 14 form a detection component, the detection area corresponding to the detection component includes the parietal lobe region.

[0103] In one alternative embodiment, Figure 9A schematic diagram of the structure of another multimodal brain signal acquisition device provided in the embodiments of this application is shown below. Figure 9 As shown, the first multi-channel interface 11 forms the detection component 51, the second multi-channel interface 12 forms the detection component 52, and the third multi-channel interface 13 and the fourth multi-channel interface 14 form the detection component 53. The control circuit 40 includes a main control chip 41 and a detection component selection control unit 42. The detection component selection control unit 42 is used to select one or more of the multiple detection components for the acquisition of near-infrared brain functional imaging signals.

[0104] For example, if the multimodal brain signal acquisition device needs to acquire brain signals from the frontal lobe region, it can select the detection component 51 formed by the first multi-channel interface 11 for signal acquisition; if it needs to acquire brain signals from the occipital lobe region, it can select the detection component 52 formed by the second multi-channel interface 12 for signal acquisition; if it needs to acquire brain signals from the parietal lobe region, it can select the detection component 53 formed by the third multi-channel interface 13 and the fourth multi-channel interface 14 for signal acquisition; if it needs to acquire brain signals from both the frontal and parietal lobe regions, it can select the detection component 51 formed by the first multi-channel interface 11 and the third multi-channel interface 14. The detection component 53 formed by the third and fourth multi-channel interfaces 13 and 14 is used for signal acquisition. If it is necessary to acquire brain signals from the parietal and occipital regions, the detection component 52 formed by the second multi-channel interface 12 and the detection component 53 formed by the third and fourth multi-channel interfaces 13 and 14 can be selected for signal acquisition. If it is necessary to acquire brain signals from the frontal, parietal, and occipital regions, the detection component 51 formed by the first multi-channel interface 11, the detection component 52 formed by the second multi-channel interface 12 and the detection component 53 formed by the third and fourth multi-channel interfaces 13 and 14 can be selected for signal acquisition.

[0105] Optionally, the detection component gating control unit 42 includes multiple switching components ( Figure 9 (Not shown in the diagram), the switching components and detection components correspond one-to-one. The main control chip 41 is used to send selection signals to multiple switching components, and control one or more switching components to connect with the corresponding detection components through the selection signals.

[0106] For example, detection component 51 corresponds to the first switch component, detection component 52 corresponds to the second switch component, and detection component 53 corresponds to the third switch component. When the activating signal controls the first switch component to connect with the corresponding detection component 51, the detection component 51 can be used to acquire near-infrared brain functional imaging signals of the frontal lobe region; or when the activating signal controls the first switch component to connect with the corresponding detection component 51 and the detection component 53 corresponding to the third switch, the detection components 51 and 53 can be used to acquire brain signals of the frontal and parietal lobe regions.

[0107] In the embodiments of this application, the detection component selection control unit can select brain signals from different detection areas, such as collecting brain signals from only the frontal lobe region or collecting brain signals from the entire brain region. Users can select to collect brain signals from one or more detection areas according to actual needs, providing flexible signal acquisition and meeting diverse signal acquisition requirements. Furthermore, the control circuit can also control the multifunctional photoelectric signal acquisition sensor to collect only EEG signals, only near-infrared light signals, or both EEG signals and near-infrared light signals in a certain detection area.

[0108] Figure 10 This is a schematic diagram of a control circuit provided in an embodiment of this application. Figure 11 for Figure 8 A schematic diagram of the specific structure of the multimodal brain signal acquisition device; such as Figure 10 and Figure 11 As shown, the control signals include power control signals and lighting control signals. The control circuit 40 includes a main control chip 41, a detection component gating control unit 42, and a control module 43. The control module 43 is connected between the main control chip 41 and the multi-channel interface. The control module 43 is used to receive signals from the host computer (…). Figure 11 The control module 43 is also used to receive a lighting signal sent by the host computer, generate a lighting control signal based on the lighting signal, and send the lighting control signal to the corresponding transmitting light source; the control module 43 is also used to receive a lighting signal sent by the host computer, generate a lighting control signal based on the lighting signal, and output the lighting control signal to the corresponding transmitting light source.

[0109] Optionally, the lighting signal includes a first lighting signal and a second lighting signal, and the lighting control signal includes a first lighting control signal and a second lighting control signal. The control module 43 includes: a first MUX, multiple range resistors, a second MUX, and a third MUX. The first MUX is connected between the main control chip 41 and the multiple range resistors, the second MUX is connected between the multiple range resistors and multiple multi-channel interfaces (including multiple emitting light sources), and the third MUX is connected between the main control chip 41 and the multiple multi-channel interfaces (including multiple emitting light sources). Figure 11As shown, the main control chip 41 sends a power selection signal to the first MUX; the first MUX generates a gear selection signal based on the power selection signal, and outputs a power control signal to the second MUX through the gear selection resistor corresponding to the gear selection signal; the second MUX outputs the power control signal to multiple emitting light sources, and the power control signal is used to control the power of the multiple emitting light sources; the second MUX outputs a first lighting control signal to the corresponding emitting light source based on the first lighting signal output by the main control chip 41; the third MUX outputs a second lighting control signal to the corresponding emitting light source based on the second lighting signal output by the main control chip 41. For example, the number of gear resistors can be four, and the multiple gear resistors can include gear resistor L0, gear resistor L1, gear resistor L2, and gear resistor L3.

[0110] The following combination Figure 10 and Figure 11 The working process of the multimodal brain signal acquisition device according to the embodiments of this application will be described in detail.

[0111] Currently, to ensure the multimodal brain signal acquisition device can fit different head circumferences, two different sizes of caps are available, each with a different distance between the emitting light source and the near-infrared sensor. To prevent insufficient signal acquisition depth at greater distances, a power switching function has been added to the control circuit 40, providing multiple power levels. For example, the control circuit 40 has four power levels: high, relatively high, medium, and low. When the distance between the emitting light source and the near-infrared sensor is greater, the control circuit 40 can set the power of the emitting light source to high or relatively high; when the distance is moderate, it can set the power of the emitting light source to medium or low, thereby reducing the transmission power, saving power consumption, and extending the usage time. For example, the power of the emitting light source can be determined based on the distance between the emitting light source and the near-infrared sensor. The four power levels correspond to four resistor levels: high power corresponds to resistor L0, higher power to resistor L1, medium power to resistor L2, and low power to resistor L3. For instance, if the distance between the emitting light source and the near-infrared sensor is 40mm, the power of the emitting light source can be set to high or higher power; if the distance is 25mm, the power of the emitting light source can be set to medium or low power.

[0112] The user inputs a power selection signal into the host computer. For example, if the user selects high power, they input a high power selection signal into the host computer. The host computer sends this power selection signal to the main control chip 41, which then sends it to the first MUX. The first MUX generates a gear selection signal based on the power selection signal. For example, if the power selection signal is for high power, the gear selection signal can be 1000. In this case, the gear selection signal 1000 corresponds to the gear resistor L0. The first MUX is electrically connected to the second MUX through the gear resistor L0, and the power control current flows to the second MUX through the gear resistor L0, allowing the first MUX to output a power control signal to the second MUX through the gear resistor L0. Alternatively, if the power selection signal is for higher power, the gear selection signal can be 0100. In this case, the gear selection signal 0100 corresponds to the gear resistor L1, and the first MUX is electrically connected to the second MUX through the gear resistor L1. The power control current flows to the second MUX through the gear resistor L1, allowing the first MUX to output a power control signal to the second MUX through the gear resistor L0. Resistor L1 outputs a power control signal to the second MUX. For example, if the power selection signal is for medium power, the gear selection signal can be 0010. In this case, gear selection signal 0010 corresponds to gear resistor L2. The first MUX is electrically connected to the second MUX through gear resistor L2, and the power control current flows to the second MUX through gear resistor L2, allowing the first MUX to output a power control signal through gear resistor L2. Similarly, if the power selection signal is for low power, the gear selection signal can be 0001. In this case, gear selection signal 0001 corresponds to gear resistor L3, and the first MUX is electrically connected to the second MUX through gear resistor L3. The power control current flows to the second MUX through gear resistor L3, allowing the first MUX to output a power control signal through gear resistor L3. Because the resistance values ​​of different gear resistors are different, the magnitude of the control current flowing through different gear resistors is different, resulting in different magnitudes of the power control signals sent from the first MUX to the second MUX. Therefore, through user selection on the host computer, the first MUX can control the switching between different power levels.

[0113] The second MUX is used to output a power control signal to multiple emitting light sources, which can be used to control the power of the multiple emitting light sources. The main control chip outputs a first lighting signal to the second MUX, and the second MUX outputs a first lighting control signal to the corresponding emitting light source according to the first lighting signal; the main control chip outputs a second lighting signal to the third MUX, and the third MUX outputs a second lighting control signal to the corresponding emitting light source according to the second lighting signal. Each emitting light source includes a first light source and a second light source. The first and second light sources emit near-infrared light with different wavelengths. The first and second light sources of each emitting light source are lit sequentially according to the first and second lighting control signals, thus allowing the emitting light sources to light up alternately.

[0114] Figure 12 This is a schematic diagram of the illumination of a light source provided in an embodiment of this application, as shown below. Figure 12 As shown, the second MUX includes a first switch K1, and the third MUX includes a second switch K2. The main control chip 41 outputs a first lighting signal to the second MUX through pins A0-A3 and a second lighting signal to the third MUX through pins A0-A3. In addition, the main control chip 41 also outputs an enable signal to the EN pin of the second and third MUX to enable the second and third MUX to start working.

[0115] Under the control of the first lighting signal, the first switch K1 connects the first light source RED1 to the low voltage terminal, for example, the low voltage terminal is the ground terminal, so that the first lighting control signal output by the second MUX to the first light source RED1 is at a low level. At this time, the level of the first light source RED1 is pulled low, and the first light source RED1 lights up under the control of the low level. Under the control of the second lighting signal, the second switch K2 connects the second light source RED2 to the high voltage terminal Vdd, so that the second lighting control signal output by the third MUX to the second light source RED2 is at a high level. At this time, the level of the second light source RED2 is pulled high, and the second light source RED2 turns off under the control of the high level.

[0116] Then, under the control of the first lighting signal, the first switch K1 connects the second light source RED2 to the low voltage terminal, so that the first lighting control signal output by the second MUX to the second light source RED2 is at a low level. At this time, the level of the second light source RED2 is pulled low, and the second light source RED2 lights up under the control of the low level. Under the control of the second lighting signal, the second switch K2 connects the first light source RED1 to the high voltage terminal Vdd, so that the second lighting control signal output by the third MUX to the first light source RED1 is at a high level. At this time, the level of the first light source RED1 is pulled high, and the first light source RED1 turns off under the control of the high level.

[0117] Therefore, when the first light source RED1 is lit, the voltage level of the second light source RED2 is pulled high, ensuring that the second light source RED2 is completely turned off; conversely, when the second light source RED2 is lit, the voltage level of the first light source RED1 is pulled high, ensuring that the first light source RED1 is completely turned off. Using this method, the first and second light sources of each emitting light source are lit sequentially. During the switching process, by pulling high the voltage level of the previous emitting light source, accidental emission of the previous emitting light source due to leakage current is prevented.

[0118] The technical solution provided in this application includes a multimodal brain signal acquisition device comprising multiple multifunctional photoelectric signal acquisition sensors and multiple emission light sources. These sensors and light sources form different multi-channel interfaces, which in turn form different detection components. Each detection component corresponds to a different detection region of the user's brain. The device also includes a control circuit that sends control signals to the detection components. The detection components respond to these control signals and acquire brain signals from the corresponding detection region. This application utilizes different multi-channel interfaces to form different detection components and detects brain signals from different detection regions using these components. The flexible layout of the detection components and the diverse signal acquisition methods cater to a wide range of user needs.

[0119] In this embodiment, different detection components can detect brain signals in different detection regions, thereby improving the flexibility of multi-region signal monitoring.

[0120] In this embodiment, the main control chip sends a power selection signal to the first multiplexer. The first multiplexer generates a gear selection signal based on the power selection signal and outputs a power control signal to the second multiplexer through the gear selection resistor corresponding to the gear selection signal. The second multiplexer outputs the power control signal to multiple transmitting light sources, thereby realizing the control of the power of the transmitting light sources through the power control signal.

[0121] In this embodiment, by pulling up the level of the previous light source, it is ensured that when the current light source is lit, the previous light source is completely turned off, thereby preventing crosstalk, ensuring that only one light source is lit, and preventing the previous light source from emitting light accidentally due to leakage current.

[0122] This application also provides a multimodal brain signal acquisition system, including the multimodal brain signal acquisition device and host computer (also referred to as the main control terminal) shown in the above embodiments, or the multimodal brain signal acquisition system includes the multifunctional photoelectric signal acquisition sensor and host computer shown in the above embodiments. The host computer is used to analyze the electrical signal conditioned by the optical signal processor to obtain the near-infrared spectrum, or to analyze the EEG signal conditioned by the EEG signal processor to obtain the electroencephalogram (EEG). Optionally, the host computer can be an electronic device such as a desktop computer, tablet computer, laptop computer, or PDA.

[0123] The above description is merely a specific embodiment of this application. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application. The protection scope of this application should be determined by the protection scope of the claims.

Claims

1. A multifunctional photoelectric signal acquisition sensor, characterized in that, The multifunctional photoelectric signal acquisition sensor, used for simultaneously acquiring electroencephalogram (EEG) signals and near-infrared light signals for brain functional imaging, includes: The sensor body has a built-in near-infrared probe sensor for detecting near-infrared light signals reflected or scattered by the cerebral cortex; there is a groove between the near-infrared probe sensor and the sensor body for placing an absorbent sponge, which passes through the sensor body and contacts the scalp to collect electroencephalogram (EEG) signals. Multiple electrode needles are arranged circumferentially along the port of the sensor body near the scalp, and the electrode needles are in contact with the scalp to collect electroencephalogram (EEG) signals.

2. The multifunctional photoelectric signal acquisition sensor according to claim 1, characterized in that, The electrode needle is an elastic structure that can extend and retract along the sensor body; and / or, The inner wall of the groove is coated with a metal layer.

3. A multimodal brain signal acquisition device, characterized in that, Includes one or more multifunctional photoelectric signal acquisition sensors, electroencephalogram (EEG) signal processors, and optical signal processors as described in any one of claims 1-2; The near-infrared light signal acquired by the multifunctional photoelectric signal acquisition sensor is transmitted to the optical signal processor via optical fiber; The EEG signal processor is used to condition the EEG signals acquired by the multifunctional photoelectric signal acquisition sensor; the optical signal processor is used to convert the near-infrared light signals acquired by the multifunctional photoelectric signal acquisition sensor into analog signals, and to condition the analog signals, the conditioning including signal amplification and filtering.

4. The apparatus according to claim 3, characterized in that, The EEG signal processor includes an analog front-end processing module, a first amplifier module, and a first analog-to-digital converter. The analog front-end processing module is used to perform denoising processing on the EEG signal, and the denoising processing includes at least removing baseline drift, power line interference, and electrooculography (EOG) interference. The first amplifier module is used to amplify and filter the denoised EEG signal. The first analog-to-digital converter is used to convert the amplified and filtered EEG signal into a first digital signal. The EEG signal processor is also used to transmit the first digital signal to an external host computer. The optical signal processor includes a first photodiode, a second amplifier processing module, and a second analog-to-digital converter. The first photodiode is used to convert near-infrared light signals into a first analog signal. The second amplifier processing module is used to amplify and filter the first analog signal to obtain a second analog signal. The second analog-to-digital converter is used to convert the second analog signal into a second digital signal. The optical signal processor is also used to transmit the second digital signal to an external host computer.

5. The apparatus according to claim 4, characterized in that, The near-infrared probe sensor includes a near-infrared sensor body and an optical fiber interface, and the near-infrared probe sensor is connected to the optical fiber through the optical fiber interface; The near-infrared sensor body has a hollow light guide column, which is used to receive near-infrared light signals and guide them to the optical fiber interface.

6. The apparatus according to claim 5, characterized in that, The near-infrared probe sensor also includes a pre-processing module; the light guide column is connected to the optical fiber interface through the pre-processing module. The pre-processing module is used to preprocess the near-infrared light signal guided by the light guide post and output the preprocessed near-infrared light signal to the optical fiber interface.

7. The apparatus according to claim 6, characterized in that, The front-end processing module includes a second photodiode, a filtering unit, a third analog-to-digital converter, and a digital-to-optical converter; The second photodiode is used to convert the near-infrared light signal guided by the light guide post into a third analog signal; The filtering unit is used to filter the third analog signal; The third analog-to-digital converter is used to convert the filtered third analog signal into a third digital signal; The digital-to-optical converter is used to convert the third digital signal into an optical signal; and / or, The sensitivity of the second photodiode is higher than that of the first photodiode; and / or, The front-end processing module further includes a data verification mechanism unit, which is used to add a preset data verification mechanism to the third digital signal. The optical signal processor further includes a data verification mechanism verification unit, used to verify whether the second digital signal conforms to the preset data verification mechanism.

8. The apparatus according to claim 7, characterized in that, The light guide post and the optical fiber interface are connected using optical fiber fusion splicing technology; and / or The light guide column is a retractable structure used to adjust the distance between the near-infrared probe sensor and the cerebral cortex.

9. The apparatus according to claim 4, characterized in that, The first photodiode is either separately located in the optical signal processor or integrated into the second amplifier processing module.

10. The apparatus according to claim 3, characterized in that, The device is a hat-type structure, a helmet structure, or a headband structure; and / or, When there are multiple multifunctional photoelectric signal acquisition sensors, the device further includes a control circuit and multiple emitting light sources, each emitting light source corresponding to multiple multifunctional photoelectric signal acquisition sensors; The multiple multifunctional photoelectric signal acquisition sensors and the multiple emission light sources form different multi-channel interfaces, and the different multi-channel interfaces form different detection components, which correspond to different detection areas of the user's brain. The control circuit is used to send control signals to the detection component.

11. The apparatus according to claim 10, characterized in that, The control circuit includes a detection component selection control unit, which is used to select one or more of a plurality of detection components for brain signal acquisition.

12. The apparatus according to claim 11, characterized in that, The detection component selection control unit includes multiple switching components, and each switching component corresponds to a detection component. The control circuit includes a main control chip, which is used to send a gating signal to the plurality of switching components, and control one or more switching components to connect with the corresponding detection component through the gating signal.

13. The apparatus according to claim 11, characterized in that, The control signals include power control signals and lighting control signals. The control circuit also includes a main control chip and a control module, with the control module connected between the main control chip and the multi-channel interface. The control module is configured to receive a power selection signal sent by a host computer, generate a power control signal based on the power selection signal, and send the power control signal to the plurality of emitting light sources; receive a lighting signal sent by a host computer, generate a lighting control signal based on the lighting signal, and output the lighting control signal to the corresponding emitting light source.

14. The apparatus according to claim 13, characterized in that, The lighting signal includes a first lighting signal and a second lighting signal, and the lighting control signal includes a first lighting control signal and a second lighting control signal; the control module includes: a first multiplexer, multiple level resistors, a second multiplexer, and a third multiplexer, wherein the first multiplexer is connected between the main control chip and the multiple level resistors, the second multiplexer is connected between the multiple level resistors and the multiple emitting light sources, and the third multiplexer is connected between the main control chip and the multiple emitting light sources; The main control chip is used to send a power selection signal to the first multiplexer; The first multiplexer is used to generate a gear selection signal based on the power selection signal, and output a power control signal to the second multiplexer through the gear selection resistor corresponding to the gear selection signal; The second multiplexer is used to output the power control signal to the plurality of emitting light sources, and the power control signal is used to control the power of the plurality of emitting light sources; The second multiplexer is used to output the first lighting control signal to the corresponding emitting light source according to the first lighting signal output by the main control chip; The third multiplexer is used to output the second lighting control signal to the corresponding emitting light source according to the second lighting signal output by the main control chip.

15. The apparatus according to claim 10, characterized in that, The multi-channel interface includes a first multi-channel interface, a second multi-channel interface, a third multi-channel interface, and a fourth multi-channel interface; If the first multi-channel interface forms a detection component, the detection area corresponding to the detection component includes the frontal lobe region; or, If the second multi-channel interface forms a detection component, the detection area corresponding to the detection component includes the occipital lobe region; or... If the third multi-channel interface and the fourth multi-channel interface form a detection component, the detection area corresponding to the detection component includes the top leaf region.

16. A multimodal brain signal acquisition system, characterized in that, The system includes a multimodal brain signal acquisition device and a host computer as described in any one of claims 3-15, or a multifunctional photoelectric signal acquisition sensor and a host computer as described in any one of claims 1-2.

Images