Multifunctional photoelectric signal acquisition sensor and multi-mode brain signal acquisition device

Abstract

The invention provides a multifunctional photoelectric signal acquisition sensor and a multi-mode brain signal acquisition device and system.The multifunctional photoelectric signal acquisition sensor comprises a sensor body, a near-infrared probe sensor is arranged in the sensor body, and the near-infrared probe sensor is used for detecting near-infrared light signals reflected or scattered by the cerebral cortex; a groove is formed between the near-infrared probe sensor and the sensor body, the groove is used for placing a water-absorbing sponge, and the water-absorbing sponge penetrates through the sensor body to be in contact with scalp so as to collect electroencephalogram signals; each electrode needle is arranged along the circumference of a port, close to one side of the scalp, of the sensor body, and the electrode needles make contact with the scalp so as to collect electroencephalogram signals. The multifunctional photoelectric signal acquisition sensor provided by the invention is helpful for simultaneously acquiring electroencephalogram signals and near-infrared light signals, and solves the problem of point location conflict or sharing.

Description

Technical Field

[0001] The present application relates to the technical field of brain signal acquisition, and in particular to a multifunctional photoelectric signal acquisition sensor, a multimodal brain signal acquisition device and a system. Background Art

[0002] Multimodal synchronous monitoring methods of brain states are widely used in brain function research. In multimodal monitoring, the combination of functional near-infrared spectroscopy and electroencephalography has received increasing attention. The EEG signal acquisition system has standard points, and the near-infrared light signal has a standard measurement brain area. When measuring, there will be point conflicts or sharing problems between the EEG signal and the near-infrared light signal. Summary of the invention

[0003] The present application provides a multifunctional photoelectric signal acquisition sensor, a multimodal brain signal acquisition device and a system, which are helpful for simultaneously collecting EEG signals and near-infrared light signals, and solving the problem of point conflicts or sharing.

[0004] In a first aspect, the present application provides a multifunctional photoelectric signal acquisition sensor for simultaneously acquiring electroencephalographic signals and near-infrared light signals for brain function imaging, comprising:

[0005] The sensor body has a built-in near-infrared probe sensor, which is used to detect near-infrared light signals reflected or scattered by the cerebral cortex; there is a groove between the near-infrared probe sensor and the sensor body, and the groove is used to place a water-absorbing sponge, which passes through the sensor body and contacts the scalp to collect EEG signals;

[0006] A plurality of electrode needles are arranged along the circumference of a port of the sensor body close to the scalp, and the electrode needle contacts the scalp to collect brain electrical signals.

[0007] In one possible implementation, the electrode needle is an elastic structure and can be extended and retracted along the sensor body; and / or the inner wall of the groove is provided with a metal coating.

[0008] In a second aspect, the present application provides a multimodal brain signal acquisition device, comprising: a multifunctional photoelectric signal acquisition sensor, an electroencephalogram signal processor, and an optical signal processor as shown in the first aspect;

[0009] The near-infrared light signal collected by the multifunctional photoelectric signal collection sensor is transmitted to the optical signal processor via optical fiber;

[0010] The EEG signal processor is used to condition the EEG signals collected by the multifunctional photoelectric signal acquisition sensor; the optical signal processor is used to convert the near-infrared light signals collected by the multifunctional photoelectric signal acquisition sensor into analog signals and condition the analog signals, and the conditioning includes signal amplification and filtering processing.

[0011] In one possible implementation, the EEG signal processor includes an analog front-end processing module, a first amplifier module and a first analog-to-digital converter, the analog front-end processing module is used to perform denoising on the EEG signal, the denoising process at least includes removing baseline drift, power frequency interference and electrooculographic interference; the first amplifier module is used to amplify and filter the EEG signal after denoising; the first analog-to-digital converter is used to convert the EEG signal after signal amplification and filtering into a first digital signal, and the EEG signal processor is also used to transmit the first digital signal to an external host computer;

[0012] The optical signal processor includes a first photodiode, a second amplifier processing module and a second analog-to-digital converter. The first photodiode is used to convert a near-infrared light signal into a first analog signal; the second amplifier processing module is used to amplify and filter the first analog signal to obtain a second analog signal; the second analog-to-digital converter is used to convert the second analog signal into a second digital signal. The optical signal processor is also used to transmit the second digital signal to an external host computer.

[0013] In one possible implementation, the near infrared probe sensor includes a near infrared sensor body and an optical fiber interface, and the near infrared probe sensor is connected to the optical fiber through the optical fiber interface;

[0014] A hollow light guide column is arranged in the body of the near-infrared sensor, and the light guide column is used to receive the near-infrared light signal and guide it to the optical fiber interface.

[0015] In one possible implementation, the near-infrared probe sensor further includes a pre-processing module;

[0016] The light guide is connected to the optical fiber interface through the pre-processing module

[0017] The pre-processing module is used to pre-process the near-infrared light signal guided by the light guide column, and output the pre-processed near-infrared light signal to the optical fiber interface.

[0018] In one possible implementation, the pre-processing module includes a second photodiode, a filter unit, a third analog-to-digital converter, and a digital-to-optical converter;

[0019] The second photodiode is used for converting the near-infrared light signal guided by the light-guiding column into a third analog signal;

[0020] The filtering unit is used to perform filtering processing on the third analog signal;

[0021] The third analog-to-digital converter is used to convert the filtered third analog signal into a third digital signal;

[0022] The digital-to-optical converter is used to convert the third digital signal into an optical signal; and / or,

[0023] The sensitivity of the second photodiode is higher than the sensitivity of the first photodiode; and / or,

[0024] The pre-processing module further includes a data verification mechanism unit, which is used to add a preset data verification mechanism to the third digital signal;

[0025] The optical signal processor also includes a data verification mechanism verification unit, which is used to verify whether the second digital signal complies with a preset data verification mechanism.

[0026] In one possible implementation, the light guide column and the optical fiber interface are connected by optical fiber fusion splicing technology; and / or the light guide column is a retractable structure for adjusting the distance between the near-infrared probe sensor and the cerebral cortex.

[0027] In one possible implementation manner, the first photodiode is separately provided in the optical signal processor, or is integrated in the second amplifier processing module.

[0028] In one possible implementation, the device is a cap-type structure, a helmet structure, or a headband structure; and / or,

[0029] When there are multiple multifunctional photoelectric signal acquisition sensors, the device further includes a control circuit and multiple emitting light sources, each emitting light source corresponds to multiple multifunctional photoelectric signal acquisition sensors;

[0030] A plurality of multifunctional photoelectric signal acquisition sensors and a plurality of emitting light sources form different multi-channel interfaces, and different multi-channel interfaces form different detection components, and different detection components correspond to different detection areas of the user's brain;

[0031] The control circuit is used to send a control signal to the detection component.

[0032] In one possible implementation, the control circuit includes a detection component gating control unit, which is used to select one or more groups of multiple detection components to collect brain signals.

[0033] In one possible implementation, the detection component gating control unit includes a plurality of switch components, and the switch components correspond to the detection components one by one;

[0034] The control circuit includes a main control chip, which is used to send a selection signal to multiple switch components, and control one or more switch components to be connected to corresponding detection components through the selection signal.

[0035] In one possible implementation, the control signal includes a power control signal and a lighting control signal, the control circuit also includes a main control chip and a control module, and the control module is connected between the main control chip and the multi-channel interface;

[0036] The control module is used to receive a power selection signal sent by the host computer, generate a power control signal according to the power selection signal and send the power control signal to multiple emitting light sources; receive a lighting signal sent by the host computer, generate a lighting control signal according to the lighting signal and output the lighting control signal to the corresponding emitting light sources.

[0037] In one possible implementation, the lighting signal includes a first lighting signal and a second lighting signal, and the lighting control signal includes a first lighting control signal and a second lighting control signal; the control module includes: a first multiplexer, a plurality of gear resistors, a second multiplexer and a third multiplexer, the first multiplexer is connected between the main control chip and the plurality of gear resistors, the second multiplexer is connected between the plurality of gear resistors and the plurality of emitting light sources, and the third multiplexer is connected between the main control chip and the plurality of emitting light sources;

[0038] A main control chip, used for sending a power selection signal to the first multiplexer;

[0039] A first multiplexer, configured to generate a gear selection signal according to the power selection signal, and output a power control signal to the second multiplexer through a gear resistor corresponding to the gear selection signal;

[0040] A second multiplexer, used to output a power control signal to the multiple emitting light sources, the power control signal being used to control the power of the multiple emitting light sources;

[0041] A second multiplexer, configured to output a first lighting control signal to a corresponding emitting light source according to a first lighting signal output by the main control chip;

[0042] The third multiplexer is used to output a second lighting control signal to the corresponding emitting light source according to the second lighting signal output by the main control chip.

[0043] In one possible implementation, the multi-channel interface includes a first multi-channel interface, a second multi-channel interface, a third multi-channel interface, and a fourth multi-channel interface;

[0044] If the first multi-channel interface forms a detection component, the detection area corresponding to the detection component includes the frontal lobe area; or,

[0045] If the second multi-channel interface forms a detection component, the detection area corresponding to the detection component includes the occipital lobe area; or,

[0046] If the third multi-channel interface and the fourth channel interface form a detection component, the detection area corresponding to the detection component includes the parietal lobe area.

[0047] In a third aspect, the present application provides a multimodal brain signal acquisition system, comprising the multimodal brain signal acquisition device and a host computer as shown in the second aspect, or, comprising the multifunctional optoelectronic signal acquisition sensor and a host computer as shown in the first aspect.

[0048] Compared with the prior art, this application has at least the following technical effects:

[0049] The present application provides a multifunctional photoelectric signal acquisition sensor for simultaneously acquiring EEG signals and near-infrared light signals for brain function imaging. The multifunctional photoelectric signal acquisition sensor includes a sensor body, and the sensor body has a built-in near-infrared probe sensor for detecting near-infrared light signals; a groove is provided between the near-infrared probe sensor and the sensor body, and the groove is used to place a water-absorbing sponge, and the water-absorbing sponge passes through the sensor body and contacts the scalp to acquire EEG signals; a plurality of electrode needles are arranged on the circumference of the port of the sensor body close to the scalp, and the electrode needles contact the scalp to acquire EEG signals. The multifunctional photoelectric signal acquisition sensor can realize the acquisition of multifunctional photoelectric signals, and can acquire a variety of signals related to brain functions, including EEG signals and near-infrared light signals, and provide more comprehensive and accurate brain function information. Specifically, EEG signals can be acquired by contacting the scalp with the water-absorbing sponge or the electrode needle, and near-infrared light signals can also be acquired by the near-infrared probe sensor, which is helpful for acquiring EEG signals and near-infrared light signals at the same time, and solving the problem of point conflicts or sharing.

[0050] Furthermore, the present application also provides a multimodal brain signal acquisition device, including a multifunctional photoelectric signal acquisition sensor, an EEG signal processor, and an optical signal processor. The EEG signal collected by the multifunctional photoelectric signal acquisition sensor is transmitted to the EEG signal processor for signal conditioning, and the near-infrared light signal collected by the multifunctional photoelectric signal acquisition sensor is transmitted to the optical signal processor via an optical fiber. The optical signal processor converts the near-infrared light signal into an analog signal and conditions the analog signal. When optical signals are transmitted using optical fibers, since the transmission principle of optical fibers is total reflection optical path transmission, the signal loss to the light source is small. When the distance is short, the loss on the optical conduction path can be ignored. Compared with the method of transmitting electrical signals using cables, the use of optical paths to transmit signals can effectively solve the problems of interference and noise in the transmission process of near-infrared signals and improve the accuracy of signal detection. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 A schematic diagram of the structure of a multifunctional photoelectric signal acquisition sensor provided in an embodiment of the present application;

[0052] Figure 2 for Figure 1 A side view of the multifunctional photoelectric signal acquisition sensor shown;

[0053] Figure 3 A schematic diagram of the structure of a multimodal brain signal acquisition device provided in an embodiment of the present application;

[0054] Figure 4 A schematic diagram of the structure of another multimodal brain signal acquisition device provided in an embodiment of the present application;

[0055] Figure 5 A schematic diagram of a near-infrared light signal processing flow provided in an embodiment of the present application;

[0056] Figure 6 Another schematic diagram of a near-infrared light signal processing process provided in an embodiment of the present application;

[0057] Figure 7 A schematic diagram of the structure of a near-infrared probe sensor provided in an embodiment of the present application;

[0058] Figure 8 A schematic diagram of the structure of another multimodal brain signal acquisition device provided in an embodiment of the present application;

[0059] Fig. 9 A schematic diagram of the structure of another multimodal brain signal acquisition device provided in an embodiment of the present application;

[0060] Fig.10 A schematic diagram of the structure of a control circuit provided in an embodiment of the present application;

[0061] Fig.11 for Figure 8 Schematic diagram of the specific structure of the multimodal brain signal acquisition device;

[0062] Fig.12 A schematic diagram of lighting up an emitting light source provided in an embodiment of the present application. DETAILED DESCRIPTION

[0063] In the embodiments of the present application, unless otherwise specified, the character " / " indicates that the objects before and after the association are in an or relationship. For example, A / B can represent A or B. "And / or" describes the association relationship of the associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone.

[0064] It should be pointed out that the words "first", "second", etc. involved in the embodiments of the present application are only used to distinguish the description purpose, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated, nor can they be understood as indicating or implying order.

[0065] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. In addition, "at least one of the following" or similar expressions refers to any combination of these items, which may include any combination of single items or plural items. For example, at least one of A, B, or C may represent: A, B, C, A and B, A and C, B and C, or A, B and C. Among them, each of A, B, and C may be an element itself, or a set containing one or more elements.

[0066] In the embodiments of the present application, "exemplary", "in some embodiments", "in another embodiment", etc. are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the word "exemplary" is intended to present concepts in a concrete way.

[0067] In the embodiments of the present application, "of", "corresponding", and "corresponding" can sometimes be used interchangeably. It should be noted that when the distinction between them is not emphasized, the meanings to be expressed are consistent. In the embodiments of the present application, communication and transmission can sometimes be used interchangeably. It should be noted that when the distinction between them is not emphasized, the meanings to be expressed are consistent. For example, transmission can include sending and / or receiving, which can be a noun or a verb.

[0068] The equal to involved in the embodiments of the present application can be used in conjunction with greater than, and is applicable to the technical solution adopted when greater than, and can also be used in conjunction with less than, and is applicable to the technical solution adopted when less than. It should be noted that when equal to is used in conjunction with greater than, it cannot be used in conjunction with less than; when equal to is used in conjunction with less than, it cannot be used in conjunction with greater than.

[0069] The EEG signal acquisition system has standard points, and the near-infrared light signal has standard measurement brain areas. During measurement, there may be point conflicts or sharing issues between the EEG signal and the near-infrared light signal.

[0070] Based on the above problems, the embodiment of the present application proposes a multifunctional photoelectric signal acquisition sensor, which helps to simultaneously collect EEG signals and near-infrared light signals and solve the problem of point conflict or sharing.

[0071] Figure 1 This is a schematic diagram of the structure of the multifunctional photoelectric signal acquisition sensor provided in the embodiment of the present application. Figure 2 for Figure 1 The side view of the multifunctional photoelectric signal acquisition sensor shown in FIG. Figure 1 and Figure 2As shown, the multifunctional photoelectric signal acquisition sensor 10 includes a sensor body 101, and the sensor body 101 has a near-infrared probe sensor 102 built therein, and the near-infrared probe sensor 102 is used to detect the near-infrared light signal reflected or scattered by the cerebral cortex; there is a groove 103 between the near-infrared probe sensor 102 and the sensor body 101, and the groove 103 is used to place a water-absorbing sponge 104, and the water-absorbing sponge 104 passes through the sensor body 101 and contacts the scalp to collect brain electrical signals; the multifunctional photoelectric signal acquisition sensor 10 also includes a plurality of electrode needles 105, each electrode needle 105 is arranged along the circumference of the port of the sensor body close to the scalp, and the electrode needle 105 contacts the scalp to collect brain electrical signals. Optionally, the near-infrared probe sensor 102 of the multifunctional photoelectric signal acquisition sensor 10 is connected to an optical fiber 106 to transmit the near-infrared light signal to an optical processing device for signal processing.

[0072] There are two ways to collect EEG signals: dry electrode collection and water electrode collection. Figure 1 In the multifunctional photoelectric signal acquisition sensor shown, the electrode needle 105 is a dry electrode probe, and the method of collecting EEG signals by contacting the electrode needle with the subject's scalp is a dry electrode collection method; after the absorbent sponge 104 is full of saline, it is placed in the groove 103, and the method of conducting electrical signals by passing through the sensor body 101 and contacting the subject's scalp is a water electrode collection method. When the multifunctional photoelectric signal acquisition sensor provided in the embodiment of the present application collects EEG signals, it can use both a dry electrode collection method and a water electrode collection method. It is compatible with both collection methods and can save space. At the same time, dry electrodes have advantages in convenience and comfort, while water electrodes have lower impedance, perform better in signal quality and stability, and support longer EEG signal recording. Compatible with both collection methods, the appropriate collection method can be selected according to different application scenarios and needs.

[0073] Optionally, the electrode needle 105 is an elastic structure and can be extended along the sensor body 101. That is, the electrode needle is elastic and can be extended to the inside of the sensor body 101, so that it can better pass through the hair and make repeated contact with the scalp. It is mainly used to collect brain wave signals in dense hair areas, and is also suitable for collecting brain wave signals in hairless areas.

[0074] Alternatively, if Figure 1 and Figure 2 As shown, the groove 103 is a double arc structure, and the shape of the groove 103 is adapted to the absorbent sponge 104. After the absorbent sponge 104 is filled with saline, it is placed in the groove 103. The inner wall of the groove 103 is provided with a metal coating, which can conduct electricity after contacting with the water of the absorbent sponge 104, and transmit the EEG signal to the sensor body, and then through the signal processing board PCB (Printed Circuit Board, printed circuit board, Figure 1 and Figure 2 It should be noted that the shapes of the groove and the water-absorbing sponge are only used as examples and do not limit the embodiments of the present application.

[0075] The multifunctional photoelectric signal acquisition sensor provided in the present application can realize the acquisition of multifunctional photoelectric signals, and can acquire a variety of brain function-related signals, including EEG signals and near-infrared light signals, to provide more comprehensive and accurate brain function information. Specifically, EEG signals can be acquired by contacting the scalp with a water-absorbing sponge or an electrode needle, and near-infrared light signals can also be acquired by a near-infrared probe sensor, which helps to simultaneously acquire EEG signals and near-infrared light signals for brain function imaging, and solve the problem of point conflicts or sharing.

[0076] The detection of near-infrared signals requires the cooperation of a light source and a photodiode. The light source emits near-infrared light to the cerebral cortex. After the oxygenated hemoglobin and deoxygenated hemoglobin in the cerebral cortex absorb near-infrared light of a specific wavelength, the unabsorbed near-infrared light reaches the photodiode after reflection or scattering. The photodiode converts the optical signal into an electrical signal, which is then transmitted to the main control end through a cable. After analysis by the main control end, near-infrared spectral imaging of the functional area of ​​the brain is obtained. However, if the photodiode is placed directly in the area of ​​the brain to be tested and connected to the main control end through a cable, the weak electrical signal may be interfered with and noisy during transmission due to the distributed capacitance and distributed inductance of the cable, changes in the external magnetic field environment, or relative movement of the cable, thereby reducing the accuracy of signal detection.

[0077] Based on the point conflicts or sharing issues of near-infrared signal acquisition and EEG signal acquisition, as well as the interference and noise issues during near-infrared signal transmission, this application proposes a multimodal brain signal acquisition device, such as Figure 3 As shown, Figure 3 The present invention provides a schematic diagram of the structure of a multimodal brain signal acquisition device according to an embodiment of the present invention. The multimodal brain signal acquisition device includes the multifunctional photoelectric signal acquisition sensor 10, the EEG signal processor 30, and the optical signal processor 20 described in the above embodiment. In the multifunctional photoelectric signal acquisition sensor 10, a near-infrared light signal is acquired by a near-infrared probe sensor, and an EEG signal is acquired by an electrode needle or an absorbent sponge. The near-infrared light signal is transmitted to the optical signal processor via an optical fiber. The EEG signal acquired by contacting the scalp with the absorbent sponge or the electrode needle is transmitted to the EEG signal processor via a PCB connected to the sensor body and a cable connected to the PCB.

[0078] The EEG signal processor 30 is used to condition the EEG signal collected by the multifunctional photoelectric signal acquisition sensor; the optical signal processor 20 is used to convert the near-infrared light signal collected by the multifunctional photoelectric signal acquisition sensor into an analog signal and condition the analog signal, and the conditioning includes signal amplification and filtering processing.

[0079] This application can collect EEG signals and near-infrared light signals for brain function imaging at the same time through a multifunctional photoelectric signal acquisition sensor, which helps to solve the problem of point conflicts or sharing. The EEG signals collected by the multifunctional photoelectric signal acquisition sensor are transmitted to the EEG signal processor for signal conditioning, and the near-infrared light signals collected by the multifunctional photoelectric signal acquisition sensor are transmitted to the optical signal processor through optical fiber. The optical signal processor converts the near-infrared light signal into an analog signal and conditions the analog signal. Since optical fiber transmits optical signals, and the transmission principle of optical fiber is total reflection optical path transmission, the optical signal will not be affected by interference and noise such as changes in the external magnetic field, the distributed capacitance and distributed inductance of the cable, and the relative movement of the cable during transmission, and the loss of transmission through the optical path is small, which helps to solve the interference and noise problems in the transmission process of near-infrared signals and improve the accuracy of signal detection.

[0080] Optionally, the multimodal brain signal acquisition device can be a cap-type structure or a helmet structure or a headband structure. Different structural designs can meet the needs of different application scenarios. For example, a cap-type structure device is usually designed to be relatively light and flexible, suitable for use in laboratories or clinical environments, and can be easily worn on the head of the tester for long-term monitoring without affecting the tester's daily activities. A helmet-type structure device is usually more sturdy and stable, suitable for use in industrial or field environments, such as construction site operations or cycling safety, and can provide additional protection while integrating a variety of sensors to monitor the working environment and the physiological state of workers. A headband structure device is usually more comfortable and suitable for long-term wear. The device is suitable for use in scenarios where long-term continuous monitoring of brain function is required. The headband structure can also be easily adjusted in size to accommodate people with different head shapes.

[0081] In other optional embodiments, such as Figure 4 As shown, Figure 4A schematic diagram of the structure of another multimodal brain signal acquisition device provided in an embodiment of the present application, wherein the EEG signal processor 30 includes an analog front-end processing module 31, a first amplifier module 32, and a first analog-to-digital converter 33. The analog front-end processing module 31 is used to perform denoising on the EEG signal. The denoising process may be to use high- and low-pass filters to remove baseline drift, power frequency interference, electrooculographic interference, and head movement interference, or to use a bandpass filter to extract EEG signals in an effective frequency band, thereby improving the accuracy and reliability of subsequent EEG signal processing and analysis. The first amplifier module 32 is used to amplify and filter the EEG signal after denoising. The first analog-to-digital converter 33 is used to convert the EEG signal after signal amplification and filtering into a first digital signal. The EEG signal processor 30 is also used to transmit the first digital signal to an external host computer ( Figure 4 The optical signal processor 20 includes a first photodiode 21, a second amplifier processing module 22, and a second analog-to-digital converter 23. The first photodiode 21 is used to convert the near-infrared light signal into a first analog signal; the second amplifier processing module 22 is used to amplify and filter the first analog signal to obtain a second analog signal; the second analog-to-digital converter 23 is used to convert the second analog signal into a second digital signal. The optical signal processor 20 is also used to transmit the second digital signal to an external host computer.

[0082] Since the external host computer cannot directly process analog signals, only digital signals after analog-to-digital conversion can be further processed and analyzed by the host computer. Therefore, a first analog-to-digital converter is also provided in the EEG signal processor, which converts the EEG signal after signal amplification and filtering into a first digital signal, and a second analog-to-digital converter is also provided in the optical signal processor, which converts the second analog signal into a second digital signal. The EEG signal processor can transmit the first digital signal to the external host computer by wireless or wired means for presentation and further processing. Similarly, the optical signal processor can also transmit the second digital signal to the external host computer by wireless or wired means for presentation and further processing.

[0083] In some optional embodiments, such as Figure 5 As shown, Figure 5 A schematic diagram of a near-infrared light signal processing flow provided in an embodiment of the present application, wherein the near-infrared probe sensor 102 comprises a near-infrared sensor body 1021 and an optical fiber interface 1023, wherein the near-infrared probe sensor 102 is connected to an optical fiber via the optical fiber interface 1023; a hollow light guide column is provided in the near-infrared sensor body 1021, and the light guide column is used to receive the near-infrared light signal and guide it to the optical fiber interface 1023. Optionally, the light guide column and the optical fiber interface 1023 are connected by optical fiber fusion splicing technology, which can reduce light source loss.

[0084] In this embodiment, the near-infrared light source (light source emitter / emitting light source) lights up alternately, emitting near-infrared light to the brain area to be measured, and the near-infrared light that is not absorbed by the brain area to be measured is received by the light guide column of the near-infrared sensor body 1021 after reflection or scattering, and the light guide column guides the near-infrared light to the optical fiber interface 1023, and transmits the near-infrared light to the optical signal processor 20 through the optical fiber. At this time, the photodiode (i.e., the first photodiode 21) is set in the optical signal processor 20 far away from the head, and the first photodiode 21 can be set separately in the optical signal processor 20 or integrated in the second amplifier processing module 22. The near-infrared probe sensor 102 for detecting near-infrared light close to the head collects the near-infrared light signal and guides it to the optical fiber interface 1023, and the near-infrared light signal is transmitted to the optical signal processor 20 through the optical fiber, and the subsequent signal processing is performed in the optical signal processor 20. The near-infrared light signal is transmitted by optical fiber. Since the transmission principle of the optical fiber is total reflection light path transmission, the optical signal will not be disturbed during the transmission process, ensuring the accuracy of signal detection.

[0085] When the optical signal processor 20 receives the near-infrared light signal transmitted by the optical fiber, the first photodiode 21 converts the near-infrared light signal into an electrical signal (specifically a first analog signal), the first analog signal is input into the second amplifier module 22 for signal amplification and filtering to obtain a second analog signal, and then the second analog signal is converted into a second digital signal by the second analog-to-digital converter 23, and then the second digital signal is sent to the host computer by wired or wireless means for presentation and further processing.

[0086] In some optional embodiments, such as Figure 6 As shown, Figure 6 Another near-infrared light signal processing flow diagram provided for the embodiment of the present application, the near-infrared probe sensor 102 includes a near-infrared sensor body 1021, a pre-processing module 1022 and an optical fiber interface 1023, and the near-infrared probe sensor 102 is connected to the optical fiber through the optical fiber interface 1023; a hollow light guide column is provided in the near-infrared sensor body 1021, and the light guide column is connected to the optical fiber interface 1023 through the pre-processing module 1022, and the light guide column is used to receive the near-infrared light signal and guide it to the pre-processing module 1022; the pre-processing module 1022 is used to pre-process the near-infrared light signal guided by the light guide column, and output the pre-processed near-infrared light signal to the optical fiber interface. Among them, the light guide column and the pre-processing module 1022 are adjacent structures in the near-infrared probe sensor 102, and there is no line connection between the light guide column and the pre-processing module 1022, that is, the light guide column directly guides the light reflected or scattered by the cerebral cortex to the pre-processing module 1022, so there is no interference on the line.

[0087] Alternatively, if Figure 7 As shown, Figure 7 A schematic diagram of the structure of a near-infrared probe sensor provided in an embodiment of the present application. The near-infrared probe sensor 102 includes a near-infrared sensor body 1021, a pre-processing module 1022, and an optical fiber interface 1023. The pre-processing module 1022 includes a second photodiode 10221, a filtering unit 10222, a third analog-to-digital converter 10223, and a digital-to-optical converter 10224. Among them, the second photodiode 10221 is used to convert the near-infrared light signal guided by the light guide column in the near-infrared sensor body 1021 into a third analog signal; the filtering unit 10222 is used to filter the third analog signal; the third analog-to-digital converter 10223 is used to convert the filtered third analog signal into a third digital signal; the digital-to-optical converter 10224 is used to convert the third digital signal into an optical signal.

[0088] In this embodiment, the near-infrared light source (light source emitter / emitting light source) lights up alternately, emitting near-infrared light to the brain area to be measured, and the brain area to be measured reflects or scatters the unabsorbed near-infrared light and receives it through the light guide column of the near-infrared sensor body 1021. The light guide column guides the received near-infrared light to the pre-processing module 1022 adjacent to the light guide column, and the pre-processing module 1022 pre-processes the near-infrared light and outputs the pre-processed near-infrared light signal to the optical fiber interface 1023, and transmits the pre-processed near-infrared light signal to the optical signal processor 20 through the optical fiber.

[0089] The pre-processing module 1022 pre-processes the near-infrared light signal in detail including: using the second photodiode 10221 to convert the near-infrared light signal guided by the light guide column into an electrical signal (specifically a third analog signal), and then filtering the third analog signal through the filter unit 10222 to remove noise, and then converting the filtered third analog signal into a third digital signal through the third analog-to-digital converter 10223, and then converting the third digital signal into an optical signal through the digital-to-optical converter 10224. At this time, the signal transmitted by the optical fiber is a near-infrared light signal. Since the transmission principle of the optical fiber is total reflection optical path transmission, the optical signal will not be disturbed during the transmission process, thereby ensuring the accuracy of signal detection.

[0090] When the optical signal processor 20 receives the near-infrared light signal transmitted by the optical fiber, the first photodiode 21 converts the near-infrared light signal into an electrical signal (specifically a first analog signal), the first analog signal is input into the second amplifier module 22 for signal amplification and filtering to obtain a second analog signal, and then the second analog signal is converted into a second digital signal by the second analog-to-digital converter 23, and then the second digital signal is sent to the host computer by wired or wireless means for presentation and further processing.

[0091] In this embodiment, the near-infrared probe sensor pre-processes the collected near-infrared light signal through a pre-processing module, and the pre-processing module successively converts the light signal into an analog signal, the analog signal into a digital signal, and the digital signal into an optical signal, and then transmits the pre-processed light signal to an optical signal processor through an optical fiber for further signal processing. The near-infrared probe first performs signal pre-processing. At this time, the photodiode (i.e., the second photodiode) in the pre-processing module is close to the brain area to be measured, and the accuracy of receiving and processing the light signal is higher. Therefore, it is suitable for application scenarios with deeper depths in detecting brain areas.

[0092] Optionally, the sensitivity of the second photodiode is higher than that of the first photodiode. For example, the second photodiode may be an avalanche photodiode (APD), which can amplify the optical signal internally and provide higher sensitivity than an ordinary photodiode. The second photodiode is located in a near-infrared probe sensor close to the brain area to be measured, and the first photodiode is located in an optical signal processor far from the head. The sensitivity of the second photodiode is higher than that of the first photodiode, which can improve the accuracy of the optical signal obtained after the optical signal is processed at the pre-stage.

[0093] Optionally, the pre-processing module also includes a data verification mechanism unit, which is used to add a preset data verification mechanism to the third digital signal; accordingly, the optical signal processor also includes a data verification mechanism verification unit, which is used to verify whether the second digital signal complies with the preset data verification mechanism.

[0094] Digital verification refers to the process of ensuring the accuracy, integrity and validity of data during transmission, storage or processing. Data verification mechanisms can be parity check, cyclic redundancy check, checksum, etc. Among them, parity check is to ensure that the total number of 1s in the data is odd (odd check) or even (even check) by adding an extra bit (check bit). This method can detect single bit errors, but cannot detect even bit errors; cyclic redundancy check treats the data as a large binary number and divides it using a predefined polynomial (generator polynomial). The remainder is appended to the data. The receiver uses the same polynomial for verification. If the remainder is 0, the data is considered to be error-free; the checksum is a value obtained by performing arithmetic or logical operations on the data block. This value is appended to the data. The receiver performs the same operation on the received data and compares it with the transmitted checksum to detect whether the data has been tampered with during transmission. These verification mechanisms can be used alone or in combination to provide different levels of error detection and correction capabilities.

[0095] Taking the data verification mechanism of the checksum as an example, in the data verification mechanism unit of the pre-stage processing module, an arithmetic or logical operation is performed on the third digital signal to obtain a first verification value. After the first verification code and the third digital signal are integrated, they are converted into an optical signal through a digital-to-optical converter, and then transmitted to the optical signal processor through an optical fiber. In the optical signal processor, the optical signal is successively converted into a first analog signal, the first analog signal is amplified and filtered to obtain a second analog signal, and the second analog signal is converted into a second digital signal. Then, the same mathematical operation is performed on the second digital signal through the data verification mechanism verification unit to obtain a second verification value. The first verification value and the second verification value are compared. If the two are the same, it means that the second digital signal meets the data verification mechanism of the checksum, and the second digital signal is accurate, complete and valid. By introducing the data verification mechanism, the accuracy, integrity and validity of the data during transmission and processing can be verified.

[0096] Optionally, the outer layer of the optical fiber is provided with a fully wrapped optical fiber core cladding, which can effectively prevent interference from external light sources.

[0097] Optionally, the diameter of the light guide column is greater than the diameter of the optical fiber interface. Since the near-infrared light reflected or scattered by the cerebral cortex is relatively weak, the larger the diameter of the light guide column, the more near-infrared light it receives. However, the diameter of the light guide column needs to match the optical fiber interface to ensure that the light can be effectively transmitted. If the diameter of the light guide column is too large, it may cause an increase in light loss at the optical fiber interface. In Example 1, the light guide column is connected to the optical fiber interface using optical fiber fusion splicing technology to reduce light source loss. In Example 2, the light guide column is connected to the optical fiber interface through a pre-stage processing module. The light guide column can also be set to a retractable structure, which can adjust the distance between the near-infrared probe sensor and the cerebral cortex, so that the light guide column is closer to the brain area of ​​the subject and can receive more near-infrared light.

[0098] The multimodal brain signal acquisition device provided by the present application can simultaneously acquire EEG signals and near-infrared light signals through a multifunctional photoelectric signal acquisition sensor, which helps to solve the problem of point conflicts or sharing. The EEG signals collected by the multifunctional photoelectric signal acquisition sensor are transmitted to the EEG signal processor for signal conditioning, and the near-infrared light signals collected by the multifunctional photoelectric signal acquisition sensor are transmitted to the optical signal processor through optical fiber. The optical signal processor converts the near-infrared light signal into an analog signal and conditions the analog signal. Since optical fiber transmits optical signals, and the transmission principle of optical fiber is total reflection optical path transmission, the optical signal will not be affected by interference and noise such as changes in the external magnetic field, the distributed capacitance and distributed inductance of the cable, and the relative movement of the cable during the transmission process, and the loss of transmission through the optical path is small, which helps to solve the interference and noise problems in the transmission process of near-infrared signals and improve the accuracy of signal detection.

[0099] Figure 3 The multimodal brain signal acquisition device shown includes a multifunctional photoelectric signal acquisition sensor. In other optional embodiments, the multimodal brain signal acquisition device may also include multiple multifunctional photoelectric signal acquisition sensors and multiple emitting light sources, each emitting light source corresponds to multiple multifunctional photoelectric signal acquisition sensors (specifically, near-infrared probe sensors in the multifunctional photoelectric signal acquisition sensors); multiple multifunctional photoelectric signal acquisition sensors and multiple emitting light sources form different multi-channel interfaces, different multi-channel interfaces form different detection components, and different detection components correspond to different detection areas of the user's brain. The multimodal brain signal acquisition device may also include a control circuit 40, which is used to send a control signal to the detection component. Among them, the emitting light source is used to light up in sequence according to the control signal to send a near-infrared light signal to the detection area; the near-infrared probe sensor in the multifunctional photoelectric signal acquisition sensor is used to receive the near-infrared light signal reflected or scattered by the detection area, and a channel is formed between the emitting light source and each connected near-infrared probe sensor.

[0100] In the embodiment of the present application, different multi-channel interfaces can form different detection components, and the detection components are correspondingly arranged in different detection areas of the user's brain. The control circuit 40 sends a control signal to the detection component, and the detection component collects the detection signal of the corresponding detection area in response to the control signal and outputs the detection signal. By detecting the detection signals of different detection areas through different detection components, the layout of the detection components is flexible, and the signal collection method is flexible and diverse, thereby meeting the diverse needs of users.

[0101] Figure 8 A schematic diagram of the structure of another multimodal brain signal acquisition device provided in an embodiment of the present application is shown in FIG. Figure 8 As shown, as an optional solution, the multimodal brain signal acquisition device includes multiple multi-channel interfaces and a control circuit 40, and the multiple multi-channel interfaces include a first multi-channel interface 11, a second multi-channel interface 12, a third multi-channel interface 13 and a fourth multi-channel interface 14. In practical applications, the number of multi-channel interfaces can be set as needed, and the embodiments of the present application do not limit this.

[0102] In the embodiment of the present application, different multi-channel interfaces among the multiple multi-channel interfaces can be combined to form different detection components. Optionally, if the first multi-channel interface 11 forms a detection component, the detection area corresponding to the detection component includes the frontal lobe area; or, if the second multi-channel interface 12 forms a detection component, the detection area corresponding to the detection component includes the occipital lobe area; or, if the third multi-channel interface 13 and the fourth channel interface 14 form a detection component, the detection area corresponding to the detection component includes the parietal lobe area.

[0103] In an optional embodiment, Fig. 9A schematic diagram of the structure of another multimodal brain signal acquisition device provided in an embodiment of the present application is shown in FIG. Fig. 9 As shown, the first multi-channel interface 11 forms a detection component 51, the second multi-channel interface 12 forms a detection component 52, and the third multi-channel interface 13 and the fourth channel interface 14 form a detection component 53. The control circuit 40 includes a main control chip 41 and a detection component gating control unit 42, and the detection component gating control unit 42 is used to select one or more groups of multiple detection components to collect near-infrared brain function imaging signals.

[0104] For example, if the multimodal brain signal acquisition device needs to acquire brain signals in the frontal lobe region, the detection component 51 formed by the first multi-channel interface 11 can be selected for signal acquisition; if it is necessary to acquire brain signals in the occipital lobe region, the detection component 52 formed by the second multi-channel interface 12 can be selected for signal acquisition; if it is necessary to acquire brain signals in the parietal lobe region, the detection component 53 formed by the third multi-channel interface 13 and the fourth multi-channel interface 14 can be selected for signal acquisition; if it is necessary to acquire brain signals in the frontal lobe region and the parietal lobe region, the detection component 51 formed by the first multi-channel interface 11 and the detection component 52 formed by the third multi-channel interface 14 can be selected for signal acquisition. 3 and the fourth multi-channel interface 14 to collect signals; if it is necessary to collect brain signals in the parietal and occipital regions, the detection component 52 formed by the second multi-channel interface 12 and the detection component 53 formed by the third multi-channel interface 13 and the fourth multi-channel interface 14 can be selected to collect signals; if it is necessary to collect brain signals in the frontal, parietal and occipital regions, the detection component 51 formed by the first multi-channel interface 11, the detection component 52 formed by the second multi-channel interface 12 and the detection component 53 formed by the third multi-channel interface 13 and the fourth multi-channel interface 14 can be selected to collect signals.

[0105] Optionally, the detection component gating control unit 42 includes a plurality of switch components ( Fig. 9 The main control chip 41 is used to send a selection signal to multiple switch components, and control one or more switch components to communicate with the corresponding detection components through the selection signal.

[0106] For example, the detection component 51 corresponds to the first switch component, the detection component 52 corresponds to the second switch component, and the detection component 53 corresponds to the third switch component. When the first switch component is controlled by the selection signal to be connected to the corresponding detection component 51, the detection component 51 can be used to collect near-infrared brain functional imaging signals of the frontal lobe area; or when the first switch component is controlled by the selection signal to be connected to the corresponding detection component 51 and the detection component 53 corresponding to the third switch, the detection components 51 and 53 can be used to collect brain signals of the frontal lobe area and the parietal lobe area.

[0107] In the embodiments of the present application, the control unit of the detection component can select brain signals of different detection areas, such as only collecting brain signals of the frontal lobe area, or collecting brain signals of the whole brain area, etc. The user can choose to collect brain signals of one or more detection areas according to actual needs, and the signal collection is flexible to meet the diverse signal collection needs. Furthermore, the control circuit can also control that in a certain detection area, the multifunctional photoelectric signal collection sensor only collects EEG signals, or only collects near-infrared light signals, or collects EEG signals and near-infrared light signals.

[0108] Fig.10 A schematic diagram of a control circuit provided in an embodiment of the present application is shown in FIG. Fig.11 for Figure 8 The specific structural diagram of the multimodal brain signal acquisition device is as follows; Fig.10 and Fig.11 As shown, the control signal includes a power control signal and a lighting control signal. The control circuit 40 includes a main control chip 41, a detection component selection control unit 42 and a control module 43, wherein the control module 43 is connected between the main control chip 41 and the multi-channel interface; the control module 43 is used to receive the host computer ( Fig.11 The control module 43 is also used to receive a lighting signal sent by the host computer, generate a lighting control signal according to the lighting signal, and output the lighting control signal to the corresponding emitting light source.

[0109] Optionally, the lighting signal includes a first lighting signal and a second lighting signal, the lighting control signal includes a first lighting control signal and a second lighting control signal, and the control module 43 includes: a first MUX, a plurality of gear resistors, a second MUX and a third MUX, the first MUX is connected between the main control chip 41 and the plurality of gear resistors, the second MUX is connected between the plurality of gear resistors and the plurality of multi-channel interfaces (including the plurality of emitting light sources), and the third MUX is connected between the main control chip 41 and the plurality of multi-channel interfaces (including the plurality of emitting light sources). Fig.11As shown, the main control chip 41 is used to send a power selection signal to the first MUX; the first MUX is used to generate a gear selection signal according to the power selection signal, and output a power control signal to the second MUX through a gear resistor corresponding to the gear selection signal; the second MUX is used to output the power control signal to multiple emitting light sources, and the power control signal is used to control the power of multiple emitting light sources; the second MUX is used to output a first lighting control signal to the corresponding emitting light source according to the first lighting signal output by the main control chip 41; the third MUX is used to output a second lighting control signal to the corresponding emitting light source according to the second lighting signal output by the main control chip 41. For example, the number of gear resistors can be four, and the multiple gear resistors can include gear resistor L0, gear resistor L1, gear resistor L2 and gear resistor L3.

[0110] Combine the following Fig.10 and Fig.11 , the working process of the multimodal brain signal acquisition device of an embodiment of the present application is described in detail.

[0111] At present, in order to make the cap of the multimodal brain signal acquisition device fit different head circumferences when the user wears it, two caps of different sizes are provided, and the distances between the emitting light source and the near-infrared probe sensor corresponding to different caps are different. In order to prevent the signal acquisition depth at a long distance from being insufficient, a power switching function is added to the control circuit 40, so that the control circuit 40 has multiple power levels. For example, the control circuit 40 has 4 power levels, and the 4 power levels may include high power, relatively high power, medium power and low power. When the distance between the emitting light source and the near-infrared probe sensor is far, the control circuit 40 may set the power of the emitting light source to high power or relatively high power; when the distance between the emitting light source and the near-infrared probe sensor is moderate, the power of the emitting light source may be set to medium power or low power, thereby reducing the emitting power, saving power consumption and extending the use time. For example, the power of the emitting light source can be determined according to the distance between the emitting light source and the near-infrared probe sensor. The four power levels correspond to the four level resistors, high power corresponds to level resistor L0, relatively high power corresponds to level resistor L1, medium power corresponds to level resistor L2, and low power corresponds to level resistor L3. For example, if the distance between the emitting light source and the near-infrared probe sensor is 40 mm, the power of the emitting light source can be set to high power or relatively high power; if the distance between the emitting light source and the near-infrared probe sensor is 25 mm, the power of the emitting light source can be set to medium power or low power.

[0112] The user inputs a power selection signal to the host computer. For example, if the user selects high power, the user inputs a high power power selection signal to the host computer; the host computer sends the power selection signal to the main control chip 41, and the main control chip 41 sends the power selection signal to the first MUX. The first MUX generates a gear selection signal according to the power selection signal. For example, if the power selection signal is a high-power selection signal, the gear selection signal can be 1000. At this time, the gear selection signal 1000 corresponds to the gear resistor L0, and the first MUX is electrically connected to the second MUX through the gear resistor L0. The power control current flows to the second MUX through the gear resistor L0, so that the first MUX can output the power control signal to the second MUX through the gear resistor L0; for another example, if the power selection signal is a higher power selection signal, the gear selection signal can be 0100. At this time, the gear selection signal 0100 corresponds to the gear resistor L1, and the first MUX is electrically connected to the second MUX through the gear resistor L1. The power control current flows to the second MUX through the gear resistor L1, so that the first MUX can output the power control signal to the second MUX through the gear resistor L0. For example, if the power selection signal is a medium power selection signal, the gear selection signal can be 0010. At this time, the gear selection signal 0010 corresponds to the gear resistor L2. The first MUX is electrically connected to the second MUX through the gear resistor L2. The power control current flows to the second MUX through the gear resistor L2, so that the first MUX can output the power control signal through the gear resistor L2. For example, if the power selection signal is a low power selection signal, the gear selection signal can be 0001. At this time, the gear selection signal 0001 corresponds to the gear resistor L3. The first MUX is electrically connected to the second MUX through the gear resistor L3. The power control current flows to the second MUX through the gear resistor L3, so that the first MUX can output the power control signal through the gear resistor L3. Since different gear resistors have different resistance values, the magnitude of the control current flowing through different gear resistors is different, so that the magnitude of the power control signal sent by the first MUX to the second MUX is also different, so that the first MUX can control the switching of different powers through the user's selection on the host computer.

[0113] The second MUX is used to output a power control signal to multiple emitting light sources, and the power control signal can be used to control the power of multiple emitting light sources. The main control chip outputs a first lighting signal to the second MUX, and the second MUX outputs a first lighting control signal to the corresponding emitting light source according to the first lighting signal; the main control chip outputs a second lighting signal to the third MUX, and the third MUX outputs a second lighting control signal to the corresponding emitting light source according to the second lighting signal. Each emitting light source includes a first light source and a second light source, and the first light source and the second light source emit different wavelengths of near-infrared light. The first light source and the second light source of each emitting light source are sequentially lit according to the first lighting control signal and the second lighting control signal, that is, the emitting light sources can be lit alternately.

[0114] Fig.12 A schematic diagram of lighting up a light source provided in an embodiment of the present application is shown in FIG. Fig.12 As shown, the second MUX includes a first switch K1, the third MUX includes a second switch K2, and the main control chip 41 outputs a first lighting signal to the second MUX through pins A0-A3 and outputs a second lighting signal to the third MUX through pins A0-A3. In addition, the main control chip 41 also outputs an enable signal to the pins EN of the second MUX and the third MUX to start the second MUX and the third MUX to work.

[0115] The first switch K1 connects the first light source RED1 to a low voltage terminal under the control of a first lighting signal, for example, the low voltage terminal is a ground terminal, so that the first lighting control signal output by the second MUX to the first light source RED1 is a low level. At this time, the level of the first light source RED1 is pulled down, and the first light source RED1 is lit under the control of the low level; the second switch K2 connects the second light source RED2 to a high voltage terminal Vdd under the control of a second lighting signal, so that the second lighting control signal output by the third MUX to the second light source RED2 is a high level. At this time, the level of the second light source RED2 is pulled up, and the second light source RED2 is extinguished under the control of the high level.

[0116] Then, under the control of the first lighting signal, the first switch K1 connects the second light source RED2 to the low voltage terminal, so that the first lighting control signal output by the second MUX to the second light source RED2 is at a low level. At this time, the level of the second light source RED2 is pulled down, and the second light source RED2 is lit under the control of the low level; the second switch K2 connects the first light source RED1 to the high voltage terminal Vdd under the control of the second lighting signal, so that the second lighting control signal output by the third MUX to the first light source RED1 is at a high level. At this time, the level of the first light source RED1 is pulled up, and the first light source RED1 is extinguished under the control of the high level.

[0117] It can be seen that when the first light source RED1 is lit, the level of the second light source RED2 is pulled high to ensure that the second light source RED2 is completely turned off; when the second light source RED2 is lit, the level of the first light source RED1 is pulled high to ensure that the first light source RED1 is completely turned off. By adopting the above method, the first light source and the second light source of each emitting light source are lit in turn, and the level of the previous light source is pulled high during the light source switching process, thereby preventing the previous light source from emitting light due to leakage current.

[0118] In the technical solution provided in the embodiment of the present application, the multimodal brain signal acquisition device includes a plurality of multifunctional photoelectric signal acquisition sensors and a plurality of emitting light sources, and the plurality of multifunctional photoelectric signal acquisition sensors and the plurality of emitting light sources form different multi-channel interfaces, and different multi-channel interfaces form different detection components, and different detection components correspond to different detection areas of the user's brain. The multimodal brain signal acquisition device also includes a control circuit, which sends a control signal to the detection component, and the detection component collects brain signals of the corresponding detection area in response to the control signal. The present application forms different detection components through different multi-channel interfaces, and detects brain signals of different detection areas through different detection components. The layout of the detection components is flexible, and the signal acquisition method is flexible and diverse, thereby meeting the diverse needs of users.

[0119] In the embodiments of the present application, different detection components can detect brain signals in different detection areas, thereby improving the flexibility of multi-area signal monitoring.

[0120] In an embodiment of the present application, the main control chip sends a power selection signal to the first multiplexer, the first multiplexer generates a gear selection signal according to the power selection signal, outputs a power control signal to the second multiplexer through the gear resistor corresponding to the gear selection signal, and the second multiplexer outputs the power control signal to multiple emitting light sources, thereby realizing the control of the power of the emitting light source through the power control signal.

[0121] In the embodiment of the present application, by raising the level of the previous light source, it is ensured that when the current light source is lit, the previous light source is completely turned off, thereby preventing crosstalk, ensuring that only a single light source is lit, and preventing the previous light source from emitting light inadvertently due to leakage current.

[0122] The present application also provides a multimodal brain signal acquisition system, including the multimodal brain signal acquisition device and the host computer (also referred to as the main control terminal) shown in the above embodiment, or the multimodal brain signal acquisition system includes the multifunctional photoelectric signal acquisition sensor and the host computer shown in the above embodiment. The host computer is used to analyze the electrical signal conditioned by the optical signal processor to obtain a near-infrared spectrum, or to analyze the EEG signal conditioned by the EEG signal processor to obtain an electroencephalogram. Optionally, the host computer can be an electronic device such as a desktop computer, a tablet computer, a laptop computer, a handheld computer, etc.

[0123] The above is only a specific implementation of the present application. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. The protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A multifunctional photoelectric signal acquisition sensor, characterized in that: The multifunctional photoelectric signal acquisition sensor is used for simultaneously acquiring EEG signals and near-infrared light signals for brain function imaging, and comprises: A sensor body, wherein the sensor body is equipped with a near-infrared probe sensor, and the near-infrared probe sensor is used to detect near-infrared light signals reflected or scattered by the cerebral cortex; a groove is provided between the near-infrared probe sensor and the sensor body, and the groove is used to place a water-absorbing sponge, and the water-absorbing sponge passes through the sensor body and contacts the scalp to collect brain electrical signals; A plurality of electrode needles are provided, each electrode needle being arranged along the circumference of a port of the sensor body close to the scalp, and the electrode needle contacts the scalp to collect brain electrical signals.

2. The multifunctional photoelectric signal acquisition sensor according to claim 1, characterized in that: The electrode needle is an elastic structure and can be extended and retracted along the sensor body; and / or, The inner wall of the groove is provided with a metal coating.

3. A multimodal brain signal acquisition device, characterized in that: It comprises one or more multifunctional photoelectric signal acquisition sensors, electroencephalogram signal processors, and optical signal processors as described in any one of claims 1 to 2; The near-infrared light signal collected by the multifunctional photoelectric signal collection sensor is transmitted to the optical signal processor via an optical fiber; The EEG signal processor is used to condition the EEG signal collected by the multifunctional photoelectric signal acquisition sensor; the optical signal processor is used to convert the near-infrared light signal collected by the multifunctional photoelectric signal acquisition sensor into an analog signal and condition the analog signal, wherein the conditioning includes signal amplification and filtering processing.

4. The device according to claim 3, characterized in that The EEG signal processor includes an analog front-end processing module, a first amplifier module and a first analog-to-digital converter. The analog front-end processing module is used to perform denoising on the EEG signal, and the denoising process at least includes removing baseline drift, power frequency interference and electrooculographic interference; the first amplifier module is used to amplify and filter the EEG signal after denoising; the first analog-to-digital converter is used to convert the EEG signal after signal amplification and filtering into a first digital signal, and the EEG signal processor is also used to transmit the first digital signal to an external host computer; The optical signal processor includes a first photodiode, a second amplifier processing module and a second analog-to-digital converter. The first photodiode is used to convert a near-infrared light signal into a first analog signal; the second amplifier processing module is used to amplify and filter the first analog signal to obtain a second analog signal; the second analog-to-digital converter is used to convert the second analog signal into a second digital signal. The optical signal processor is also used to transmit the second digital signal to an external host computer.

5. The device according to claim 4, characterized in that The near infrared probe sensor comprises a near infrared sensor body and an optical fiber interface, and the near infrared probe sensor is connected to the optical fiber through the optical fiber interface; A hollow light-guiding column is arranged in the body of the near-infrared sensor, and the light-guiding column is used to receive near-infrared light signals and guide them to the optical fiber interface.

6. The device according to claim 5, characterized in that The near-infrared probe sensor also includes a pre-processing module; the light guide column is connected to the optical fiber interface through the pre-processing module; The pre-processing module is used to pre-process the near-infrared light signal guided by the light guide column, and output the pre-processed near-infrared light signal to the optical fiber interface.

7. The device according to claim 6, characterized in that The pre-processing module includes a second photodiode, a filtering unit, a third analog-to-digital converter, and a digital-to-optical converter; The second photodiode is used to convert the near-infrared light signal guided by the light guide column into a third analog signal; The filtering unit is used to filter the third analog signal; The third analog-to-digital converter is used to convert the filtered third analog signal into a third digital signal; The digital-to-optical converter is used to convert the third digital signal into an optical signal; and / or, The sensitivity of the second photodiode is higher than the sensitivity of the first photodiode; and / or, The pre-processing module further includes a data verification mechanism unit, and the data verification mechanism unit is used to add a preset data verification mechanism to the third digital signal; The optical signal processor further comprises a data verification mechanism verification unit, which is used to verify whether the second digital signal complies with the preset data verification mechanism.

8. The device according to claim 7, characterized in that The light guide column and the optical fiber interface are connected by using optical fiber fusion splicing technology; and / or, The light guide column is a retractable structure, which is used to adjust the distance between the near-infrared probe sensor and the cerebral cortex.

9. The device according to claim 4, characterized in that The first photodiode is separately arranged in the optical signal processor, or integrated in the second amplifier processing module.

10. The device according to claim 3, characterized in that The device is a cap-like structure, a helmet structure, or a headband structure; and / or, When there are multiple multifunctional photoelectric signal acquisition sensors, the device further comprises a control circuit and multiple emitting light sources, each emitting light source corresponds to multiple multifunctional photoelectric signal acquisition sensors; The multiple multifunctional photoelectric signal acquisition sensors and the multiple emitting light sources form different multi-channel interfaces, different multi-channel interfaces form different detection components, and different detection components correspond to different detection areas of the user's brain; The control circuit is used to send a control signal to the detection component.

11. The device according to claim 10, characterized in that The control circuit includes a detection component gating control unit, which is used to select one or more groups of multiple detection components to collect brain signals.

12. The device according to claim 11, characterized in that The detection component gating control unit includes a plurality of switch components, and the switch components correspond to the detection components one by one; The control circuit includes a main control chip, and the main control chip is used to send a selection signal to the multiple switch components, and control one or more switch components to be connected to the corresponding detection components through the selection signal.

13. The device according to claim 11, characterized in that The control signal includes a power control signal and a lighting control signal, and the control circuit also includes a main control chip and a control module, and the control module is connected between the main control chip and the multi-channel interface; The control module is used to receive a power selection signal sent by the host computer, generate a power control signal according to the power selection signal and send the power control signal to the multiple emitting light sources; receive a lighting signal sent by the host computer, generate the lighting control signal according to the lighting signal and output the lighting control signal to the corresponding emitting light sources.

14. The device according to claim 13, characterized in that The lighting signal includes a first lighting signal and a second lighting signal, and the lighting control signal includes a first lighting control signal and a second lighting control signal; the control module includes: a first multiplexer, a plurality of gear resistors, a second multiplexer and a third multiplexer, the first multiplexer is connected between the main control chip and the plurality of gear resistors, the second multiplexer is connected between the plurality of gear resistors and the plurality of emitting light sources, and the third multiplexer is connected between the main control chip and the plurality of emitting light sources; The main control chip is used to send a power selection signal to the first multiplexer; The first multiplexer is used to generate a gear selection signal according to the power selection signal, and output a power control signal to the second multiplexer through a gear resistor corresponding to the gear selection signal; The second multiplexer is used to output the power control signal to the multiple emitting light sources, and the power control signal is used to control the power of the multiple emitting light sources; The second multiplexer is used to output the first lighting control signal to the corresponding emitting light source according to the first lighting signal output by the main control chip; The third multiplexer is used to output the second lighting control signal to the corresponding emitting light source according to the second lighting signal output by the main control chip.

15. The device according to claim 10, characterized in that The multi-channel interface includes a first multi-channel interface, a second multi-channel interface, a third multi-channel interface and a fourth multi-channel interface; If the first multi-channel interface forms a detection component, the detection area corresponding to the detection component includes the frontal lobe area; or, If the second multi-channel interface forms a detection component, the detection area corresponding to the detection component includes the occipital lobe area; or, If the third multi-channel interface and the fourth channel interface form a detection component, the detection area corresponding to the detection component includes the parietal lobe area.

16. A multimodal brain signal acquisition system, characterized in that: The system includes a multimodal brain signal acquisition device and a host computer as described in any one of claims 3-15, or a multifunctional photoelectric signal acquisition sensor and a host computer as described in any one of claims 1-2.

Images