Tracing positioning method and device for brain magnetic system and brain magnetic system

Abstract

The invention relates to a traceability positioning method and device for a brain magnetic system and the brain magnetic system. The traceability positioning method comprises the following steps: acquiring brain magnetic signals from a brain in a head, which are acquired by a sensor array; position change information, determined through at least one position sensor, of the head of the to-be-detected object relative to the brain magnetic helmet is obtained; on the basis of the position change information, a pre-established forward propagation model of the brain magnetic system is updated, and the forward propagation model is a mathematical model representing the relation between the electromagnetic activity of a source field point in the brain and brain magnetic signals collected by the sensor array; the forward propagation model is related to the mapping relation between the source space of the brain and the sensor space of the sensor array; and based on the brain magnetic signal and the updated forward propagation model, positioning a source field point related to the brain magnetic signal in the brain.

Description

Technical Field

[0001] The present disclosure relates to the field of medical devices, and in particular to a source tracing and positioning method and source tracing and positioning device for a brain magnetoencephalogram system, an electronic device, a brain magnetoencephalogram system, a computer-readable storage medium, and a computer program product. Background Art

[0002] Magnetoencephalography (MEG) is a brain function detection technology that non-invasively detects the magnetic field generated by the brain's electrical activity. It has millisecond and millimeter time resolutions, and the signal is not affected by tissue conductivity and skull thickness. It can be used to accurately locate electrical activity in the cerebral cortex, that is, brain magnetic tracing and localization, thereby assisting brain tumor resection surgery and epilepsy treatment.

[0003] The physical essence of brain magnetometry source localization is based on the propagation model of brain magnetometry signals generated by brain electrophysiological activities. The brain magnetometry signals collected by the brain magnetometry sensor array are used for reverse solution to determine the source location and intensity of electrophysiological activities in the cerebral cortex. At present, how to accurately trace the source is the key issue of magnetoencephalography technology. Summary of the invention

[0004] According to one aspect of the present disclosure, a source tracing and positioning method for a brain magnetometry system is provided, wherein the brain magnetometry system comprises a brain magnetometry helmet, a sensor array fixed on the brain magnetometry helmet, and at least one position sensor for collecting position information of the head of a subject to be tested, wherein the brain magnetometry helmet is located on the head of the subject to be tested, and the source tracing and positioning method comprises: obtaining brain magnetometry signals from the brain in the head collected by the sensor array; obtaining position change information of the head of the subject to be tested relative to the brain magnetometry helmet determined by the at least one position sensor; based on the position change information, updating a pre-established forward propagation model of the brain magnetometry system, wherein the forward propagation model is a mathematical model representing the relationship between the electromagnetic activity of the source field point in the brain and the brain magnetometry signals collected by the sensor array, and the forward propagation model is related to the mapping relationship between the source space of the brain and the sensor space of the sensor array; and locating the source field points in the brain related to the brain magnetometry signals based on the brain magnetometry signals and the updated forward propagation model.

[0005] According to another aspect of the present disclosure, a source tracing and positioning device for a brain magnetometry system is provided, wherein the brain magnetometry system comprises a brain magnetometry helmet, a sensor array fixed on the brain magnetometry helmet, and at least one position sensor for collecting position information of the head of a subject to be tested, wherein the brain magnetometry helmet is located on the head of the subject to be tested, and the source tracing and positioning device comprises: an acquisition module, wherein the acquisition module is configured to obtain brain magnetometry signals from the brain in the head acquired by the sensor array; and a determination module, wherein the determination module is configured to obtain the position of the head of the subject to be tested relative to the brain magnetometry signal determined by the at least one position sensor. The invention relates to a method for detecting a position change of a helmet; an updating module, wherein the updating module is configured to update a pre-established forward propagation model of the brain magnetic system based on the position change information, wherein the forward propagation model is a mathematical model representing the relationship between the electromagnetic activity of the source field point in the brain and the brain magnetic signal collected by the sensor array, and the forward propagation model is related to the mapping relationship between the source space of the brain and the sensor space of the sensor array; and a positioning module, wherein the positioning module is configured to locate the source field point in the brain related to the brain magnetic signal based on the brain magnetic signal and the updated forward propagation model.

[0006] According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program, and the computer program, when executed by the at least one processor, implements the traceability and positioning method according to the present disclosure.

[0007] According to another aspect of the present disclosure, a brain magnetism system is provided, which includes: a brain magnetism helmet; a sensor array fixed on the brain magnetism helmet; at least one position sensor for collecting position information of the head of a subject to be tested; and a tracing and positioning device according to the present disclosure or an electronic device according to the present disclosure.

[0008] According to another aspect of the present disclosure, one or more computer-readable storage media are provided, on which instructions are stored. In response to the instructions being executed by one or more processors, the one or more processors are prompted to execute the tracing and positioning method according to the present disclosure.

[0009] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, wherein the computer program implements the source tracing and positioning method according to the present disclosure when executed by a processor.

[0010] In the present disclosure, the position change information of the head of the subject to be tested relative to the brain magnetic helmet is determined during the process of tracing and positioning, and the pre-established forward propagation model is updated based on the position change information, so as to use the updated forward propagation model for tracing and positioning. Thus, the position change of the head of the subject to be tested relative to the brain magnetic helmet during the brain magnetic examination can be determined, and the position change information can be used to compensate for the head movement of the subject to be tested in the brain magnetic tracing and positioning data processing flow, so as to obtain a more accurate forward propagation model to improve the accuracy of brain magnetic tracing and positioning.

[0011] These and other aspects of the disclosure will be apparent from and elucidated with reference to the embodiments described hereinafter. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Further details, features and advantages of the present disclosure are disclosed in the following description of exemplary embodiments in conjunction with the accompanying drawings, in which:

[0013] Figure 1 A schematic diagram of a magnetoencephalogram system according to some exemplary embodiments of the present disclosure is shown;

[0014] Figure 2 Schematic diagrams showing a magnetoencephalographic system according to some other exemplary embodiments of the present disclosure;

[0015] Figure 3 A flow chart of a method for tracing and localizing a brain magnetoencephalogram system according to some exemplary embodiments of the present disclosure is shown;

[0016] Figure 4 Shows Figure 3 Schematic diagram of the update steps of the forward propagation model in the source tracing and localization method;

[0017] Figure 5 A schematic diagram showing the collection of brain magnetic signals and position information according to some exemplary embodiments of the present disclosure is shown;

[0018] Figure 6 A schematic block diagram showing a calibration device for a magnetoencephalogram system according to an exemplary embodiment of the present disclosure; and

[0019] Figure 7 An example configuration of an electronic device is shown that may be used to implement the methods described herein. DETAILED DESCRIPTION

[0020] In the following, only some exemplary embodiments are briefly described. As those skilled in the art will appreciate, the described embodiments may be modified in various ways without departing from the spirit or scope of the present application. Therefore, the drawings and descriptions are considered to be exemplary and non-restrictive in nature.

[0021] In the traceability positioning of the magnetoencephalography system, it is necessary to spatially align the brain magnetic signals collected by the sensors of the magnetoencephalography system with the images of the human body collected by medical imaging equipment (for example, nuclear magnetic resonance imaging equipment). Specifically, the positional relationship of the human head and brain relative to the magnetoencephalography helmet is obtained by using optical and electromagnetic positioning methods, and the magnetoencephalography helmet and the sensor array thereon are relatively fixed, so the positional relationship between the human brain and the sensor array can be obtained, thereby realizing the spatial alignment of the magnetoencephalography signal with the image collected by the medical imaging equipment. Since the magnetoencephalography helmet cannot completely fit the shape of the human head, the patient's head will move in the magnetoencephalography helmet during a long examination, resulting in the measured alignment position relationship no longer being accurate, thereby affecting the accuracy of the magnetoencephalography traceability positioning.

[0022] In the present disclosure, the position change information of the head of the subject to be tested relative to the brain magnetic helmet is determined during the process of tracing and positioning, and the pre-established forward propagation model is updated based on the position change information, so as to use the updated forward propagation model for tracing and positioning. Thus, the position change of the head of the subject to be tested relative to the brain magnetic helmet during the brain magnetic examination can be determined, and the position change information can be used to compensate for the head movement of the subject to be tested in the brain magnetic tracing and positioning data processing flow, so as to obtain a more accurate forward propagation model to improve the accuracy of brain magnetic tracing and positioning.

[0023] The embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0024] Figure 1 FIG. 1 is a schematic diagram of a magnetoencephalographic system 1000 according to some exemplary embodiments of the present disclosure. Figure 1As shown, the brain magnetic system 1000 may include: a brain magnetic helmet 110, a sensor array 111 fixed on the brain magnetic helmet 110, and at least one position sensor 120 for collecting position information of the head 131 of the object to be tested 130. The brain magnetic helmet 110 is located on the head 131 of the object to be tested 130. The sensor array 111 is used to collect brain magnetic signals from the brain (the brain is also the cerebrum, located in the head) of the object to be tested 130. When the human brain is stimulated, it can generate electromagnetic activity at one or some source field points (that is, a certain position point in the brain), and the electromagnetic activity can be detected by the sensor array, thereby outputting brain magnetic signals. In the process of brain magnetic source tracing and positioning, an inverse solution can be performed based on the brain magnetic signals collected by the sensor array and the mapping relationship between the source space of the brain of the subject to be tested and the sensor space of the sensor array (for example, the guidance field matrix, which describes the geometric dimension relationship of the spatial conduction mapping of the electromagnetic activity in the source space of the brain to the sensor space of the sensor array), so as to obtain the position information of the source field point in the brain that generates the electromagnetic activity (i.e., related to the brain magnetic signal).

[0025] In some embodiments, the position sensor may be a sensor capable of detecting the position of an object, such as a camera, a laser radar, etc. When the position sensor is a laser radar, the number of position sensors may be set to one or more. When the position sensor is a camera, the position sensor may be set to multiple. That is, at least one position sensor may include multiple cameras. In this case, multiple cameras may obtain the three-dimensional spatial position of the head of a human body based on the parallax principle. It should be understood that when the position sensor is a camera, the number of position sensors may also be set to one.

[0026] In some embodiments, when the brain magnetic system is a horizontal structure, the brain magnetic system may include a bed and a magnetic shielding cabin covering the bed. The subject to be tested lies on the bed and places the head in the brain magnetic helmet. At this time, at least one position sensor may be arranged on the magnetic shielding cabin to detect the position information of the head of the subject to be tested on the bed (optionally, and the brain magnetic helmet).

[0027] In some other embodiments, the brain magnetometry system may also be a vertical structure. In this case, the brain magnetometry helmet may be in a suspended state, and the subject to be tested may be in a sitting position and wear the brain magnetometry helmet. In a vertical structure brain magnetometry system, at least one position sensor is disposed on a wall or ceiling of a room.

[0028] Figure 2 FIG. 2 shows a schematic diagram of a brain magnetometry system 2000 according to some other exemplary embodiments of the present disclosure. The features of the brain magnetometry helmet 110, the sensor array 111, and the at least one position sensor 120 in the brain magnetometry system 2000 are similar to those of FIG. Figure 1The features of the brain magnetic helmet 110, the sensor array 111, and the at least one position sensor 120 are the same, and for the sake of brevity, they are not described in detail here. Figure 2 The Brain Magnetism System 2000 and Figure 1 The difference between the Magnetoencephalographic system 1000.

[0029] In some embodiments, the brain magnetic system 2000 also includes a brain magnetic stimulation controller 140 and a signal acquisition device 150. The brain magnetic stimulation controller 140 is connected to the brain magnetic stimulator 141 to control the brain magnetic stimulator 141 to output, for example, a picture, so that the object to be tested stimulated by the brain magnetic stimulator generates electromagnetic activity at one or some source field points in its brain to be detected by the sensor array 111. While the brain magnetic stimulation controller 140 controls the brain magnetic stimulator 141 to output the picture, the brain magnetic stimulation controller 140 will also send a hard trigger signal (which includes time information) representing the number of triggers (also called trials) to the signal acquisition device 150 accordingly. The signal acquisition device 150 can also obtain brain magnetic signals from the sensor array 111. In some examples, the brain magnetic system 2000 also includes a position detection device 160. The position detection device 160 is connected between the position sensor 120 and the signal acquisition device 150. The position detection device 160 can obtain the position information of the head (and the brain magnetic helmet) from the position sensor, and send a hard trigger signal (including time information) representing one acquisition (for example, one optical capture frame) to the signal acquisition device 150 when the position sensor 120 (for example, a camera) performs position acquisition. In some examples, the signal acquisition device 150 can obtain m times of position acquisition information corresponding to the nth trigger number (for example, m frames of optical capture information) by aligning the hard trigger signal sent by the position detection device 160 with the hard trigger signal sent by the brain magnetic stimulation controller 140 in time, such as Figure 5 That is to say, the EEG signals collected in the same time period (for example, the time period between the nth trigger number and the n+1th trigger number) can be found (for example, Figure 5 The EEG magnetic signal 520 (the EEG magnetic signal between the nth trigger number and the n+1th trigger number) and the head position change information (for example, the optical capture information of m frames) are used to compensate the forward propagation model using the head position change information.

[0030] In some embodiments, the brain magnetic system 2000 may also include a processor 170. The processor 170 is connected to the signal acquisition device 150 and the position detection device 160, and can obtain the brain magnetic signal and the position information of the head (additionally, the brain magnetic helmet) from the signal acquisition device 150 and the position detection device 160, respectively, so as to calculate and compensate for the traceability positioning. In some examples, a hard trigger signal representing the number of triggers and a hard trigger signal representing one acquisition (for example, one optical capture frame) can also be obtained from the signal acquisition device 150 and the position detection device 160, respectively, and the two can be aligned in time.

[0031] Figure 3 FIG. 3 is a flowchart of a method 3000 for tracing and localizing a source of a brain magnetoencephalogram system according to some exemplary embodiments of the present disclosure. The method 3000 can be used, for example, to Figure 1 The magnetoencephalographic system 1000 shown or Figure 2 The illustrated brain magnetometry system 2000 may be specifically executed by the controller or processor in the brain magnetometry system 1000 or the processor 170 or controller in the brain magnetometry system 2000. Figure 3 As shown, the source tracing and positioning method 3000 may include: step S301, obtaining the brain magnetic signal from the brain in the head 131 collected by the sensor array 111; step S302, obtaining the position change information of the head 131 of the object 130 to be measured relative to the brain magnetic helmet 110 determined by at least one position sensor 120; step S303, based on the position change information, updating the pre-established forward propagation model of the brain magnetic system, wherein the forward propagation model is a mathematical model representing the relationship between the electromagnetic activity of the source field point in the brain and the brain magnetic signal collected by the sensor array 111, and the forward propagation model is related to the mapping relationship between the source space of the brain and the sensor space of the sensor array; step S304, based on the brain magnetic signal and the updated forward propagation model, locating the source field point in the brain related to the brain magnetic signal.

[0032] The above-mentioned implementation method can determine the position change of the head of the subject to be tested relative to the EEG helmet during the EEG examination, and use the position change information to compensate for the head movement of the subject to be tested in the EEG tracing and positioning data processing flow, so as to obtain a more accurate forward propagation model, thereby improving the accuracy of EEG tracing and positioning.

[0033] In step S301, for example, the brain magnetic stimulation controller 140 can control the brain magnetic stimulator 141 to output, for example, a picture, so that the subject to be tested stimulated by the brain magnetic stimulator generates electromagnetic activity at one or some source field points in its brain to be detected by the sensor array 111. Thus, the sensor array 111 can collect brain magnetic signals from the brain in the head 131. In other words, the sensor array 111 detects that electromagnetic activity is generated at one or some source field points in the brain of the subject to be tested, and outputs brain magnetic signals associated with the electromagnetic activity.

[0034] In step S302, when the brain magnetic system is a horizontal structure, the brain magnetic helmet is relatively fixed to the magnetic shielding cabin, so the position information of the head of the subject to be tested can be collected only by at least one position sensor 120, so as to determine the position change information of the head 131 of the subject to be tested 130 relative to the brain magnetic helmet 110 in combination with the initial position of the head. When the brain magnetic helmet is in a suspended state, the position of the brain magnetic helmet may also change. At this time, the position information of the head of the subject to be tested and the position information of the brain magnetic helmet can be collected by at least one position sensor 120, and the position change information of the head relative to the brain magnetic helmet can be determined in combination with the initial position of the head and the initial position of the brain magnetic helmet. The position sensor can perform position detection in real time, or perform position detection once every preset time interval, or perform position detection in response to other sensors detecting that the head of the subject to be tested moves. In the brain magnetic system 2000, the position detection device 160 sends a hard trigger signal representing one detection (for example, one optical capture frame) to the signal acquisition device 150 when the position sensor 120 (for example, a camera) performs position detection.

[0035] In step S303, the brain is discretely modeled and divided into M potential source points (e.g., dipole source points) according to the brain anatomical structure. The electromagnetic activity of the source points of the brain can be written as a time series matrix q(t), whose dimension is M×N, where M is the number of source points and N is the number of sampling points of the time series. The forward propagation model can be written, for example, as:

[0036] Q(t)=L·q(t).

[0037] Among them, Q(t) is the brain magnetic signal collected by the sensor array, and its dimension is S×N, S is the number of channels of the sensor array, N is the number of sampling points of the time series, and L is the mapping relationship between the source space of the brain of the subject to be tested and the sensor space of the sensor array, for example, the guiding field matrix, which describes the geometric size relationship of the electromagnetic activity of the source space of the brain to the sensor space of the sensor array for spatial conduction mapping. After the initial registration, the initial mapping relationship between the source space of the brain and the sensor space of the sensor array is recorded as L0, and the pre-established forward propagation model is Q(t)=L0·q(t).

[0038] In some examples, a pre-established forward propagation model can be obtained in the following manner: performing spatial registration to obtain the positional relationship between the head and the sensor array (for example, the positional relationship between the human head and brain relative to the brain magnetic helmet can be obtained through optical and electromagnetic positioning methods, and the brain magnetic helmet and the sensor array thereon are relatively fixed, so the positional relationship between the human head and the sensor array can be obtained); based on the image of the anatomical structure of the head acquired by the medical imaging device and the initial spatial registration information (the initial positional relationship between the head and the sensor array), a three-dimensional model of the brain-sensor array is established; based on the three-dimensional model, a forward propagation model from the electromagnetic activity of the source field point of the brain to the brain magnetic signals acquired by the sensor array is established.

[0039] In some examples, the determined position change information of the head relative to the magnetoencephalogram helmet can be used to directly update the mapping relationship in the forward propagation model, or the initial spatial registration information can be updated to update the three-dimensional model. The above methods can all achieve the update of the forward propagation model.

[0040] In step S304, since the EMG signal collected by the sensor signal has been obtained, the updated forward propagation model can be reversely solved to determine the location of the source field point in the brain related to the EMG signal.

[0041] In some embodiments, the mapping relationship in the pre-established forward propagation model can be determined based on the image of the head acquired by the medical imaging device and the initial relative position information between the head and the brain magnetic helmet. Specifically, the positional relationship between the brain and the head in the head can be obtained based on the image of the anatomical structure of the head acquired by the medical imaging device, and the positional relationship between the head and the brain magnetic helmet can be obtained based on optical positioning and other methods, and the positional relationship between the brain magnetic helmet and the sensor array thereon is fixed. Therefore, the positional relationship between the brain and the sensor array can be obtained based on the positional relationship between the brain and the head, and the positional relationship between the head and the brain magnetic helmet, thereby obtaining the mapping relationship between the source space of the brain and the sensor space of the sensor array. At this time, step S303, based on the position change information, updating the pre-established forward propagation model of the brain magnetic system may include: based on the position change information, updating the mapping relationship in the pre-established forward propagation model. For example, when the forward propagation model is written as Q(t)=L·q(t), the updated mapping relationship is recorded as Then we can get the updated forward propagation model Since the EEG magnetic signal Q(t) collected by the sensor array is known, the updated By performing the reverse solution, a more accurate electromagnetic activity q(t) of the source field point in the brain can be obtained, thereby locating the source field point more accurately.

[0042] In some embodiments, the pre-established forward propagation model can be determined by a three-dimensional model pre-established based on an image of the head acquired by a medical imaging device and initial relative position information between the head and the brain magnetoencephalogram helmet, wherein the three-dimensional model includes a model corresponding to the brain and the sensor array. Step S303, based on the position change information, updating the pre-established forward propagation model of the brain magnetoencephalogram system includes: updating the pre-established three-dimensional model based on the position change information; and updating the pre-established forward propagation model based on the updated three-dimensional model. Specifically, for example, Figure 4 As shown, a three-dimensional model is pre-established based on the initial relative position information p0 between the head and the brain magnetic helmet and the image I0 of the head acquired by the medical imaging device. Then, the pre-established three-dimensional model is updated based on the position change information p1 to obtain an updated three-dimensional model d0. According to the updated three-dimensional model d0, the pre-established forward propagation model Q(t) = L0·q(t) is updated. Since the brain magnetic signal Q(t) acquired by the sensor array is known, the updated forward propagation model can be reversely solved, and the electromagnetic activity q(t) of the source field point in the brain can be obtained, thereby locating the source field point, as shown in FIG. Figure 4 The source field point O1 located in the three-dimensional model. The above implementation can achieve more accurate source tracing and positioning.

[0043] In some embodiments, Figure 1 As shown, a plurality of marking points 180 are set on the face of the object to be tested 130. Step S302, obtaining the position change information of the head of the object to be tested relative to the brain magnetic helmet determined by at least one position sensor may include: obtaining the position information of at least a plurality of marking points collected by each position sensor of at least one position sensor; and determining the position change information of the head of the object to be tested relative to the brain magnetic helmet based on at least the position information of the plurality of marking points obtained by each position sensor. By setting a plurality of marking points, it is convenient to establish a stereoscopic model of the entire head in a three-dimensional space, so as to determine the movement information of the entire head. When the position sensor is a laser radar, the number of position sensors can be set to one or more. When the position sensor is a camera, the position sensor can be set to multiple, so that the position of the marking point can be determined according to the parallax principle. The position information obtained by multiple position sensors can be processed according to the data processing method in the prior art to obtain more accurate position information. It should be understood here that when the position sensor is a camera, the number of position sensors can also be set to one.

[0044] In some embodiments, the locations where the multiple markers are set include the locations of multiple ones of the cheekbones, the jawbone, the frontal bone, and the brow bone on the face. Since the above positions are relative to the rigidity of the head, a rigid body model of the head in three-dimensional space can be established through these markers. At this time, based on the position information of each marker point, combined with the rigid body model of the head, the position information of the entire head in three-dimensional space is determined.

[0045] In the case where the brain magnetism system is a horizontal structure, the brain magnetism helmet is relatively fixed to the magnetic shielding cabin, so that only the position information of the head of the subject to be tested can be collected through at least one position sensor 120, so as to determine the position change information of the head 131 of the subject to be tested 130 relative to the brain magnetism helmet 110 in combination with the initial position of the head. At this time, obtaining the position information of at least a plurality of marking points collected by each position sensor of at least one position sensor may include obtaining the position information of a plurality of marking points collected by each position sensor of at least one position sensor. Based at least on the position information of the plurality of marking points obtained by each position sensor, determining the position change information of the head of the subject to be tested relative to the brain magnetism helmet may include: determining the position change information of the head of the subject to be tested relative to the brain magnetism helmet based on the position information of the plurality of marking points obtained by each position sensor.

[0046] When the brain magnetic system is in a suspended state, the position of the brain magnetic helmet may also change. At this time, the position information of the head of the object to be tested and the position information of the brain magnetic helmet can be collected by at least one position sensor 120, and the position change information of the head relative to the brain magnetic helmet can be determined in combination with the initial position of the head and the initial position of the brain magnetic helmet. At this time, obtaining the position information of at least a plurality of marking points collected by each position sensor of at least one position sensor may include obtaining the position information of a plurality of marking points and the brain magnetic helmet collected by each position sensor of at least one position sensor. Based at least on the position information of the plurality of marking points obtained by each position sensor, determining the position change information of the head of the object to be tested relative to the brain magnetic helmet may include: determining the position change information of the head of the object to be tested relative to the brain magnetic helmet based on the plurality of marking points and the position information of the brain magnetic helmet obtained by each position sensor.

[0047] In some embodiments, the EEG signal includes the EEG signal collected in each of the multiple time periods, the position change information includes multiple representative position change information of the head relative to the EEG helmet, and step S302, obtaining the position change information of the head of the subject to be tested relative to the EEG helmet determined by at least one position sensor may include: obtaining multiple position information of the head collected by at least one position sensor to determine multiple position change information of the head (for example, multiple marking points) relative to the EEG helmet, each of the multiple position change information includes the collection time of the position information corresponding to the position change information; for each of the multiple time periods, based on the collection time of each position change information, determining multiple first position change information corresponding to the time period from the multiple position change information; processing the multiple first position change information to determine the representative position change information of the head relative to the EEG helmet in the time period. Among them, the method of obtaining multiple position information of the head collected by at least one position sensor to determine the position change information of the head (for example, multiple marking points) relative to the EEG helmet in the multiple position change information of the EEG helmet is the same as the aforementioned method of determining the position change information of the head relative to the EEG helmet, which will not be described in detail here. In some examples, processing multiple first position change information may include averaging the multiple first position change information to obtain the average value as the representative position change information for the time period. Alternatively, the median of multiple first position change information may be selected as the representative position change information for the time period. In the above embodiment, the position change information within the time period is processed in units of time periods to obtain representative position change information, thereby reducing the amount of calculation for subsequent updates and traceability positioning, and reducing the occupation of computing resources. This is because the movement of the head is relatively slow, so it can be assumed that the head is stationary within a time period.

[0048] In some examples, each of the multiple time periods may be a time period between two adjacent hard trigger signals (representing the number of triggers) sent by the brain magnetic stimulation controller. That is, it is assumed that the head is motionless within one trigger. Alternatively, each time period may also be a time period between three or four adjacent hard trigger signals, and the present disclosure is not limited thereto. For example, Figure 5 As shown, while the brain magnetic stimulation controller 140 controls the brain magnetic stimulator 141 to output the image, the brain magnetic stimulation controller 140 accordingly sends a hard trigger signal 520 representing the number of triggers to the signal acquisition device 150 (wherein each of the multiple time periods is the time period between adjacent hard trigger signals, for example, the time period between the n+1th hard trigger signal and the nth hard trigger signal). The position detection device 160 also sends a hard trigger signal 530 representing one acquisition (for example, one optical capture frame) to the signal acquisition device 150 when the position sensor 120 (for example, a camera) performs position acquisition. By aligning the hard trigger signal 520 representing the number of triggers and the hard trigger signal 530 representing one acquisition (for example, one optical capture frame) in time, multiple first position change information corresponding to the time period can be determined from multiple position change information, for example, the position change information of the time period between the nth trigger number and the n+1th trigger number in the multiple position change information 530, that is, m frames of optical capture information, which corresponds to the electroencephalographic signal between the nth trigger number and the n+1th trigger number in the electroencephalographic signal 510.

[0049] In the above embodiment, step S303, based on the position change information, updating the pre-established forward propagation model of the brain magnetism system may include: for each of the multiple time periods, based on the representative position change information of the head relative to the brain magnetism helmet in the time period, updating the pre-established forward propagation model of the brain magnetism system to obtain an updated forward propagation model for the time period, and based on the brain magnetism signal and the updated forward propagation model, locating the source field point in the brain related to the brain magnetism signal may include: based on the brain magnetism signal obtained in the time period and the updated forward propagation model for the time period, locating the source field point in the brain that generates the brain magnetism signal in the time period. Among them, the method of updating the pre-established forward propagation model of the brain magnetism system is the same as the aforementioned method of updating the pre-established forward propagation model of the brain magnetism system, which will not be described in detail here.

[0050] In the case where each of the multiple time periods is a time period between adjacent hard trigger signals (representing the number of triggers), the association relationship within the nth trigger can be expressed as L=L n (t n ≤t<t n+1), where t is time. The forward propagation model in the nth trigger can be expressed as Q n (t) = L n q(t), where Q n (t) is the EEG signal collected in the nth trigger. Based on the representative position change information of the head relative to the EEG helmet in the nth trigger, the association relationship in the forward propagation model is updated to obtain the updated association relationship L in the nth trigger. n =H n L0, where H n is the initial association relationship L0 and the association relationship L in the nth trigger n At this time, the forward propagation model can be expressed as At this time, the EEG magnetic signal Q collected in the nth trigger can be used to n (t) Yes Perform reverse solution to locate the source field point of the brain magnetic brain signal generated in the nth trigger. The source tracing and locating method in the n+1th trigger is the same as the source tracing and locating method in the nth trigger, and will not be described in detail here.

[0051] Figure 6 FIG. 6 is a schematic block diagram of a source tracing and localization device 6000 for a magnetoencephalometric system 1000 or 2000 according to an exemplary embodiment of the present disclosure. Figure 6 As shown, the source tracing and positioning device 6000 may include an acquisition module 601, a determination module 602, an update module 603, and a positioning module 604. The acquisition module 601 is configured to obtain brain magnetic signals from the brain in the head collected by the sensor array. The determination module 602 is configured to obtain the position change information of the head of the subject to be measured relative to the brain magnetic helmet determined by at least one position sensor. The update module 603 is configured to update the pre-established forward propagation model of the brain magnetic system based on the position change information, wherein the forward propagation model is a mathematical model representing the relationship between the electromagnetic activity of the source field point in the brain and the brain magnetic signal collected by the sensor array, and the forward propagation model is related to the mapping relationship between the source space of the brain and the sensor space of the sensor array. The positioning module 604 is configured to locate the source field point related to the brain magnetic signal in the brain based on the brain magnetic signal and the updated forward propagation model.

[0052] It should be understood that Figure 6 The various modules of the device 6000 shown in FIG. Figure 3 The steps in the method 3000 described above correspond to each other. Therefore, the operations, features and advantages described above for the method 3000 are also applicable to the device 6000 and the modules included therein. For the sake of brevity, some operations, features and advantages are not repeated here.

[0053] According to yet another aspect of the present disclosure, an electronic device is provided, including: a memory, a processor, and a computer program stored in the memory, wherein the processor is configured to execute the computer program to implement the method 3000 described above.

[0054] According to another aspect of the present disclosure, Figure 1 and 2 As shown, a brain magnetometry system 1000 or 2000 is provided, and the brain magnetometry system 1000 or 2000 may include: a brain magnetometry helmet 110; a sensor array 111 fixed on the brain magnetometry helmet 110; at least one position sensor 120 for collecting position information of the head of the object to be tested; and the above-mentioned tracing and positioning device 6000 or the above-mentioned electronic device.

[0055] According to yet another aspect of the present disclosure, a non-transitory computer-readable storage medium storing a computer program is provided, wherein the computer program implements the method 3000 described above when executed by a processor.

[0056] According to yet another aspect of the present disclosure, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the method 3000 described above is implemented.

[0057] In the following, combined Figure 7 Illustrative examples of such a computer device, non-transitory computer-readable storage medium, and computer program product are described.

[0058] Figure 7 An example configuration of an electronic device 700 is shown that may be used to implement the modules and functions described herein.

[0059] The electronic device 700 can be a variety of different types of devices, such as a server of a service provider, a device associated with a client (e.g., a client device), a system on a chip, and / or any other suitable electronic device or computing system. Examples of the electronic device 700 include, but are not limited to, a desktop computer, a server computer, a laptop or netbook computer, a mobile device (e.g., a tablet or phablet device, a cellular or other wireless phone (e.g., a smart phone), a notepad computer, a mobile station), a wearable device (e.g., glasses, a watch), an entertainment device (e.g., an entertainment appliance, a set-top box communicatively coupled to a display device, a game console), a television or other display device, a car computer, and the like. Therefore, the electronic device 700 can range from a full-resource device with a large amount of memory and processor resources (e.g., a personal computer, a game console) to a low-resource device with limited memory and / or processing resources (e.g., a traditional set-top box, a handheld game console).

[0060] The electronic device 700 may include at least one processor 702, memory 704, communication interface(s) 706, a display device 708, other input / output (I / O) devices 710, and one or more mass storage devices 712 that can communicate with each other, such as via a system bus 714 or other appropriate connection.

[0061] The processor 702 may be a single processing unit or multiple processing units, all of which may include a single or multiple computing units or multiple cores. The processor 702 may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuits, and / or any device that manipulates signals based on operating instructions. Among other capabilities, the processor 702 may be configured to obtain and execute computer-readable instructions stored in the memory 704, mass storage device 712, or other computer-readable media, such as program codes of an operating system 716, program codes of an application program 718, program codes of other programs 720, and the like.

[0062] The memory 704 and the mass storage device 712 are examples of computer storage media for storing instructions that are executed by the processor 702 to implement the various functions described above. For example, the memory 704 may generally include both volatile memory and non-volatile memory (e.g., RAM, ROM, etc.). In addition, the mass storage device 712 may generally include a hard drive, a solid-state drive, removable media, including external and removable drives, memory cards, flash memory, floppy disks, optical disks (e.g., CDs, DVDs), storage arrays, network attached storage, storage area networks, etc. The memory 704 and the mass storage device 712 may all be collectively referred to herein as memory or computer storage media, and may be non-transitory media capable of storing computer-readable, processor-executable program instructions as computer program code that may be executed by the processor 702 as a specific machine configured to implement the operations and functions described in the examples herein.

[0063] A plurality of program modules may be stored on a mass storage device 712. These programs include an operating system 716, one or more application programs 718, other programs 720, and program data 722, and they may be loaded into the memory 704 for execution. Examples of such application programs or program modules may include, for example, computer program logic (e.g., computer program code or instructions) for implementing the following components / functions: a source tracing and positioning device 6000 (including a collection module 601, a determination module 602, an update module 603, and a positioning module 604), a method 3000 (including any suitable steps of the method 3000), and / or other embodiments described herein.

[0064] Although in Figure 7 704 of the electronic device 700, but modules 716, 718, 720, and 722, or portions thereof, may be implemented using any form of computer-readable media accessible by the electronic device 700. As used herein, "computer-readable media" includes at least two types of computer-readable media, namely, computer storage media and communication media.

[0065] Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented by any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data. Computer storage media includes but is not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD), or other optical storage devices, magnetic cassettes, magnetic tapes, magnetic disk storage devices or other magnetic storage devices, or any other non-transmission media that can be used to store information for access by an electronic device.

[0066] In contrast, communication media may embody computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism. Computer storage media as defined herein does not include communication media.

[0067] The electronic device 700 may also include one or more communication interfaces 706 for exchanging data with other devices, such as through a network, direct connection, etc., as discussed above. Such communication interfaces may be one or more of the following: any type of network interface (e.g., a network interface card (NIC)), a wired or wireless (such as an IEEE 802.11 wireless LAN (WLAN)) wireless interface, a Worldwide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a Bluetooth™ interface, a Near Field Communication (NFC) interface, etc. The communication interface 706 may facilitate communication within a variety of network and protocol types, including wired networks (e.g., LAN, cable, etc.) and wireless networks (e.g., WLAN, cellular, satellite, etc.), the Internet, etc. The communication interface 706 may also provide communication with an external storage device (not shown) such as a storage array, a network attached storage, a storage area network, etc.

[0068] In some examples, a display device 708 such as a monitor may be included for displaying information and images to the user. Other I / O devices 710 may be devices that receive various inputs from the user and provide various outputs to the user, and may include a touch input device, a gesture input device, a camera, a keyboard, a remote control, a mouse, a printer, an audio input / output device, and the like.

[0069] Although the present disclosure has been illustrated and described in detail in the drawings and in the foregoing description, such illustration and description should be considered illustrative and exemplary rather than restrictive; the present disclosure is not limited to the disclosed embodiments. By studying the drawings, the disclosure and the appended claims, those skilled in the art will be able to understand and implement variations to the disclosed embodiments when practicing the claimed subject matter. In the claims, the word "comprising" does not exclude other elements or steps that are not listed, the indefinite article "a" or "an" does not exclude a plurality, and the term "plurality" means two or more. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Claims

1. A source tracing and positioning method for a brain magnetometry system, the brain magnetometry system comprising a brain magnetometry helmet, a sensor array fixed on the brain magnetometry helmet, and at least one position sensor for collecting position information of the head of a subject to be tested, the brain magnetometry helmet is located on the head of the subject to be tested, and the source tracing and positioning method comprises: Acquiring brain magnetic signals from the brain in the head collected by the sensor array; Acquiring position change information of the head of the subject to be measured relative to the brain magnetic helmet determined by the at least one position sensor; Based on the position change information, a pre-established forward propagation model of the brain magnetic system is updated, wherein the forward propagation model is a mathematical model representing the relationship between the electromagnetic activity of the source field point in the brain and the brain magnetic signal collected by the sensor array, and the forward propagation model is related to the mapping relationship between the source space of the brain and the sensor space of the sensor array; as well as Based on the magnetic brain signal and the updated forward propagation model, the source field point in the brain related to the magnetic brain signal is located.

2. The method for tracing and locating the source according to claim 1, wherein: The mapping relationship in the pre-established forward propagation model is determined based on the image of the head acquired by a medical imaging device and the initial relative position information between the head and the brain magnetometry helmet, and, based on the position change information, updating the pre-established forward propagation model of the brain magnetometry system includes: Based on the position change information, the mapping relationship in the pre-established forward propagation model is updated.

3. The method for tracing and locating the source according to claim 1, wherein: The pre-established forward propagation model is determined by a three-dimensional model pre-established based on an image of the head acquired by a medical imaging device and initial relative position information between the head and the brain magnetotelluric helmet, wherein the three-dimensional model includes a model corresponding to the brain and the sensor array, and based on the position change information, updating the pre-established forward propagation model of the brain magnetotelluric system includes: Based on the position change information, updating the pre-established three-dimensional model; and Based on the updated three-dimensional model, the pre-established forward propagation model is updated.

4. The method for tracing and locating the source according to claim 1, wherein: A plurality of marking points are arranged on the face of the subject to be tested, and obtaining the position change information of the head of the subject to be tested relative to the brain magnetic helmet determined by the at least one position sensor includes: Acquire position information of at least the plurality of marking points collected by each position sensor of the at least one position sensor; and At least based on the position information of the multiple marking points acquired by each position sensor, the position change information of the head of the object to be measured relative to the brain magnetic helmet is determined.

5. The method for tracing and locating the source according to claim 4, wherein: The setting positions of the multiple marking points include the positions of multiple ones of the cheekbones, the jawbone, the frontal bone and the brow bone on the face.

6. The method for tracing and locating the source according to claim 1, wherein: The brain magnetic signal includes a brain magnetic signal collected in each time period of a plurality of time periods, the position change information includes a plurality of representative position change information of the head relative to the brain magnetic helmet, and obtaining the position change information of the head of the subject to be measured relative to the brain magnetic helmet determined by the at least one position sensor includes: Acquire multiple pieces of position information of the head collected by the at least one position sensor to determine multiple pieces of position change information of the head relative to the magnetic brain helmet, wherein each piece of position change information in the multiple pieces of position change information includes a collection time of the position information corresponding to the position change information; For each of the multiple time periods, Based on the collection time of each piece of position change information, determine a plurality of first position change information corresponding to the time period from the plurality of position change information; The plurality of first position change information are processed to determine representative position change information of the head relative to the brain magnetoencephalogram helmet in the time period.

7. The method for tracing and locating the source according to claim 6, wherein: Based on the position change information, updating the pre-established forward propagation model of the magnetoencephalogram system includes: For each of the multiple time periods, based on the representative position change information of the head relative to the EEG helmet in the time period, updating the pre-established forward propagation model of the EEG system to obtain an updated forward propagation model for the time period; and Based on the EEG signal and the updated forward propagation model, locating a source field point in the brain related to the EEG signal includes: Based on the EEG magnetic signals acquired in the time period and the updated forward propagation model for the time period, the source field point in the brain that generates the EEG magnetic signals collected in the time period is located.

8. A source tracing and positioning device for a brain magnetometry system, the brain magnetometry system comprising a brain magnetometry helmet, a sensor array fixed on the brain magnetometry helmet, and at least one position sensor for collecting position information of the head of a subject to be tested, the brain magnetometry helmet is located on the head of the subject to be tested, and the source tracing and positioning device comprises: A collection module, the collection module is configured to obtain brain magnetic signals from the brain in the head collected by the sensor array; A determination module, the determination module is configured to obtain position change information of the head of the subject to be measured relative to the brain magnetic helmet determined by the at least one position sensor; An updating module, wherein the updating module is configured to update a pre-established forward propagation model of the brain magnetic system based on the position change information, wherein the forward propagation model is a mathematical model representing the relationship between the electromagnetic activity of the source field point in the brain and the brain magnetic signal collected by the sensor array, and the forward propagation model is related to the mapping relationship between the source space of the brain and the sensor space of the sensor array; as well as A positioning module is configured to locate a source field point in the brain related to the EEG signal based on the EEG signal and an updated forward propagation model.

9. An electronic device, comprising: at least one processor; as well as a memory communicatively coupled to the at least one processor; in The memory stores a computer program, and when the computer program is executed by the at least one processor, the computer program implements the tracing and positioning method according to any one of claims 1 to 7.

10. A brain magnetic system, comprising: Brain magnetic helmet; A sensor array fixed on the brain magnetic helmet; At least one position sensor for collecting position information of the head of the object to be measured; as well as The traceability positioning device according to claim 8 or the electronic device according to claim 9.

11. One or more computer-readable storage media having instructions stored thereon, wherein the instructions, in response to being executed by one or more processors, prompt the one or more processors to execute the traceability and positioning method according to any one of claims 1 to 7.

12. A computer program product comprising a computer program, wherein: When the computer program is executed by a processor, the computer program implements the source tracing and positioning method according to any one of claims 1 to 7.

Images