Brain function region positioning method and device, electronic equipment and storage medium

Abstract

The invention discloses a brain function region positioning method and device, electronic equipment and a storage medium, and relates to the technical field of image processing. The brain function region positioning method comprises the steps of obtaining first video data and second video data, wherein the first video data and the second video data are head multi-angle videos recorded when a user does not wear a wearable device and when the user wears a wearable device; respectively obtaining a first three-dimensional model and a second three-dimensional model of the head of the user according to the first video data and the second video data; obtaining relative position information of a detection device on the wearable equipment and the head of the user according to the first three-dimensional model and the second three-dimensional model; and performing registration on the first three-dimensional model and a preset standard space template, and obtaining a brain region position of the user corresponding to the detection device according to a registration result and the relative position information. The method can improve the accuracy of brain region positioning, and is low in equipment requirement, low in implementation cost and convenient to popularize and use.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to a method and device for locating brain functional areas, an electronic device and a storage medium. Background Art

[0002] At present, the main means of acquiring brain cognitive signals with high ecological validity are electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS). However, due to differences between individuals, each person's head shape is different, which results in different specific brain area locations being measured even though individuals wear the same channels and electrodes in the same way. In addition, the above methods also need to be combined with field magnetic technology to collect the location of each channel, but the acquisition cost of nuclear magnetic resonance (MRI) signals is high and inconvenient. Summary of the invention

[0003] The present invention aims to solve one of the technical problems in the related art to at least a certain extent. To this end, the purpose of the present invention is to provide a method, device, electronic device and storage medium for locating brain functional areas to improve the accuracy of brain area positioning, with low equipment requirements, low cost and convenient for wide use.

[0004] In a first aspect, an embodiment of the present invention proposes a method for locating brain functional areas, comprising: obtaining first video data and second video data, wherein the first video data is a multi-angle head video recorded when the user is not wearing a wearable device on his head, and the second video data is a multi-angle head video recorded when the user is wearing a wearable device on his head; obtaining a first three-dimensional model of the user's head according to the first video data, and obtaining a second three-dimensional model of the user's head according to the second video data; obtaining relative position information between a detection device on the wearable device and the user's head according to the first three-dimensional model and the second three-dimensional model; aligning the first three-dimensional model with a preset standard space template, and obtaining the position of the user's brain area corresponding to the detection device according to the alignment result and the relative position information.

[0005] According to one embodiment of the present invention, obtaining the first three-dimensional model of the user's head based on the first video data includes: extracting the user's head feature points from each frame in the first video data; performing feature matching on the head feature points to obtain the shape and motion information of the user's head; and obtaining the first three-dimensional model based on the shape and the motion information.

[0006] According to an embodiment of the present invention, when performing feature matching on the head feature points, a random sampling consistency algorithm is also used to remove erroneous matching points.

[0007] According to one embodiment of the present invention, the first three-dimensional model includes preset head markers of the user, and the second three-dimensional model includes the preset head markers and detection device markers; obtaining the relative position information of the detection device on the wearable device and the user's head based on the first three-dimensional model and the second three-dimensional model includes: aligning the first three-dimensional model and the second three-dimensional model according to the preset head markers to obtain the position of the detection device on the user's scalp surface; obtaining the relative position information based on the position of the detection device on the user's scalp surface and the preset head markers.

[0008] According to one embodiment of the present invention, obtaining the relative position information based on the position of the detection device on the user's scalp surface and the preset head marker points includes: determining the position of the detection device on the user's scalp surface and the three-dimensional coordinates of the preset head marker points; obtaining the relative position information based on the three-dimensional coordinates and the position of the preset head marker points on the user's head.

[0009] According to one embodiment of the present invention, the preset head markers include at least two of the user's nose bridge position, bilateral ear hole mastoid positions, and posterior cranial protuberance position.

[0010] According to one embodiment of the present invention, the first three-dimensional model is registered with a preset standard space template, and the position of the brain area of ​​the user corresponding to the detection device is obtained based on the registration result and the relative position information, including: voxelizing the first three-dimensional model, and converting the voxelized first three-dimensional model into a voxel scale that is the same as the preset standard space template; mapping the voxels of the first three-dimensional model with the preset standard space template using a non-rigid registration method; and obtaining the position of the brain area of ​​the user corresponding to the detection device based on the mapping result and the relative position information.

[0011] In the second aspect, an embodiment of the present invention proposes a brain area positioning device, including: an acquisition module, used to acquire first video data and second video data, wherein the first video data is a multi-angle head video recorded when the user is not wearing a wearable device on his head, and the second video data is a multi-angle head video recorded when the user is wearing a wearable device on his head; a first processing module, used to obtain a first three-dimensional model of the user's head according to the first video data, and to obtain a second three-dimensional model of the user's head according to the second video data; a second processing module, used to obtain the relative position information of the detection device on the wearable device and the user's head according to the first three-dimensional model and the second three-dimensional model; a registration module, used to align the first three-dimensional model with a preset standard space template, and obtain the position of the user's brain area corresponding to the detection device according to the registration result and the relative position information.

[0012] In a third aspect, an embodiment of the present invention provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the brain functional area locating method described in the first aspect are implemented.

[0013] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the method for locating brain functional areas described in the first aspect are implemented.

[0014] The method, device, electronic device, and storage medium for locating brain functional areas of the embodiments of the present invention first obtain multi-angle head videos recorded when the user's head is not wearing a wearable device and when the user is wearing a wearable device, and obtain first video data and second video data; then obtain a first three-dimensional model of the user's head based on the first video data, and obtain a second three-dimensional model of the user's head based on the second video data; then obtain the relative position information between the detection device on the wearable device and the user's head based on the first three-dimensional model and the second three-dimensional model; finally, align the first three-dimensional model with a preset standard space template, and obtain the position of the user's brain area corresponding to the detection device based on the alignment result and the relative position information. In this process, the shape of the user's real head is obtained, and an alignment method with a preset standard space template is used, thereby improving the accuracy of brain area positioning; and this process does not require complex equipment, and has low requirements for equipment, so that the implementation cost is low and it is easy to promote and use. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a flow chart of a method for locating brain functional areas according to an embodiment of the present invention;

[0016] Figure 2 is a schematic diagram of second video data of an example of the present invention;

[0017] Figure 3 is a flow chart of a method for locating brain functional areas according to a specific embodiment of the present invention;

[0018] Figure 4 is a structural block diagram of a brain functional area positioning device according to an embodiment of the present invention;

[0019] Figure 5 It is a structural block diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0020] At present, the common method for obtaining the scalp position corresponding to the channel (which may correspond to the EEG electrode) on the EEG signal acquisition device is to use a magnetic field positioning pen to record the position by contacting the position of the channel on the scalp before and after the measurement. However, this method is applicable to limited equipment and is not suitable for equipment where the detector (such as EEG electrode) does not directly contact the scalp, such as the acquisition of high-density channels. In addition, if individual differences are to be eliminated to achieve accurate positioning of brain areas, it is necessary to scan the brain structure map of the individual through nuclear magnetic resonance technology, which is costly. To this end, the present invention proposes a universal brain area positioning method, which is implemented by image recognition, image registration, and model voxelization. Corresponding to the brain area positioning method, the present invention also proposes a brain area positioning device, an electronic device, and a computer-readable storage medium.

[0021] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.

[0022] The following describes the brain functional area positioning method, device, electronic device, and storage medium of the embodiments of the present invention with reference to the accompanying drawings.

[0023] Figure 1 It is a flow chart of a method for locating brain functional areas according to an embodiment of the present invention.

[0024] like Figure 1 As shown, the methods for locating brain functional areas include:

[0025] S11, obtaining first video data and second video data, wherein the first video data is a multi-angle head video recorded when the user is not wearing a wearable device on his head, and the second video data is a multi-angle head video recorded when the user is wearing a wearable device on his head.

[0026] Specifically, positioning tags can be set at at least two of the user's nose bridge, bilateral ear hole mastoids, and posterior cranial protuberance as preset head marking points; and positioning tags can be set on the channels (or light source and detector positions) on the wearable device as detection device marking points. When the user is not wearing a wearable device (such as the above-mentioned EEG signal acquisition device) on his head, a multi-angle video of the user's head can be recorded using a camera, smart phone, etc. Figure 2 As shown in FIG. 1 , when a user wears a wearable device on his head, a camera, a smart phone, etc. are used to record multi-angle videos of the user's head ( Figure 2 The figure shows video frames recorded at five angles when the user wears a wearable device on his head. The five angles are the back, right back, right side, right front and front side. The three corners of the green and red triangles in the figure correspond to the aforementioned light source or detector positions).

[0027] S12, obtaining a first three-dimensional model of the user's head according to the first video data, and obtaining a second three-dimensional model of the user's head according to the second video data.

[0028] In some embodiments of the present invention, a first three-dimensional model of a user's head is obtained based on first video data, including: extracting the user's head feature points from each frame in the first video data; performing feature matching on the head feature points to obtain shape and motion information of the user's head; and obtaining a first three-dimensional model based on the shape and motion information.

[0029] Specifically, feature extraction algorithms such as Scale-Invariant Feature Transform (SIFT), Speeded Up Robust Features (SURF), and ORB (Oriented FAST and Rotated BRIEF) can be used to extract the user's head feature points from each frame in the first video data, and determine the correspondence between the head feature points in different frames. Feature matching can be performed based on the correspondence, and the movement trajectory of the user's head in the video can be tracked, and then the shape and movement information of the user's head can be obtained; then, three-dimensional modeling can be performed based on the shape and movement information to obtain a three-dimensional model of the user's real head containing preset head markers (i.e., a first three-dimensional model). Similarly, a three-dimensional model of the user's head when wearing a wearable device containing preset head markers and detection device markers can be obtained (i.e., a second three-dimensional model).

[0030] In some examples, when performing feature matching on head feature points, a random sample consensus (RANSAC) algorithm is also used to remove erroneous matching points to improve the accuracy of feature matching.

[0031] S13, obtaining relative position information between the detection device on the wearable device and the user's head according to the first three-dimensional model and the second three-dimensional model.

[0032] In some embodiments of the present invention, the first three-dimensional model includes preset head marker points of the user, and the second three-dimensional model includes preset head marker points and detection device marker points; the relative position information of the detection device on the wearable device and the user's head is obtained based on the first three-dimensional model and the second three-dimensional model, including: aligning the first three-dimensional model and the second three-dimensional model according to the preset head marker points to obtain the position of the detection device on the surface of the user's scalp; obtaining relative position information based on the position of the detection device on the surface of the user's scalp and the preset head marker points.

[0033] In this embodiment, as an implementation method, relative position information is obtained based on the position of the detection device on the user's scalp surface and preset head marker points, including: determining the position of the detection device on the user's scalp surface and the three-dimensional coordinates of the preset head marker points; obtaining relative position information based on the three-dimensional coordinates and the position of the preset head marker points on the user's head.

[0034] Specifically, when registering the first three-dimensional model and the second three-dimensional model, due to the thickness of the wearable device, the detection device markers in the second three-dimensional model are projected onto the surface of the first three-dimensional model through registration, and the specific position of the detection device on the scalp surface can be obtained. Afterwards, the three-dimensional coordinates of each detection device marker and the preset head marker can be obtained using tools such as Maya, Python, or Matlab. Since the position of the preset head marker on the user's head is determined and fixed, the specific position of the detection device relative to the user's head (i.e., relative position information) can be obtained based on the three-dimensional coordinates of the detection device marker and the preset head marker.

[0035] S14, registering the first three-dimensional model with a preset standard space template, and obtaining the position of the user's brain region corresponding to the detection device according to the registration result and the relative position information.

[0036] In some embodiments of the present invention, the first three-dimensional model is aligned with a preset standard space template, and the position of the user's brain area (i.e., brain functional area) corresponding to the detection device is obtained based on the alignment result and the relative position information, including: voxelizing the first three-dimensional model, and converting the voxelized first three-dimensional model into the same voxel scale as the preset standard space template; mapping the voxels of the first three-dimensional model with the preset standard space template using a non-rigid alignment method; and obtaining the position of the user's brain area corresponding to the detection device based on the mapping result and the relative position information.

[0037] Specifically, the first three-dimensional model can be voxelized, and MagicaVoxel software can be used to convert the voxelized first three-dimensional model into the same voxel scale as a preset standard space template (such as MNI152, ICBM series template, Colin 27); then, the voxels of the user's head model are mapped to the preset standard space template using a non-rigid registration method, and the position of the user's brain area corresponding to the detection device can be obtained, thereby achieving brain area positioning.

[0038] For ease of understanding, the following Figure 3 The implementation process of the method for locating brain functional areas of the present invention is described by a specific embodiment:

[0039] like Figure 3 As shown, the first video data is recorded based on "no device + anchor point", and the first video data is feature recognized to obtain "head model A" (i.e., the first three-dimensional model), wherein no device means that the user does not wear a wearable device on his head, and the anchor point refers to setting a preset head mark point. The second video data is recorded based on "wearable device + channel mark + anchor point", and the second video data is feature recognized to obtain "head model B" (i.e., the second three-dimensional model) with a channel, wherein the wearable device refers to the wearable device on the user's head, the channel mark refers to setting a detection device mark point, and the anchor point refers to setting a preset head mark point.

[0040] Then, anchor point registration is performed on head model A and head model B to obtain "head model C with channel mapping to the scalp surface" (including the above relative position information). After that, head model C is "voxelized" and a non-rigid registration method is used to "register the preset standard control template" to obtain "head model D with channel mapping and brain area" (to achieve brain area positioning of the detection device).

[0041] The brain region positioning method of the embodiment of the present invention obtains the shape of the user's real head by recording multi-angle videos of the user's head, and uses voxel registration in the process of brain region registration, which is more accurate than anchor point registration. In addition, the method can be adapted to a variety of acquisition devices, has low requirements on the equipment, is low in cost, and can be widely used.

[0042] Figure 4 It is a structural block diagram of a brain functional area positioning device according to an embodiment of the present invention.

[0043] like Figure 4 As shown, the brain functional area positioning device 400 includes: an acquisition module 410, a first processing module 420, a second processing module 430 and a registration module 440.

[0044] Among them, the acquisition module 410 is used to obtain first video data and second video data, wherein the first video data is a multi-angle head video recorded when the user is not wearing a wearable device on his head, and the second video data is a multi-angle head video recorded when the user is wearing a wearable device on his head; the first processing module 420 is used to obtain a first three-dimensional model of the user's head according to the first video data, and to obtain a second three-dimensional model of the user's head according to the second video data; the second processing module 430 is used to obtain the relative position information of the detection device on the wearable device and the user's head according to the first three-dimensional model and the second three-dimensional model; the alignment module 440 is used to align the first three-dimensional model with a preset standard space template, and obtain the user's brain area position corresponding to the detection device according to the alignment result and the relative position information.

[0045] In some embodiments of the present invention, a first three-dimensional model of a user's head is obtained based on first video data, including: extracting the user's head feature points from each frame in the first video data; performing feature matching on the head feature points to obtain shape and motion information of the user's head; and obtaining a first three-dimensional model based on the shape and motion information.

[0046] In some embodiments of the present invention, when performing feature matching on head feature points, a random sampling consistency algorithm is also used to remove erroneous matching points.

[0047] In some embodiments of the present invention, the first three-dimensional model includes preset head marker points of the user, and the second three-dimensional model includes preset head marker points and detection device marker points; the relative position information of the detection device on the wearable device and the user's head is obtained based on the first three-dimensional model and the second three-dimensional model, including: aligning the first three-dimensional model and the second three-dimensional model according to the preset head marker points to obtain the position of the detection device on the surface of the user's scalp; obtaining relative position information based on the position of the detection device on the surface of the user's scalp and the preset head marker points.

[0048] The preset head marker points include at least two of the user's nose bridge position, bilateral ear hole mastoid positions, and posterior cranial protuberance positions.

[0049] In some embodiments of the present invention, relative position information is obtained based on the position of the detection device on the user's scalp surface and preset head markers, including: determining the position of the detection device on the user's scalp surface and the three-dimensional coordinates of the preset head markers; obtaining relative position information based on the three-dimensional coordinates and the position of the preset head markers on the user's head.

[0050] In some embodiments of the present invention, the first three-dimensional model is aligned with a preset standard space template, and the position of the user's brain area corresponding to the detection device is obtained based on the alignment result and the relative position information, including: voxelizing the first three-dimensional model, and converting the voxelized first three-dimensional model into the same voxel scale as the preset standard space template; mapping the voxels of the first three-dimensional model with the preset standard space template using a non-rigid alignment method; and obtaining the position of the user's brain area corresponding to the detection device based on the mapping result and the relative position information.

[0051] It should be noted that, for other specific implementations of the brain function area positioning device 400 according to the embodiment of the present invention, reference may be made to the specific implementations of the brain function area positioning method according to the above embodiment.

[0052] The brain functional area positioning device of the embodiment of the present invention obtains the shape of the user's real head by recording multi-angle videos of the user's head, and uses voxel registration in the process of brain area registration, which is more accurate than anchor point registration. In addition, the device can be adapted to a variety of acquisition devices, has low requirements for equipment, low cost, and can be widely used.

[0053] Based on the brain functional area positioning method of the above embodiment, the present invention proposes a computer-readable storage medium.

[0054] In this embodiment, a computer program is stored on a computer-readable storage medium, and when the computer program is executed by a processor, the brain functional area positioning method of the above embodiment is implemented.

[0055] Based on the brain functional area positioning method of the above embodiment, the present invention also proposes an electronic device.

[0056] like Figure 5 As shown, the electronic device 500 includes: a processor 501 and a memory 503. The processor 501 and the memory 503 are connected, such as through a bus 502. Optionally, the electronic device 500 may also include a transceiver 504. It should be noted that in actual applications, the transceiver 504 is not limited to one, and the structure of the electronic device 500 does not constitute a limitation on the embodiments of the present invention.

[0057] Processor 501 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of the present invention. Processor 501 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0058] The bus 502 may include a path to transmit information between the above components. The bus 502 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 502 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 5 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0059] The memory 503 is used to store a computer program corresponding to the brain functional area positioning method of the above embodiment of the present invention, and the computer program is controlled and executed by the processor 501. The processor 501 is used to execute the computer program stored in the memory 503 to implement the content shown in the above method embodiment.

[0060] The electronic device 500 includes, but is not limited to, fixed terminals such as digital TVs and desktop computers, and mobile terminals such as smart phones and tablet computers. Figure 5 The electronic device 500 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0061] It should be noted that the logical steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0062] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0063] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0064] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “radial”, “circumferential”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0065] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0066] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0067] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being "above", "above" or "above" a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below", "below" or "below" a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0068] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A method for locating brain functional areas, characterized in that: include: Acquire first video data and second video data, wherein the first video data is a multi-angle head video recorded when the user is not wearing a wearable device, and the second video data is a multi-angle head video recorded when the user is wearing a wearable device; Obtain a first three-dimensional model of the user's head according to the first video data, and obtain a second three-dimensional model of the user's head according to the second video data; Obtaining relative position information between the detection device on the wearable device and the user's head according to the first three-dimensional model and the second three-dimensional model; The first three-dimensional model is registered with a preset standard space template, and the position of the user's brain area corresponding to the detection device is obtained according to the registration result and the relative position information.

2. The method for locating brain functional areas according to claim 1, characterized in that: The step of obtaining a first three-dimensional model of the user's head according to the first video data includes: Extracting head feature points of the user from each frame of the first video data; Performing feature matching on the head feature points to obtain shape and motion information of the user's head; The first three-dimensional model is obtained according to the shape and the motion information.

3. The method for locating brain functional areas according to claim 2, characterized in that: When performing feature matching on the head feature points, a random sampling consistency algorithm is also used to remove erroneous matching points.

4. The method for locating brain functional areas according to claim 1, characterized in that: The first three-dimensional model includes preset head markers of the user, and the second three-dimensional model includes the preset head markers and detection device markers; and obtaining relative position information between the detection device on the wearable device and the user's head according to the first three-dimensional model and the second three-dimensional model includes: Registering the first three-dimensional model with the second three-dimensional model according to the preset head markers to obtain the position of the detection device on the surface of the user's scalp; The relative position information is obtained according to the position of the detection device on the user's scalp surface and the preset head marking points.

5. The method for locating brain functional areas according to claim 4, characterized in that: The obtaining the relative position information according to the position of the detection device on the user's scalp surface and the preset head marking point includes: Determining the position of the detection device on the user's scalp surface and the three-dimensional coordinates of the preset head marking points; The relative position information is obtained according to the three-dimensional coordinates and the position of the preset head marker point on the user's head.

6. The method for locating brain functional areas according to claim 4 or 5, characterized in that: The preset head markers include at least two of the user's nose bridge position, bilateral ear hole mastoid positions, and posterior cranial protuberance position.

7. The method for locating brain functional areas according to claim 1, characterized in that: The registering the first three-dimensional model with a preset standard space template, and obtaining the position of the user's brain region corresponding to the detection device according to the registration result and the relative position information, includes: voxelize the first three-dimensional model, and convert the voxelized first three-dimensional model into a voxel scale that is the same as that of the preset standard space template; Mapping the voxels of the first three-dimensional model to the preset standard space template using a non-rigid registration method; The position of the user's brain region corresponding to the detection device is obtained according to the mapping result and the relative position information.

8. A brain functional area positioning device, characterized in that: include: An acquisition module, configured to acquire first video data and second video data, wherein the first video data is a multi-angle head video recorded when the user is not wearing a wearable device, and the second video data is a multi-angle head video recorded when the user is wearing a wearable device; A first processing module, configured to obtain a first three-dimensional model of the user's head according to the first video data, and obtain a second three-dimensional model of the user's head according to the second video data; a second processing module, configured to obtain relative position information between the detection device on the wearable device and the user's head according to the first three-dimensional model and the second three-dimensional model; A registration module is used to register the first three-dimensional model with a preset standard space template, and obtain the brain area position of the user corresponding to the detection device according to the registration result and the relative position information.

9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method for locating brain functional areas according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method for locating brain functional areas described in any one of claims 1 to 7 are implemented.

Images