3D visualization display method of data based on individual head model

Abstract

The present invention discloses a 3D data visualization display method based on an individual head model, comprising the following steps: S1, creating a 3D head model of a subject; S2, matching the coordinates of the detection part on the detection cap with the corresponding position on the 3D head model; S3, applying different task stimuli to the subject, collecting the blood oxygen data of the subject under different task stimuli through the detection cap, and rendering the collected data in real time on the 3D head model for display. The present invention creates a 3D head model of the subject, and renders the blood oxygen data of the subject under different task stimuli collected by the detection cap in real time on the 3D head model for display, so as to dynamically display the activation of the brain area of ​​the subject, and facilitate a more intuitive understanding of the blood oxygen data of the subject under different task stimuli.

Description

Technical Field

[0001] The invention belongs to the technical field of near-infrared brain function imaging, and in particular relates to a 3D visualization display method of data based on an individual head model. Background Art

[0002] Currently, an important issue facing cognitive neuroscience is to establish the correspondence between brain function and brain structure. Functional brain imaging technologies represented by functional magnetic resonance imaging (fMRI) and functional near-infrared spectroscopy (fNIRS) enable neuroscience researchers to observe the function of the living human brain in a non-invasive way.

[0003] Transcranial brain mapping technologies, including transcranial brain therapy and transcranial brain imaging, have been developing rapidly and have shown great potential in brain mechanism assessment and brain injury treatment. For example, transcranial magnetic stimulation (TMS) uses an externally applied magnetic field to inhibit or excite local brain activity at high temporal and spatial resolution. The non-invasive nature of transcranial magnetic stimulation makes it helpful to evaluate the causal relationship between specific brain regions / brain circuits and behaviors. Transcranial magnetic stimulation is also widely used to treat various neuropsychiatric disorders, such as Parkinson's disease, pain, addiction, etc. It is worth mentioning that transcranial magnetic stimulation has been certified by the U.S. Food and Drug Administration (FDA) as a clinical intervention for the treatment of drug-resistant depression.

[0004] Near-infrared brain functional imaging technology is used to reflect the activation of brain areas under task stimulation. It is very important to be able to show the activation of corresponding brain areas under different task stimulation. Currently, there is no 3D head model on the market to show the activation of brain areas in real time.

[0005] The Chinese patent with the publication number CN213787408U discloses a near-infrared brain function imaging analyzer, including: a data acquisition analyzer, and an operating table arranged above the data acquisition analyzer; a base, which is arranged at the bottom of the data acquisition analyzer, and baffles are installed on both sides of the upper surface of the base; a bracket, which is arranged on the upper surface of the operating table, and a limit plate is installed at the bottom of the bracket, and the limit plate is fixedly connected to the upper surface of the operating table; a transmission line, which is arranged on the upper surface of the data acquisition analyzer and is fixedly connected to the upper surface of the data acquisition analyzer, and a head cover is arranged on one side of the transmission line; a connecting plate, which is arranged at the bottom of the base, and a universal wheel is installed at the bottom of the connecting plate, and four universal wheels are arranged. It realizes that there is no need to strictly limit the subject's movements during the acquisition process, and motion artifacts can be identified and corrected, thereby effectively avoiding the problem of being unsuitable for brain function imaging research on infants, the elderly and special populations. This patent uses a traditional display to display the activation of brain areas, which is less intuitive.

[0006] Therefore, it is urgent to propose a 3D visualization display method of data based on individual head models to solve the above problems. Summary of the invention

[0007] The purpose of the present invention is to provide a 3D visualization display method of data based on an individual head model in order to solve the problems existing in the prior art.

[0008] To achieve the above object, the technical solution adopted by the present invention is:

[0009] A 3D visualization display method for data based on an individual head model comprises the following steps:

[0010] S1, create a 3D head model of the subject;

[0011] S2, coordinate matching of the detection part on the detection cap with the corresponding position on the 3D head model;

[0012] S3, applying different task stimuli to the subject, collecting blood oxygen data of the subject under different task stimuli through the detection cap, and rendering the collected data in real time on the 3D head model for display.

[0013] Optionally, in step S1, a 3D head model of the subject is generated using an MRI scan file, and the steps are as follows:

[0014] Mask creation;

[0015] Image segmentation;

[0016] Create 3D objects;

[0017] Smooth model;

[0018] Matrix calibration;

[0019] Export the model;

[0020] The exported model file is based on the MNI coordinate system, and the geometric center of the 3D head model is located at the origin of the MNI coordinate system.

[0021] Optionally, in step S1, a 3D scanning device may be used to generate a 3D head model of the subject, and the steps are as follows:

[0022] By moving the 3D scanning device, the 3D point cloud data of the subject's head is collected from multiple angles;

[0023] Triangulate the collected 3D point cloud data to generate a closed 3D head model;

[0024] Export the 3D head model.

[0025] Specifically, after the 3D head model is exported using a 3D scanning device, the 3D head model must be calibrated in the MNI coordinate system. The steps are as follows:

[0026] Determine multiple reference points on the MNI head model and 3D head model;

[0027] respectively calculating matrix data of the MNI head model and the 3D head model based on the plurality of reference points;

[0028] Taking the MNI head model as a benchmark, the matrix data of the 3D head model is affine transformed, and all points on the 3D head model are converted to the MNI matrix space. The resulting 3D head model is a head model based on the MNI coordinate system, and the geometric center of the head model is located at the origin of the MNI coordinate system.

[0029] Furthermore, the multiple reference points include a left ear, a right ear, a center of the eyebrows, and a parietal lobe.

[0030] Specifically, in step S2, the coordinate information of the channel and the probe on the detection cap is obtained; and the coordinate information of the channel and the probe on the detection cap is mapped onto the 3D head model according to the positional relationship between the detection cap and the head of the subject.

[0031] Furthermore, in step S3, the blood oxygen data collected by the detection cap is rendered in real time on the 3D head model for display according to the coordinate information of the channel and the probe.

[0032] Furthermore, in step S3, the method of rendering the collected data in real time onto the 3D head model for display is:

[0033] S301, setting a color scale, and dividing the color scale into n equal segments;

[0034] S302, dividing the collected data into n intervals in ascending order according to the maximum value and the minimum value of the collected data, each data interval corresponding to a segment of a color scale;

[0035] S303, converting the collected data into corresponding color blocks according to the correspondence between the color scale segments and the data intervals;

[0036] S304, rendering the color block to the corresponding position of the 3D head model according to the brain area position information corresponding to the channel number of the data.

[0037] Compared with the prior art, the beneficial effects of the present invention are as follows: the present invention can dynamically display the brain activation of the subject by creating a 3D head model of the subject, and render the blood oxygen data of the subject collected by the detection cap under different task stimulations on the 3D head model for display in real time, so as to facilitate a more intuitive understanding of the blood oxygen data of the subject under different task stimulations. Moreover, the 3D head model in the present invention is created based on the subject's head, and its external contour better matches the subject's real head contour, greatly improving the authenticity of the display of brain activation. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 The figure is a flow chart of a method for 3D visualization display of data based on an individual head model according to the present invention.

[0039] Figure 2 The present invention is a flowchart of a method for rendering the collected data in real time onto the 3D head model for display in an embodiment of the present invention. DETAILED DESCRIPTION

[0040] The technical solution of the present invention will be described clearly and completely below in conjunction with the accompanying drawings of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0041] Example 1

[0042] like Figure 1 As shown, this embodiment provides a 3D visualization display method of data based on an individual head model, comprising the following steps:

[0043] S1, create a 3D head model of the subject;

[0044] S2, coordinate matching of the detection part on the detection cap with the corresponding position on the 3D head model;

[0045] S3, applying different task stimuli to the subject, collecting blood oxygen data of the subject under different task stimuli through the detection cap, and rendering the collected data in real time on the 3D head model for display.

[0046] Optionally, in step S1, a 3D head model of the subject is generated using an MRI scan file, and the steps are as follows:

[0047] Mask creation;

[0048] Image segmentation;

[0049] Create 3D objects;

[0050] Smooth model;

[0051] Matrix calibration;

[0052] Export the model;

[0053] The exported model file is based on the MNI coordinate system, and the geometric center of the 3D head model is located at the origin of the MNI coordinate system. This is to provide the necessary conditions and basis for the subsequent calculation of the coordinate mapping values ​​from the subject's head to the MNI head model or from the MNI head model to the subject's head.

[0054] Specifically, in step S2, the coordinate information of the channel and the probe on the detection cap is obtained; and the coordinate information of the channel and the probe on the detection cap is mapped onto the 3D head model according to the positional relationship between the detection cap and the head of the subject.

[0055] Furthermore, in step S3, the blood oxygen data collected by the detection cap is rendered in real time on the 3D head model for display according to the coordinate information of the channel and the probe.

[0056] In this embodiment, the task stimulation includes visual stimulation, auditory stimulation, electrical stimulation, magnetic stimulation, etc.

[0057] Furthermore, if Figure 2 As shown, in step S3, the method of rendering the collected data in real time onto the 3D head model for display is:

[0058] S301, setting a color scale, dividing the color scale into 18 equal segments;

[0059] S302, according to the maximum and minimum values ​​of the collected data, the collected data is divided into 18 intervals in ascending order (the difference between the maximum and minimum values ​​of the data is divided by 18, that is, the size of the data interval), and each data interval corresponds to a segment of the color scale;

[0060] S303, converting the collected data into corresponding color blocks according to the correspondence between the color scale segments and the data intervals;

[0061] S304, rendering the color block to the corresponding position of the 3D head model according to the brain area position information corresponding to the channel number of the data.

[0062] Example 2

[0063] This embodiment provides a 3D visualization display method of data based on an individual head model. The difference from the above-mentioned embodiment 1 is that in this embodiment, a 3D scanning device can also be used to generate a 3D head model of the subject. The steps are as follows:

[0064] By moving the 3D scanning device, the 3D point cloud data of the subject's head is collected from multiple angles;

[0065] Triangulate the collected 3D point cloud data to generate a closed 3D head model;

[0066] Export the 3D head model.

[0067] Specifically, after the 3D head model is exported using a 3D scanning device, the 3D head model must be calibrated in the MNI coordinate system. The steps are as follows:

[0068] Determine multiple reference points on the MNI head model and 3D head model;

[0069] respectively calculating matrix data of the MNI head model and the 3D head model based on the plurality of reference points;

[0070] Taking the MNI head model as a benchmark, the matrix data of the 3D head model is affine transformed, and all points on the 3D head model are converted to the MNI matrix space. The resulting 3D head model is a head model based on the MNI coordinate system, and the geometric center of the head model is located at the origin of the MNI coordinate system.

[0071] Furthermore, the multiple reference points include a left ear, a right ear, a center of the eyebrows, and a parietal lobe.

[0072] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0073] The present invention is described with reference to flowcharts and / or block diagrams of methods, platforms (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0074] This specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0075] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0076] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 In a typical configuration, a computer includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0077] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0078] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, disk storage, quantum memory, graphene-based storage media or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0079] In the description of this specification, the description with reference to the terms "one embodiment", "certain embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0080] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the technical solutions of the embodiments of the present invention.

Claims

1. A 3D visualization display method based on individual head model data, characterized in that: The following steps are involved: S1, using a 3D scanning device to create a 3D head model of the subject, the steps are as follows: by moving the 3D scanning device, 3D point cloud data of the subject's head is collected from multiple angles; the collected 3D point cloud data is triangulated to generate a closed 3D head model; and the 3D head model is exported; After the 3D head model is exported by a 3D scanning device, the 3D head model is calibrated in the MNI coordinate system, and the steps are as follows: multiple reference points are determined on the MNI head model and the 3D head model; matrix data of the MNI head model and the 3D head model based on the multiple reference points are calculated respectively; with the MNI head model as a reference, the matrix data of the 3D head model is affine transformed, and all points on the 3D head model are converted to the MNI matrix space, and the obtained 3D head model is a head model based on the MNI coordinate system, and the geometric center of the head model is located at the origin of the MNI coordinate system; S2, coordinate matching of the detection part on the detection cap with the corresponding position on the 3D head model; S3, applying different task stimuli to the subject, collecting blood oxygen data of the subject under different task stimuli through the detection cap, and rendering the collected data in real time on the 3D head model for display.

2. The method for 3D visualization of data based on an individual head model according to claim 1, characterized in that: The plurality of reference points include a left ear, a right ear, a center of the eyebrows, and a parietal lobe.

3. The method for 3D visualization of data based on an individual head model according to claim 1, characterized in that: In step S2, the coordinate information of the channel and the probe on the detection cap is obtained; and the coordinate information of the channel and the probe on the detection cap is mapped onto the 3D head model according to the positional relationship between the detection cap and the head of the subject.

4. The method for 3D visualization of data based on an individual head model according to claim 3, characterized in that: In step S3, the blood oxygen data collected by the detection cap is rendered in real time on the 3D head model for display according to the coordinate information of the channel and the probe.

5. The method for 3D visualization display of data based on an individual head model according to claim 1, characterized in that: In step S3, the method of rendering the collected data in real time onto the 3D head model for display is: S301, setting a color scale, and dividing the color scale into n equal segments; S302, dividing the collected data into n intervals in ascending order according to the maximum value and the minimum value of the collected data, each data interval corresponding to a segment of the color scale; S303, converting the collected data into corresponding color blocks according to the correspondence between the color scale segments and the data intervals; S304, rendering the color block to the corresponding position of the 3D head model according to the brain area position information corresponding to the channel number of the data.

Images