Dementia information calculation method and analysis device using 2D MRI

Abstract

The method for calculating dementia information using two-dimensional MRI includes a step of an analysis device receiving an input of a 2D (dimension) MRI (Magnetic Resonance Imaging) slice of a subject, a step of the analysis device inputting the 2D MRI slice into a segmentation model to extract a region of interest, a step of the analysis device inputting pixel information of the region of interest into a first learning model that has been pre-trained to predict the cerebral cortical thickness of at least one of the regions of interest and the volume of at least one of the regions of interest, and a step of the analysis device inputting the cerebral cortical thickness of the at least one region and the volume of the at least one region into a second learning model that has been pre-trained to calculate dementia information of the subject.

Description

[Technical Field]

[0001] The technology described below is a technique for calculating dementia-related information using two-dimensional MRI. [Background technology]

[0002] Dementia is a syndrome that causes impairment of cognitive functions such as memory, language, and judgment. There are various types of dementia, but Alzheimer's disease is the most common form.

[0003] Brain imaging such as magnetic resonance imaging (MRI) and positron emission tomography (PET) is used to diagnose dementia. Cortical thickness is a commonly used factor associated with dementia. Summary of the Invention [Problem to be solved by the invention]

[0004] Traditionally, early diagnosis of dementia has relied on brain imaging techniques such as 3D MRI and PET-CT. However, 3D MRI requires high-spec MRI equipment, which is time-consuming and expensive. Furthermore, 2D MRI scanners used in general health screening centers and primary hospitals generate approximately 20 images, making accurate diagnosis difficult.

[0005] The technology described below aims to provide a technique for calculating dementia-related information or predicting dementia using a small number of 2D MRI images. [Means for solving the problem]

[0006] The method for calculating dementia information using two-dimensional MRI includes the steps of: an analysis device receiving 2D MRI slices of a subject; the analysis device inputting the 2D MRI slices into a segmentation model to extract regions of interest; the analysis device inputting pixel information of the regions of interest into a first pre-trained learning model to predict the cortical thickness of at least one of the regions of interest and the volume of at least one of the regions of interest; and the analysis device inputting the cortical thickness of the at least one region and the volume of the at least one region into a second pre-trained learning model to calculate dementia information of the subject.

[0007] The method for calculating dementia information using two-dimensional MRI includes the steps of: an analysis device receiving 2D MRI slices of a subject; the analysis device inputting the 2D MRI slices into a segmentation model to extract regions of interest; the analysis device inputting pixel information of the regions of interest into a pre-trained first learning model to predict the volume of at least one of the regions of interest; and the analysis device inputting the volume of the at least one region into a pre-trained second learning model to calculate dementia information of the subject.

[0008] The region of interest includes at least one of frontal gray matter, temporal gray matter, parietal gray matter, occipital gray matter, lateral ventricles, hippocampal formation, and extracerebral cerebrospinal fluid regions. [Effects of the Invention]

[0009] The technology described below uses a learning model that analyzes a small number of 2D MRI images to calculate dementia-related information. The technology described below can provide information useful for diagnosing dementia based on brain MRIs generated by low-spec 2D MRI scanners. [Brief explanation of the drawings]

[0010] [Figure 1] This is an example of the entire process of calculating a subject's dementia information using 2D brain MRI.

[0011] [Figure 2] This is an example of the process of training a segmentation model to extract regions of interest in brain images.

[0012] [Figure 3] This is an example of the learning process of a learning model that predicts the thickness of the cerebral cortex and the volume of a brain region based on a region of interest.

[0013] [Figure 4] 10 is an example of the learning process of a learning model that calculates dementia information based on the volume of a brain region.

[0014] [Figure 5] This is an example of the learning process of a learning model that calculates dementia information using the thickness of the cerebral cortex and the volume of brain regions.

[0015] [Figure 6] This is an example of an analysis device that calculates dementia information of a subject using brain images. DETAILED DESCRIPTION OF THE INVENTION

[0016] The technology described below can be modified in various ways and can have various embodiments, and a specific embodiment will be illustrated in the drawings and described in detail. However, this is not intended to limit the technology described below to a specific embodiment, and it should be understood that the technology described below includes all modifications, equivalents, and alternatives that fall within the spirit and scope of the technology described below.

[0017] Terms such as "first," "second," "A," and "B" may be used to describe various components, but the components are not limited by these terms and are used merely to distinguish one component from another. For example, a first component may be designated as a second component, and similarly, a second component may be designated as a first component, without departing from the scope of the technology described below. The term "and / or" includes a combination of multiple related listed items or any of multiple related listed items.

[0018] In the terms used in this specification, the singular expression should be understood to include the plural expression unless the context clearly dictates otherwise, and the term "comprise" or the like should be understood to mean the presence of a stated feature, number, step, operation, component, part, or combination thereof, and not to exclude the possibility of the presence or addition of one or more other features, numbers, step operations, components, parts, or combinations thereof.

[0019] Before proceeding to a detailed description of the drawings, it should be made clear that the division of components in this specification is merely a division according to the main function of each component. That is, two or more components described below may be combined into one component, or one component may be divided into two or more components according to more specific functions. Furthermore, each component described below may additionally perform some or all of the functions performed by other components in addition to its own main function, and some of the main functions performed by each component may be exclusively performed by a different component.

[0020] Furthermore, in performing a method or method of operation, the steps of the method may occur in a different order than specified unless the context clearly dictates a specific order, i.e., the steps may occur in the same order as specified, may be performed substantially simultaneously, or may be performed in the reverse order.

[0021] Hereinafter, dementia includes Alzheimer's disease.

[0022] The techniques described below are techniques for calculating dementia information using 2D brain MRI, and include techniques for diagnosing or predicting dementia using dementia information extracted from 2D brain MRI.

[0023] Dementia information refers to information for diagnosing or predicting dementia. For example, dementia information includes whether or not a subject has dementia, whether or not they are at high risk for dementia (possibility of developing the disease in the future), and dementia-related indicators. Dementia-related indicators are used to diagnose or predict dementia, and may include various research scores, the degree of brain atrophy, etc.

[0024] Hereinafter, the device that analyzes the brain MRI and calculates dementia information for the subject will be referred to as the “analysis device.” The analysis device can take the form of a computer device such as a PC, a smart device, a network server, a chipset dedicated to data processing, etc.

[0025] The analysis device can predict the presence or absence of dementia based on brain images using multiple learning models. The learning models are machine learning models. Therefore, the classification model can be one of various types of models. For example, the learning model can be implemented using one of the following methods: decision tree, random forest (RF), K-nearest neighbor (KNN), naive Bayes, support vector machine (SVM), deep neural network (DNN), regression model, etc. There are various types of DNN models. For example, DNNs include segmentation models that extract regions of interest from images and classification models that perform classification based on image features.

[0026] FIG. 1 is an example of an overall process 100 for calculating dementia information of a subject using 2D brain MRI.

[0027] The analysis device can calculate dementia information for a subject based on a small number of 2D MRI slices. The number of 2D MRI slices can be the same as that calculated by a typical 2D MRI scanner. Researchers built a learning model using 20 2D MRI slices. Therefore, for the sake of convenience, the following explanation assumes that the number of 2D MRI slices is 20.

[0028] The analyzer receives a 2D brain MRI of the subject 110. For example, the analyzer can receive 20 slices of the 2D MRI of the subject.

[0029] The analysis device extracts regions of interest (ROIs) from the input 2D MRI slices (120). The analysis device can extract multiple ROIs using a pre-trained segmentation model. The ROIs can be regions for calculating the volume of a specific region. Furthermore, the ROIs can include regions for calculating the thickness of the cerebral cortex.

[0030] The region of interest may include at least one of frontal gray matter, temporal gray matter, parietal gray matter, occipital gray matter, lateral ventricle, hippocampus, and extracerebral cerebrospinal fluid.

[0031] The analysis device can use the extracted regions of interest to calculate certain brain imaging indices (130).

[0032] Brain image indices may include the number of pixels in the extracted region of interest. Brain image indices may also include total brain size, which can be calculated from the size of the region on the brain image. Brain size may be calculated by adding up the size of the extracerebral cerebrospinal fluid, the seven regions of interest, and the white matter in the regions of interest. Meanwhile, various methodologies for determining brain size have been researched, and the analysis device may calculate the subject's brain size using one of various image processing techniques.

[0033] Meanwhile, the analysis device may normalize the region of interest to a predetermined size. For example, the analysis device may calculate the size of the entire brain and normalize the size of the region of interest to a constant size. The analysis device may calculate brain imaging indices, such as the number of pixels, based on the normalized region of interest.

[0034] The analyzer can utilize the pre-trained learning model to estimate the volume of a brain region (140), or the analyzer can utilize the pre-trained learning model to estimate the thickness of the cerebral cortex and the volume of a brain region (140).

[0035] The analysis device can input brain imaging indices into the learning model to predict the thickness of the cerebral cortex in the region of interest. The analysis device can predict the thickness of the cerebral cortex in each region of interest using multiple learning models. For example, the analysis device can calculate the thickness of the cerebral cortex in each region using separate learning models for the frontal, temporal, parietal, and occipital regions.

[0036] The analysis device may also predict the volume of a brain region using a separate learning model. The analysis device may input brain imaging indices into the learning model to predict the volume of a brain region. The analysis device may predict the volume of each region of interest using multiple learning models. For example, the analysis device may calculate the volume of each region by individually using a learning model for the lateral ventricles, a learning model for the hippocampus, and a learning model for the extracerebral cerebrospinal fluid region.

[0037] Meanwhile, the analysis device can calculate the thickness of the cerebral cortex or the volume of a brain region by using additional clinical information (gender, age, etc.) of the subject in addition to the brain image. In this case, each learning model must be trained in advance to calculate the thickness of the cerebral cortex or the volume of a brain region using clinical information in addition to the brain MRI.

[0038] The analysis device can calculate dementia information for the subject based on the cortical thickness and volume of the region of interest (150), or the analysis device can calculate dementia information for the subject based only on the volume of the region of interest (150).

[0039] The dementia information calculation process in Figure 1 uses multiple learning models to calculate a subject's dementia information. The researchers constructed multiple learning models for the above process and verified the performance of each individual model and their dementia information calculation performance. Below, we explain the process for constructing the learning models that the researchers used to calculate a subject's dementia information.

[0040] [Table 1]

[0041] The researchers constructed a segmentation model using data from 980 individuals from the population. The 980 individuals' data was 3D MRI data generated using a 3.0 T MRI scanner (Philips 3.0T Achieva). The researchers performed structural image analysis using the 3D segmentation masks in the CIVET pipeline. In CIVET, cortical thickness is calculated as the Euclidean distance between the inner and outer surfaces of the cortex. The regions of interest included (i) the frontal, temporal, parietal, and occipital gray matter, (ii) the lateral ventricles, (iii) the hippocampal formation, and (iv) the extracerebral cerebrospinal fluid region. The researchers used the regions of interest extracted from the 980 individuals' data as ground truth for training the segmentation model.

[0042] 2 shows an example of a process 200 for training a segmentation model for extracting regions of interest in a brain image. Hereinafter, the model training process will be described as being performed by a training device. The training device refers to a computer device capable of processing image data and performing the machine learning model training process.

[0043] The learning device trains a segmentation model using MRI images of multiple subjects. However, Figure 2 explains the process of training a segmentation model using the MRI of a single subject as an example.

[0044] The learning device receives as input (210) a 3D MRI of a specific subject belonging to the population described above.

[0045] The learning device prepares a training dataset (220). The training dataset consists of input slices (original slices) for each of a number of slices and correct images for the corresponding slices. The learning device selects 20 slices from the 480 slices of the 3D MRI. The learning device can select slices from the 480 slices that match the 20 slices acquired from the 2D MRI scanner. The learning device also receives correct images for the selected 20 slices. The correct images are images in which regions of interest have been segmented for the input slices. The correct images can be images in which regions of interest have been segmented and displayed (annotated) by medical imaging experts.

[0046] The learning device uses the learning data to learn the segmentation model (230). The learning device can learn the segmentation model using input slices and the reference image for 20 slices. The segmentation model is trained to extract (segment) a region of interest in the reference image when the input slices are input.

[0047] The segmentation model can be a semantic segmentation model. For example, the segmentation model can be a fully convolutional network (FCN)-based model such as U-net. Researchers have used a U-net-based segmentation model to extract regions of interest from 2D MRI slices.

[0048] The segmentation model may be pre-defined for each region of interest. As described above, the region of interest may include at least one of frontal gray matter, temporal gray matter, parietal gray matter, occipital gray matter, lateral ventricles, hippocampal formation, and extracerebral cerebrospinal fluid region.

[0049] Alternatively, the segmentation model may be trained to extract multiple regions of interest. Researchers have used curriculum learning to accurately extract multiple regions of interest with different features. Curriculum learning is a learning strategy that mimics the human learning process by first learning easy data and then gradually learning more difficult data.

[0050] The researchers built a segmentation model using the following five learning sequences and verified its performance:

[0051] [Table 2]

[0052] The performance of the segmentation model was measured using the intersection over union (IoU) and dice similarity coefficient (DSC), which are calculated based on the correct answer and the region of interest extracted by the segmentation model. IoU and DSC can be expressed as Equation 1 and Equation 2 below, respectively.

[0053] [Mathematical formula 1]

[0054] IoU=A overlap / (A GT +A pred -A overlap )

[0055] [Mathematical formula 2]

[0056] DSC=2*A overlap / (A GT +A pred )

[0057] In the above mathematical formula, A GT is the correct answer,A pred is the region of interest (prediction region) divided by the segmentation model, A overlap is A GT and A pred This is an overlapping area.

[0058] The segmentation model showed the IoU and DSC for the following six regions of interest as shown in Table 3. The segmentation model showed the highest performance in extracting the lateral ventricles.

[0059] [Table 3]

[0060] Table 4 below shows the extraction performance of the segmentation model for the extracerebral cerebrospinal fluid region. The segmentation model showed the highest performance in the lateral ventricle region.

[0061] [Table 4]

[0062] Table 5 below shows the results of analyzing the performance for the learning order in Table 2. The learning method that learns the lateral ventricles first showed slightly better performance than the other learning orders. Therefore, it can be seen that the technique of dividing the region of interest and performing curriculum learning is significant for the performance of the segmentation model.

[0063] [Table 5]

[0064] FIG. 3 shows an example of a learning process 300 of a learning model that predicts the thickness of the cerebral cortex and the volume of a brain region based on a region of interest. A learning model that predicts the thickness of the cerebral cortex may be prepared in advance for each region of interest. In addition, a learning model that predicts the volume of a brain region may also be prepared in advance for each region of interest. In FIG. 3, the learning model can predict the thickness of the cerebral cortex or the volume of a brain region based on each region of interest. FIG. 3 illustrates an integrated learning process for each region of interest.

[0065] The learning process in Figure 3 is based on the assumption that the aforementioned regions of interest have been extracted from brain MRIs of subjects belonging to the population. In other words, the learning device can use the regions of interest calculated using the segmentation model in Figure 2.

[0066] The learning device extracts input data based on regions of interest extracted from the brain MRI (310). The input data can include brain imaging indices and clinical information extracted from the regions of interest extracted by the segmentation model.

[0067] Brain imaging indices include size information for each region of interest (frontal gray matter, temporal gray matter, parietal gray matter, occipital gray matter, lateral ventricles, hippocampal formation, and extracerebral cerebrospinal fluid region). The size of a region of interest can be determined by the number of pixels in the image of the region of interest. That is, the size of a region of interest can be the sum of all pixels belonging to the region. Meanwhile, the size of a region of interest can be normalized based on the size of the entire brain. Normalization is the process of adjusting brain size, which varies from subject to subject, to a uniform size.

[0068] The brain imaging indices may further include brain size, which may be calculated by summing the sizes of the extracerebral cerebrospinal fluid region, the seven regions of interest, and the white matter of the regions of interest.

[0069] The total number of pixels in a specific region of interest may be the sum of all the numbers of pixels in the region of interest for each of the 20 slices. Taking the frontal gray matter as a reference, the total number of pixels in the frontal gray matter may be the total sum of all the pixels belonging to the frontal gray matter region in each of the 20 slices. Assume that the 20 slices are indexed from 0 to 19. The total number of pixels in the frontal gray matter may be the total sum of the number of pixels belonging to the frontal gray matter region of slice 0, the number of pixels belonging to the frontal gray matter region of slice 1, ..., the number of pixels belonging to the frontal gray matter region of slice 19. Furthermore, the number of pixels in the region of interest may be the average number of pixels in all slices.

[0070] The clinical information may include the subject's age and sex, and may also include APOE4 genotype.

[0071] The researchers used the sum of pixel counts in the region of interest, brain size, and clinical information as all input data.

[0072] The learning device performs a process of learning a learning model using the extracted input data (320). The learning device repeats the learning process of the learning model using input data extracted from the brain MRIs of multiple subjects.

[0073] The learning device performs learning by inputting the extracted input data into a learning model and comparing the value (predicted value) output by the learning model with the correct answer. The learning model is trained to predict the cortical thickness of a specific region of interest or the volume of a specific region of interest. The correct answer is information calculated from MRI and PET-CT scans of subjects belonging to the population (see Table 1).

[0074] The learning model can be constructed as an individual model depending on the information to be predicted. The learning model is a machine learning model and can be embodied as one of various types of models. The researchers used a regression model. The researchers individually constructed a model to predict the thickness of the frontal cerebral cortex (frontal model), a model to predict the thickness of the temporal cerebral cortex (temporal model), a model to predict the thickness of the parietal cerebral cortex (parietal model), a model to predict the thickness of the occipital cerebral cortex (occipital model), a model to predict the volume of the lateral ventricles (lateral ventricle model), a model to predict the volume of the hippocampal formation (hippocampal formation model), and a model to predict the volume of the extracerebral cerebrospinal fluid region (extracerebral cerebrospinal fluid model).

[0075] For example, a frontal model can predict the thickness of the cerebral cortex in the frontal region based on the sum of the frontal gray matter pixels and clinical information, and a frontal model can predict the thickness of the cerebral cortex in the frontal region based on the sum of the frontal gray matter pixels, brain size, and clinical information.

[0076] For example, the extracerebral cerebrospinal fluid model can predict the volume of the extracerebral cerebrospinal fluid region based on the total number of pixels in the extracerebral cerebrospinal fluid region and clinical information. Also, the extracerebral cerebrospinal fluid model can predict the volume of the extracerebral cerebrospinal fluid region based on the total number of pixels in the extracerebral cerebrospinal fluid region, brain size, and clinical information.

[0077] The researchers constructed models that used brain size as input data and models that did not, and then verified the performance of the corresponding models. Table 6 below shows the models used to evaluate the performance of the learning models constructed by the researchers. The performance indicator is the Pearson Correlation Coefficient. In Table 6, Model 1 is a model that does not use brain size, while Model 2 is a model that does use brain size. It can be seen that the performance of Model 1 or Model 2 is slightly higher depending on the region of interest. Therefore, models that predict the thickness of the cerebral cortex and the volume of brain regions can selectively use Model 1 or Model 2 depending on the region of interest. However, there was not much difference in performance between Model 1 and Model 2.

[0078] [Table 6]

[0079] The researchers verified the performance of the learning model to predict the cortical thickness or volume of the region of interest. Using the learning model, the researchers compared the predicted values ​​based on 2D MRI with the correct values ​​measured using 3D MRI. The results are shown in Table 7 below. The cortical thickness and volume predicted by the learning model showed a high degree of correlation with the actual correct values. Volume in particular showed a high degree of correlation.

[0080] The researchers verified the performance of the learning model to predict the cortical thickness or volume of the region of interest. Using the learning model, the researchers compared the predicted values ​​based on 2D MRI with the correct values ​​measured using 3D MRI. The results are shown in Table 7 below. The cortical thickness and volume predicted by the learning model showed a high degree of correlation with the actual correct values. Volume in particular showed a high degree of correlation.

[0081] [Table 7]

[0082] Figure 4 shows an example of a learning process 400 of a learning model that calculates dementia information based on the volume of a brain region. The learning model that ultimately calculates dementia information can be implemented as one of various machine learning model types. Researchers implemented a model that calculates dementia information using a deep learning model.

[0083] The learning in Figure 4 is based on the assumption that the thickness of the cerebral cortex, the volume of a specific brain region, and clinical information for subjects belonging to a population have been acquired. For example, the learning device can use the volume of a specific brain region for each subject calculated using the learning model in Figure 3.

[0084] The learning device can extract input data required for learning (410). The learning device extracts the volume of a specific brain region extracted from 2D brain MRIs of subjects belonging to the population. The brain region volume can include the volume of the lateral ventricles, hippocampus, and extracerebral cerebrospinal fluid region. The learning device also acquires clinical information about the subjects. The clinical information can include at least one of age, gender, and APOE4 genotype. The learning data can include the volume of a specific brain region calculated using the learning model of Figure 3. Alternatively, the learning data can include the thickness of the cerebral cortex and the volume of a specific brain region calculated from brain images of actual subjects. The researchers used the thickness of the cerebral cortex and the volume of a specific brain region calculated from 3D MRI analysis results of actual subjects as learning data.

[0085] The learning device performs a process of learning a learning model using the extracted input data (420). The learning device repeats the learning process of the learning model using input data extracted from a large number of subjects.

[0086] The learning device performs learning by inputting the extracted input data into a learning model and comparing the value (predicted value) output by the learning model with the correct answer. The learning model is trained to calculate the dementia information of the subject. For example, the learning model can output a binary classification result on whether the subject has dementia or not. In this case, the correct answer is information on whether the subject in the population has dementia or not (see Table 1).

[0087] Figure 5 shows an example of a learning process 500 of a learning model that calculates dementia information using the thickness of the cerebral cortex and the volume of brain regions. The learning model that ultimately calculates dementia information can be implemented as one of various machine learning model types. Researchers implemented a model that calculates dementia information using a deep learning model.

[0088] The learning in Figure 5 is based on the assumption that the thickness of the cerebral cortex, the volume of a specific brain region, and clinical information for subjects belonging to a population have been acquired. For example, the learning device can use the regional cerebral cortical thickness and the volume of a specific brain region of a subject calculated using the learning model in Figure 3.

[0089] The learning device can extract input data required for learning (510). The learning device extracts the thickness of the cerebral cortex and the volume of a specific brain region extracted from the brain MRI of the subjects belonging to the population. The thickness of the cerebral cortex can include at least one of the thicknesses of the cerebral cortex of the frontal, temporal, parietal, and occipital regions. The volume of the brain region can include at least one of the volumes of the lateral ventricles, the hippocampus, and the extracerebral cerebrospinal fluid region.

[0090] The learning device also acquires clinical information about the subject. The clinical information may include at least one of age, gender, and APOE4 genotype. The learning data may include the thickness of the cerebral cortex and the volume of a specific brain region calculated using the learning model of Figure 3. Alternatively, the learning data may include the thickness of the cerebral cortex and the volume of a specific brain region calculated from brain images of actual subjects. The researchers used the thickness of the cerebral cortex and the volume of a specific brain region calculated from the results of 3D MRI analysis of actual subjects as learning data.

[0091] The learning device performs a process of learning a learning model using the extracted input data (520). The learning device repeats the learning process of the learning model using input data extracted from multiple subjects.

[0092] The learning device performs learning by inputting the extracted input data into a learning model and comparing the value (predicted value) output by the learning model with the correct answer. The learning model is trained to calculate the dementia information of the subject. For example, the learning model can output a binary classification result on whether the subject has dementia or not. In this case, the correct answer is information on whether the subject in the population has dementia or not (see Table 1).

[0093] The researchers constructed multiple learning models using different input data sets. They used data from 924 individuals (80%) of the population as training data and data from 196 individuals (20%) as validation data. The researchers separated the model groups into those that used significantly different ROIs and constructed individual models within each group using a variety of input data. The multiple learning models constructed by the researchers are shown in Table 8 below. Table 8 shows the model groups that used four different ROIs and the training data used to construct the different models in each group. The models in Table 8 below predict whether a subject has dementia (dementia or normal). In other words, the learning model in Figure 4 corresponds to the model that binary classifies the subject as either dementia or normal.

[0094] [Table 8]

[0095] In Table 8, ROIs are indicated by abbreviations. F stands for frontal, T stands for temporal, P stands for parietal, O stands for occipital, L stands for lateral ventricle, H stands for hippocampus, and E stands for extracerebral cerebrospinal fluid. Meanwhile, unlike Table 8, the learning model may use the thickness and / or volume of some (at least one) of the aforementioned regions of interest as input data. In other words, various types of learning models can be constructed depending on which regions of interest are used.

[0096] The researchers validated the constructed learning model. During the validation process, the researchers used the cortical thickness and brain region volume predicted by the learning model in Figure 3 as input data for the learning model in Figure 4. The researchers performed 10-fold cross-validation. The validation results are shown in Table 9 below. The validation compared the results predicted by the learning model with the correct answer. The performance indicators used were AUC (area under the receiver operating characteristic curve) and AUPRC (area under the precision-recall curve).

[0097] The researchers compared the performance of a conventional 3D MRI-based classification model with the aforementioned 2D MRI-based learning model. The conventional 3D MRI-based classification model used a previously studied model (Rebsamen, M., et al., Direct cortical thickness estimation using deep learning-based anatomy segmentation and cortex parcellation. Human Brain Mapping, 2020. 41(17): p. 4804-4814.).

[0098] A closer look at the results in Table 9 reveals that there is not much difference in performance between the 3D MRI-based model and the 2D MRI-based model. Therefore, the 2D MRI-based model developed by the researchers is also quite useful for predicting dementia. Furthermore, models that use only the cortical thickness of the region of interest extracted from the 2D MRI (learning models 10-12), models that use only the volume of the region of interest (learning models 7-9), and models that use both the cortical thickness and volume of the region of interest (learning models 1-6) all demonstrated a fair level of performance. Compared to the model that uses only cortical thickness (learning models 10-12), the other models performed slightly better.

[0099] [Table 9]

[0100] The researchers also constructed a model to calculate dementia-related indices in previous studies. The researchers used data from 924 individuals (80%) of the population as training data and 196 individuals (20%) as validation data. The researchers constructed a model that calculates certain indices based on input of the cortical thickness and / or volume for the region of interest calculated using the learning model in Figure 3 described above. In Figure 4, the learning model corresponds to the model that calculates certain indices (scores).

[0101] Previous studies have used the W-score as an index for discriminating information about brain atrophy (Renaud La Joie et al., Region-specific hierarchy between atrophy, hypometabolism, and β-amyloid (Aβ) load in Alzheimer's disease dementia, J Neurosci. 2012 Nov 14;32(46):16265-73). Subjects with a W-score of 1.65 or higher are considered to have brain atrophy. Researchers constructed a learning model to calculate the W-score. Table 10 below shows the correlation between the W-scores of the researchers' learning model and those calculated using 3D MRI of the same subjects. Table 10 also compares the results of score calculations by region of interest. In Table 10, Model 1 uses age and gender as score adjustment variables, while Model 2 uses age, gender, and education level as score adjustment variables.

[0102] [Table 10]

[0103] Previous studies have used the AD-score as an indicator for determining whether or not a person has dementia (Jin San Lee et al., Machine Learning-based Individual Assessment of Cortical Atrophy Pattern in Alzheimer's Disease Spectrum: Development of the Classifier and Longitudinal Evaluation, J Neurosci. SCIENTIFIC REPORTS, Vol.8(1):4161, 2018. Reference).

[0104] The researchers constructed a learning model to calculate AD scores using the data from the aforementioned population. This corresponds to the case in Figure 4 where the learning model calculates AD scores. The researchers verified the constructed model using test data from 196 faces. The verification results showed that the learning model for calculating AD scores performed highly well, with an AUC of 0.92 and an accuracy of 0.854.

[0105] Furthermore, the researchers calculated AD scores using the learning model that calculates the W scores mentioned above. Using the learning model, the researchers derived AD scores by inputting the W scores for the seven areas of interest mentioned above. The researchers analyzed the correlation between the AD scores calculated using the learning model and those obtained using previous research methods. Table 11 below shows the performance of the learning model that calculates W scores. Model 1 uses age and gender as score adjustment variables, while Model 2 uses age, gender, and education level as score adjustment variables. A closer look at Table 11 reveals that even when using the model that calculates W scores, there is a considerable correlation with the correct value.

[0106] [Table 11]

[0107] 6 shows an example of an analysis device 600 that calculates dementia information of a subject using brain images. The analysis device 600 may be physically embodied in various forms. For example, the analysis device 600 may be a computer device such as a PC, a smart device, a network server, a chipset dedicated to data processing, etc. Meanwhile, the analysis device 600 may be connected to or integrated with brain imaging equipment.

[0108] The analysis device 600 may include a storage device 610 , a memory 620 , a processing device 630 , an interface device 640 , a communication device 650 and an output device 660 .

[0109] The storage device 610 can store 2D MRI images of a subject generated by medical imaging equipment.

[0110] The storage device 610 can store clinical information of the subject, which can include at least one of age, gender, educational level, and APOE4 genotype.

[0111] The storage unit 610 can store a segmentation model for extracting ROIs in brain images (2D MRI slices). The segmentation model is a pre-trained model.

[0112] The storage device 610 may store a learning model that predicts the thickness of the cerebral cortex and / or the volume of a specific brain region based on information about the region of interest and clinical information (age, gender). A learning model that predicts the thickness of the cerebral cortex and / or the volume of a specific brain region is referred to as a first learning model. As described above, the first learning model uses the total number of pixels in the region of interest (at least one of frontal gray matter, temporal gray matter, parietal gray matter, occipital gray matter, lateral ventricles, hippocampal formation, and extracerebral cerebrospinal fluid region) and clinical information as input data. Furthermore, the first learning model may further use brain size as input data. Therefore, the first learning model may be pre-defined and classified into a model that does not use brain size and a model that uses brain size. Furthermore, the first learning model may be pre-defined for each region of interest.

[0113] The storage device 610 may store a learning model that calculates dementia information based on the thickness of the cerebral cortex and / or the volume of a specific brain region. Finally, the learning model that predicts dementia is referred to as the second learning model. As described above, the second learning model may be implemented as various models depending on the type of input data. The second learning model may be one of the following: (i) a model that uses only the thickness of the cerebral cortex and the volume of a specific brain region as input data; (ii) a model that uses the thickness of the cerebral cortex, the volume of a specific brain region, and clinical information (age, gender, and APEO4) as input data; (iii) a model that uses only the thickness of the cerebral cortex of a specific region of interest as input data; (iv) a model that uses the thickness of the cerebral cortex of a specific region of interest and clinical information (age, gender, and APEO4) as input data; (v) a model that uses only the volume of the specific region of interest as input data; or (vi) a model that uses the volume of the specific region of interest and clinical information (age, gender, and APEO4) as input data. The second learning model may be one of the models described in Table 7.

[0114] The dementia information may be any one of information such as a predicted result of whether or not the subject has dementia, a predicted result of whether or not the subject is at high risk of dementia, or dementia-related indicators (brain atrophy information, W-score, AD-score, etc.).

[0115] The memory 620 can store data and information generated in the process of the analysis device 600 calculating dementia information from brain images.

[0116] The interface device 640 is a device that receives certain commands and data input from the outside. The interface device 640 can receive the subject's 2D MRI and clinical information from a physically connected input device or an external storage device. The number of input 2D MRI slices is limited to 20. The interface device 640 can transmit predicted dementia information based on the 2D MRI to an external object.

[0117] The communication device 650 is configured to receive and transmit certain information via a wired or wireless network. The communication device 650 can receive 2D MRI and clinical information of a subject from an external object. The number of 2D MRI slices is up to 20. The communication device 650 can also transmit predicted dementia information based on the 2D MRI to an external object such as a user terminal.

[0118] The interface device 640 may be a device that internally transmits data received by the communication device 650 .

[0119] The output device 660 is a device that outputs certain information. The output device 660 can output an interface required for the data processing process, a brain image, a region of interest divided from the brain image, dementia-related indices calculated based on the region of interest, dementia information, etc.

[0120] The computing device 630 can pre-process the subject's brain image (2D MRI) in a certain manner. The computing device 630 can generate a mask for segmenting the entire brain region through the data pre-processing process. The computing device 630 can segment the entire brain region in the brain image using the mask for the entire brain region.

[0121] The computing device 630 can normalize the size or resolution of the subject's 2D MRI to a uniformity.

[0122] The computing device 630 can input 2D MRI slices of the subject into the trained segmentation model to extract regions of interest, including at least one of frontal gray matter, temporal gray matter, parietal gray matter, occipital gray matter, lateral ventricles, hippocampal formation, and extracerebral cerebrospinal fluid regions.

[0123] The calculation device 630 may extract size information for the regions of interest. The calculation device 630 may calculate the sum of pixels for each region of interest. The calculation device 630 may calculate the sum of pixels by summing the number of pixels identified in the entire 2D slice for each region of interest (e.g., the forehead).

[0124] The computing device 630 can calculate the size of the entire brain based on the size of the region of interest and other regions in the brain MRI. The brain size can be determined by adding up the size of the seven regions of interest and the white matter in the regions of interest.

[0125] The computing device 630 can input the total pixel count and clinical information (at least one of age, gender, and APEO4 genotype) of a region of interest into a first learning model to predict the thickness and volume of the cerebral cortex of the corresponding region of interest. The computing device 630 can input the total pixel count and clinical information (at least one of age, gender, and APEO4 genotype) for each region of interest into an individual learning model to predict the thickness and volume of the cerebral cortex of the corresponding region of interest. In this case, the computing device 630 can input the cerebral cortical thickness and volume of the region of interest predicted by the first learning model into a second learning model to calculate dementia information of the subject. For example, the computing device 630 can input the frontal cerebral cortical thickness, temporal cerebral cortical thickness, parietal cerebral cortical thickness, occipital cerebral cortical thickness, lateral ventricle volume, hippocampal formation volume, and extracerebral cerebrospinal fluid region volume into the second learning model to calculate dementia information of the subject.

[0126] The computing device 630 may also input the total number of pixels in a region of interest, brain size, and clinical information (at least one of age, gender, and APEO4 genotype) into a first learning model to predict the volume of the region of interest. The computing device 630 may also input the total number of pixels, brain size, and clinical information (at least one of age, gender, and APEO4 genotype) for each region of interest into an individual learning model to predict the volume of the region of interest. In this case, the computing device 630 may input the volume of the region of interest predicted by the first learning model into a second learning model to calculate the subject's dementia information. For example, the computing device 630 may input the volume of the lateral ventricle, the volume of the hippocampal formation, and the volume of the extracerebral cerebrospinal fluid region into the second learning model to calculate the subject's dementia information.

[0127] The computing device 630 can input clinical information (at least one of age, sex, and APOE4 genotype) in addition to the thickness or volume of the cerebral cortex into the second learning model to calculate the subject's dementia information.

[0128] The computing device 630 may be a device such as a processor, AP, or a chip with an embedded program that processes data and performs certain operations.

[0129] In addition, the above-mentioned 2D MRI-based dementia information calculation method and 2D MRI-based dementia prediction method may be implemented as a program (or application) including an executable algorithm that can be executed by a computer. The program may be provided by being stored in a transitory or non-transitory computer-readable medium.

[0130] A non-transitory readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time such as a register, cache, memory, etc. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disc, USB, memory card, ROM (read-only memory), PROM (programmable read-only memory), EPROM (erasable PROM), EEPROM (electrically EPROM), or flash memory.

[0131] Transient readable media refers to various types of RAM such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous DRAM (Synclink DRAM, SLDRAM), and direct Rambus RAM (DRRAM).

[0132] The present embodiment and the drawings attached to this specification merely clearly show a part of the technical ideas contained in the above-mentioned technology, and it is obvious that all modifications and specific embodiments that can be easily inferred by a person skilled in the art within the scope of the technical ideas contained in the specification and drawings of the above-mentioned technology are included in the scope of the rights of the above-mentioned technology.

Claims

1. receiving, by the analysis device, two-dimensional (2D) magnetic resonance imaging (MRI) slices of the subject; the analyzer inputting the 2D MRI slices into a segmentation model to extract a plurality of regions of interest; The analysis device inputs pixel information of a first region of interest included in the plurality of regions of interest into a plurality of pre-trained first learning models to predict the thickness of the cerebral cortex of the first region of interest; The analysis device inputs pixel information of a second region of interest, the second region of interest being included in the plurality of regions of interest and different from the first region of interest, into a plurality of pre-trained second learning models to predict the volume of the second region of interest; and a step of inputting the thickness of the cerebral cortex of each of the first regions of interest and the volume of each of the second regions of interest into a third learning model trained in advance by the analysis device to calculate dementia information of the subject, the plurality of regions of interest include at least one of frontal gray matter, temporal gray matter, parietal gray matter, occipital gray matter, lateral ventricles, the hippocampal formation, and extracerebral cerebrospinal fluid regions; The plurality of first learning models include a plurality of learning models corresponding to each region of interest in the first region of interest, and each of the plurality of first learning models receives a total number of pixels in each region of interest, the age of the subject, and the gender of the subject, and predicts a cerebral cortical thickness in each region of interest in the first region of interest; the first region of interest includes at least one of frontal gray matter, temporal gray matter, parietal gray matter, and occipital gray matter; The plurality of second learning models include a plurality of learning models corresponding to each region of interest in the second region of interest, and each of the plurality of second learning models receives a total number of pixels in each region of interest, the age of the subject, and the gender of the subject, and predicts a volume of each region of interest in the second region of interest; A dementia information calculation method using two-dimensional MRI, wherein the second region of interest includes at least one of a lateral ventricle, a hippocampal formation, and an extracerebral cerebrospinal fluid region.

2. The dementia information calculation method using two-dimensional MRI according to claim 1 , wherein the plurality of first learning models further receive input of the subject's APOE4 genotype to predict the thickness of the cerebral cortex.

3. The dementia information calculation method using two-dimensional MRI according to claim 1 , wherein the plurality of first learning models further receive input of the subject's brain size to predict the thickness of the cerebral cortex.

4. The third learning model is 2. The dementia information calculation method using two-dimensional MRI according to claim 1, wherein at least one of the thickness of the frontal cerebral cortex, the thickness of the temporal cerebral cortex, the thickness of the parietal cerebral cortex, and the thickness of the occipital cerebral cortex is received as input, and at least one of the volume of the lateral ventricle, the volume of the hippocampal formation, and the volume of the extracerebral cerebrospinal fluid region is received as input to calculate the dementia information of the subject.

5. The dementia information calculation method using two-dimensional MRI according to claim 4, wherein the third learning model further receives input of at least one of the subject's age, the subject's gender, and the subject's APOE4 genotype.

6. receiving, by the analysis device, two-dimensional (2D) magnetic resonance imaging (MRI) slices of the subject; the analyzer inputting the 2D MRI slices into a segmentation model to extract a plurality of regions of interest; The analysis device inputs pixel information of a first region of interest included in the plurality of regions of interest into a plurality of pre-trained first learning models to predict the volume of the first region of interest; and a step of inputting the volumes of the first regions of interest into a second learning model trained in advance by the analysis device to calculate dementia information of the subject, the plurality of regions of interest include at least one of frontal gray matter, temporal gray matter, parietal gray matter, occipital gray matter, lateral ventricles, the hippocampal formation, and extracerebral cerebrospinal fluid regions; The plurality of first learning models include a plurality of learning models corresponding to each region of interest in the first region of interest, and each of the plurality of first learning models receives a total number of pixels in each region of interest, an age of the subject, and a gender of the subject, and predicts a volume of each region of interest in the first region of interest; A dementia information calculation method using two-dimensional MRI, wherein the first region of interest includes a lateral ventricle, a hippocampal formation, and an extracerebral cerebrospinal fluid region.

7. The dementia information calculation method using two-dimensional MRI according to claim 6 , wherein the plurality of first learning models further receive an input of the subject's APOE4 genotype to predict the volume.

8. The dementia information calculation method using two-dimensional MRI according to claim 6 , wherein the plurality of first learning models further receive input of the subject's brain size to predict the volume.

9. The second learning model is 7. The dementia information calculation method using two-dimensional MRI according to claim 6, further receiving input of at least one of the thickness of the frontal cerebral cortex, the thickness of the temporal cerebral cortex, the thickness of the parietal cerebral cortex, and the thickness of the occipital cerebral cortex to calculate the dementia information of the subject.

10. The method for calculating dementia information using two-dimensional MRI according to claim 9, wherein the second learning model further receives input of at least one of the subject's age, the subject's gender, and the subject's APOE4 genotype.

11. an interface device that receives input of two-dimensional (2D) magnetic resonance imaging (MRI) slices of the subject; A storage device that stores a segmentation model that extracts a region of interest in a 2D MRI slice, a plurality of first learning models that predict volume based on input region of interest information, and a second learning model that calculates dementia information; and an analysis device that calculates dementia information using two-dimensional MRI, the analysis device including a calculation device that inputs the received 2D MRI slices into the segmentation model to extract a plurality of regions of interest, inputs pixel information of a first region of interest included in the extracted plurality of regions of interest into the plurality of first learning models to predict a volume of the first region of interest, and inputs each volume of the first region of interest into the second learning model to calculate dementia information of the subject, the region of interest includes at least one of frontal gray matter, temporal gray matter, parietal gray matter, occipital gray matter, lateral ventricles, the hippocampal formation, and extracerebral cerebrospinal fluid regions; The plurality of first learning models include a plurality of learning models corresponding to each region of interest in the first region of interest, and each of the plurality of first learning models receives a total number of pixels in each region of interest, an age of the subject, and a gender of the subject, and predicts a volume of each region of interest in the first region of interest; The first region of interest includes the lateral ventricles, the hippocampus, and the extracerebral cerebrospinal fluid region, and the analysis device calculates dementia information using two-dimensional MRI.

12. the storage device further stores a third learning model for predicting the thickness of the cerebral cortex in response to input of region of interest information; 12. The analysis device for calculating dementia information using two-dimensional MRI described in claim 11, wherein the calculation device inputs pixel information of a second region of interest included in the extracted region of interest and different from the first region of interest into the third learning model to predict the thickness of the cerebral cortex of the second region of interest, and further inputs the thickness of each cerebral cortex of the second region of interest into the second learning model to calculate the dementia information of the subject.

13. The analysis device for calculating dementia information using two-dimensional MRI according to claim 12 , wherein the second region of interest includes at least one of the frontal region, the temporal region, the parietal region, and the occipital region.

14. The analysis device for calculating dementia information using two-dimensional MRI described in claim 11, wherein the calculation device further inputs at least one of information of the subject's age, the subject's gender, and the subject's APOE4 genotype into the second learning model to calculate the subject's dementia information.

Images