Method for predicting risk of cardiovascular disease in diabetic patients and system thereof

Abstract

A method for predicting cardiovascular disease in diabetic patients and a system therefor are provided. A method for predicting cardiovascular disease according to some embodiments may comprise the steps of: obtaining one or more machine-learning models prepared to predict risk information related to cardiovascular disease in diabetic patients; obtaining state information of a target diabetic patient; and predicting risk information of the target diabetic patient related to cardiovascular disease by inputting the obtained state information into the one or more machine-learning models. According to the method, the risk of developing cardiovascular disease among various complications that can develop in diabetic patients can be accurately predicted at an early stage.

Description

Method and System for Predicting Cardiovascular Disease Risk in Diabetic Patients

[0001] The present disclosure relates to a technology for predicting the risk of cardiovascular disease among various complications that may occur in diabetic patients.

[0002]

[0003] Cardiovascular disease is one of the major chronic complications that occur in patients with diabetes. According to the 2022 Diabetes Fact Sheet in Korea, patients with type 2 diabetes are reported to have a 1.59 times higher risk of myocardial infarction and a 1.51 times higher risk of heart failure compared to normal individuals.

[0004] Preventive interventions for diabetic patients can significantly lower the incidence of these cardiovascular diseases and substantially reduce the social costs incurred due to complications. However, while it is known that factors such as the duration of diabetes, obesity, hypertension, and smoking influence the development of cardiovascular disease, no method has yet been proposed to accurately predict the risk of cardiovascular disease in diabetic patients at an early stage.

[0005]

[0006] The technical problem to be solved through some embodiments of the present disclosure is to provide a method and a system capable of accurately predicting the risk of cardiovascular disease in diabetic patients.

[0007] Another technical problem to be solved through some embodiments of the present disclosure is to provide information on key variables (features) that influence the occurrence of cardiovascular disease in diabetic patients.

[0008] The technical problems of the present disclosure are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by a person skilled in the art of the present disclosure from the description below.

[0009]

[0010] A method for predicting the risk of cardiovascular disease in a diabetic patient according to some embodiments of the present disclosure for solving the aforementioned technical problem may include a method performed by at least one processor, comprising the steps of: acquiring one or more machine-learning models prepared to predict risk information related to cardiovascular disease in a diabetic patient; acquiring state information of a target diabetic patient; and inputting the state information into the one or more machine-learning models to predict risk information related to cardiovascular disease in the target diabetic patient.

[0011] In some embodiments, the one or more machine learning models may include a random forest.

[0012] In some embodiments, the status information may include demographic characteristics, disease history, medication history, blood test results, and physical examination results.

[0013] In some embodiments, the status information may include test results regarding creatinine, glycated hemoglobin (HbA1c), AST (aspartate aminotransferase), ALP (alanine aminotransferase), and ALT (alkaline phosphatase).

[0014] In some embodiments, the status information may include test results regarding HDL (high-density lipoprotein) cholesterol, LDL (low-density lipoprotein) cholesterol, triglycerides, total cholesterol, and body mass index (BMI), as well as a history of medications regarding calcium channel blockers and diuretics, and a history of diseases regarding cerebrovascular disease.

[0015] In some embodiments, the preparation process of the one or more machine learning models may include: a step of preparing a training set and a test set based on the records of diabetic patients of a first cohort and the records of diabetic patients of a second cohort, wherein the second cohort is a cohort independent of the first cohort; a step of training a specific machine learning model using the training set; and a step of evaluating the performance of the specific machine learning model using the test set.

[0016] In some embodiments, the training set is configured based on the records of diabetic patients of the first cohort, and the test set is configured based on the records of diabetic patients of the second cohort, and may not include the records of diabetic patients of the first cohort.

[0017] In some embodiments, the average age of the diabetic patients constituting the test set may be designed to be lower than that of the training set.

[0018] In some embodiments, the preparation process of the one or more machine learning models may include: a step of preparing a training set and a test set based on the records of diabetic patients of a first cohort and the records of diabetic patients of a second cohort, wherein the second cohort is a cohort independent of the first cohort; a step of training a plurality of candidate machine learning models using the training set; a step of evaluating the performance of each of the plurality of candidate machine learning models using the test set; and a step of selecting the one or more machine learning models among the plurality of candidate machine learning models based on the results of the evaluation.

[0019] In some embodiments, the preparation process of the one or more machine learning models comprises: a step of training a first machine learning model using a training set, wherein each sample constituting the training set contains condition information of an individual diabetic patient, and the condition information of the individual diabetic patient relates to multiple variables; a step of deriving the importance of each of the multiple variables using the training result of the first machine learning model, wherein the multiple variables are classified into core variables, intermediate variables, and non-core variables based on the importance; a step of strengthening the training set based on the importance; and a step of training a second machine learning model using the strengthened training set, wherein the step of strengthening the training set includes: a step of removing the non-core variables from the training set; and a step of generating multiple synthetic samples by sampling the value of the core variable within a preset range while fixing the value of the intermediate variable, and adding the generated synthetic samples to the training set, and the step of predicting the risk information of the target diabetic patient may include a step of determining the risk information of the target diabetic patient by combining the prediction result of the first machine learning model and the prediction result of the second machine learning model.

[0020] In some embodiments, a specific machine learning model among the one or more machine learning models comprises: an embedder that generates a state embedding by embedding state information of the diabetic patient; an image encoder that generates an image embedding by encoding an image of the diabetic patient related to the cardiovascular disease; an integration encoder that generates an integration embedding by encoding the state embedding and the image embedding; a first predictor that predicts the risk of the cardiovascular disease occurring within a first period based on the integration embedding; and a second predictor that predicts the risk of the cardiovascular disease occurring within a second period different from the first period based on the integration embedding, and the step of predicting the risk information of the target diabetic patient may include: a step of predicting a first risk of the cardiovascular disease occurring in the target diabetic patient within the first period through the first predictor; a step of predicting a second risk of the cardiovascular disease occurring in the target diabetic patient within the second period through the second predictor; and a step of deriving an increasing trend of the risk for the cardiovascular disease based on the difference between the first risk and the second risk.

[0021] A system for predicting the risk of cardiovascular disease in a diabetic patient according to some embodiments of the present disclosure for solving the technical problem described above comprises: one or more processors; and a memory for storing a computer program executed by said one or more processors, wherein the computer program may include instructions for: acquiring one or more machine-learning models prepared to predict risk information related to cardiovascular disease in a diabetic patient; acquiring state information of a target diabetic patient; and inputting said state information into said one or more machine-learning models to predict risk information related to cardiovascular disease in said target diabetic patient.

[0022] A computer program according to some embodiments of the present disclosure for solving the technical problem described above may be stored on a computer-readable recording medium to execute the steps of: acquiring one or more machine-learning models prepared to predict risk information related to cardiovascular disease of a diabetic patient, coupled with a processor of a computer; acquiring state information of a target diabetic patient; and inputting the state information into the one or more machine-learning models to predict risk information related to cardiovascular disease of the target diabetic patient.

[0023]

[0024] According to some embodiments of the present disclosure, by comprehensively analyzing various status information of a diabetic patient (e.g., demographic characteristics, disease history, medication history, blood test results, physical examination results, etc.) through a machine-learning model, risk information regarding cardiovascular disease in the diabetic patient can be accurately predicted at an early stage. For example, the risk of cardiovascular disease occurring in the diabetic patient within a specific period can be accurately predicted. Furthermore, by implementing preventive interventions based on the accurate prediction of the risk of cardiovascular disease, the incidence of cardiovascular disease in diabetic patients and the resulting social costs can be significantly reduced.

[0025] In addition, a training set may be constructed based on the records of diabetic patients from a first cohort, and a test set may be constructed based on the records of diabetic patients from a second cohort independent of the first cohort. In this case, the performance of the machine learning model can be objectively and thoroughly evaluated (verified).

[0026] The effects according to the technical concept of the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by a person skilled in the art from the description below.

[0027]

[0028] FIG. 1 is an exemplary drawing for explaining the operation of a system for predicting cardiovascular disease risk in diabetic patients according to some embodiments of the present disclosure at the system level.

[0029] FIG. 2 is an exemplary drawing for further explaining the operation of a cardiovascular disease risk prediction system for diabetic patients according to some embodiments of the present disclosure.

[0030] FIG. 3 is an exemplary drawing showing input and output information of a machine-learning model according to some embodiments of the present disclosure.

[0031] FIG. 4 illustrates a case in which a machine learning model is implemented based on a random forest according to some embodiments of the present disclosure.

[0032] FIG. 5 illustrates a case in which a machine learning model is implemented based on a neural network according to some other embodiments of the present disclosure.

[0033] FIG. 6 illustrates a case in which a machine learning model is implemented based on a neural network according to some other embodiments of the present disclosure.

[0034] FIG. 7 is an exemplary flowchart schematically illustrating a method for predicting cardiovascular disease risk in diabetic patients according to some embodiments of the present disclosure.

[0035] Figure 8 is an exemplary flowchart illustrating an example of the detailed process of the machine learning model preparation step shown in Figure 7.

[0036] FIGS. 9 and FIGS. 10 are exemplary drawings for explaining detailed embodiments related to the training set and test set preparation steps illustrated in FIG. 8.

[0037] FIG. 11 is an exemplary diagram to further explain the candidate machine learning model training and performance evaluation steps illustrated in FIG. 8.

[0038] FIG. 12 is an exemplary drawing for illustrating a method of building an additional machine learning model using variable importance according to some embodiments of the present disclosure.

[0039] FIGS. 13 to 15 are exemplary drawings for explaining performance tests conducted by the inventors of the present disclosure.

[0040] FIG. 16 illustrates an exemplary computing device capable of implementing a system for predicting cardiovascular disease risk in diabetic patients according to some embodiments of the present disclosure.

[0041]

[0042] Hereinafter, various embodiments of the present disclosure will be described in detail with reference to the attached drawings. The advantages and features of the present disclosure and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the attached drawings. However, the technical concept of the present disclosure is not limited to the following embodiments but can be implemented in various different forms. The following embodiments are provided merely to complete the technical concept of the present disclosure and to fully inform those skilled in the art of the scope of the present disclosure, and the technical concept of the present disclosure is defined only by the scope of the claims.

[0043] In describing the various embodiments of the present disclosure, if it is determined that a detailed description of related known configurations or functions could obscure the essence of the present disclosure, such detailed description is omitted.

[0044] Unless otherwise defined, terms used in the following embodiments (including technical and scientific terms) may be used in a meaning commonly understood by those skilled in the art to which this disclosure pertains, but this may vary depending on the intent of those skilled in the art, case law, the emergence of new technology, etc. The terms used in this disclosure are for describing the embodiments and are not intended to limit the scope of this disclosure.

[0045] In the following embodiments, singular expressions include plural concepts unless the context clearly specifies them as singular. Additionally, plural expressions include singular concepts unless the context clearly specifies them as plural.

[0046] In addition, terms such as first, second, A, B, (a), (b), etc. used in the following embodiments are used merely to distinguish one component from another, and the essence, order, or sequence of the said component is not limited by such terms.

[0047] The components described by reference to terms such as part or unit, module, block, ~or, ~er, etc. used in the following embodiments, and the functional blocks illustrated in the drawings may be implemented in the form of software, hardware, or a combination thereof. Software may be, for example, machine code, firmware, embedded code, and application software. Additionally, hardware may include, for example, electrical circuits, electronic circuits, processors, computers, integrated circuits, integrated circuit cores, passive components, or a combination thereof.

[0048] Hereinafter, various embodiments of the present disclosure will be described in detail with reference to the attached drawings.

[0049] FIG. 1 is an exemplary drawing for explaining the operation of a cardiovascular disease risk prediction system (10) for a diabetic patient according to some embodiments of the present disclosure at the system level. In FIG. 1 and others, the name of the cardiovascular disease risk prediction system (10) is indicated as 'prediction system', and for convenience of explanation, the cardiovascular disease risk prediction system (10) will also be abbreviated as 'prediction system' below.

[0050] As illustrated in FIG. 1, the prediction system (10) according to the embodiments is a computing device / system that predicts the risk (possibility) of cardiovascular disease among major complications of a diabetic patient (e.g., a patient with type 2 diabetes). For instance, the prediction system (10) can predict various risk information (13) related to cardiovascular disease from the diabetic patient's condition information (12).

[0051] The condition information (12) of a diabetic patient may include, for example, demographic characteristics, disease history, medication history, blood test results, and physical examination results, but the scope of the present disclosure is not limited thereto. For instance, the condition information (12) may further include various images related to the cardiovascular system of the diabetic patient. Examples of such images may include echocardiography images, CT (Computed Tomography) images, MRI (Magnetic Resonance Imaging) images, and electrocardiogram (ECG) images related to the cardiovascular system, but the scope of the present disclosure is not limited thereto.

[0052] The cardiovascular disease-related risk information (13) may include, for example, the type of cardiovascular disease, risk level (e.g., probability of cardiovascular disease occurring within a specific period), whether it has occurred, and the expected time of occurrence. However, the scope of the present disclosure is not limited thereto. Additionally, examples of cardiovascular diseases may include ischemic heart disease, myocardial infarction, heart failure, atrial fibrillation, stroke, coronary artery disease, and peripheral artery disease, but the scope of the present disclosure is not limited thereto.

[0053] Specifically, the prediction system (10) can prepare (train) a machine-learning model (11) using a training set composed of status information of a diabetic patient group and cardiovascular disease information (i.e., label information). Then, the prediction system (10) can predict risk information (13) related to cardiovascular disease from the status information (12) of the target diabetic patient through the machine-learning model (11). The structure and preparation process of this machine-learning model (11) will be explained in detail shortly with reference to the drawings from Fig. 3 onwards. The machine-learning model (11) may refer to a single model or a set of multiple models.

[0054] The above-described prediction system (10) may be implemented in at least one computing device. For example, all functions of the prediction system (10) may be implemented in a single computing device, or the first function of the prediction system (10) may be implemented in a first computing device and the second function may be implemented in a second computing device. Alternatively, specific functions of the prediction system (10) may be implemented in multiple computing devices.

[0055] A computing device may include any device equipped with computing functions, and for an example of such a device, refer to FIG. 16. Since a computing device is a collection of various components (e.g., memory, processor, etc.) that interact, it may be referred to as a 'computing system' depending on the case. Of course, the term computing system may also encompass the concept of a collection of multiple computing devices that interact.

[0056] Meanwhile, in some embodiments, the prediction system (10) may provide a service for predicting risk information related to cardiovascular disease. For example, as illustrated in FIG. 2, the prediction system (10) may provide such a prediction service through communication with a diabetic patient terminal (21) and / or a medical institution terminal (22). Specifically, the prediction system (10) may receive a request including status information from the diabetic patient terminal (21) and, in response, predict and provide risk information related to cardiovascular disease of the diabetic patient. Alternatively, the prediction system (10) may receive a request including status information of a specific diabetic patient (e.g., a diabetic patient managed by a medical institution) from the medical institution terminal (22) and, in response, predict and provide risk information related to cardiovascular disease of the diabetic patient. As illustrated, the patient terminal (21), the medical institution terminal (22), and the prediction system (10) may communicate through a network. Here, the network can be implemented as any type of wired or wireless network, such as a Local Area Network (LAN), Wide Area Network (WAN), mobile radio communication network, and Wibro (wireless broadband internet).

[0057] Up to now, the operation of a prediction system (10) according to some embodiments of the present disclosure has been described schematically with reference to FIGS. 1 and 2. Below, the input / output information (data), structure, and training method of a machine learning model (11) will be described with reference to FIGS. 3 to 6.

[0058] FIG. 3 is an exemplary drawing for explaining input / output information of a machine learning model (11) according to some embodiments of the present disclosure.

[0059] As illustrated in FIG. 3, the machine learning model (11) may be configured to receive status information including demographic characteristics, disease history, medication history, blood test results and / or physical examination results of a diabetic patient, and to predict and output risk information related to cardiovascular disease of the diabetic patient. In some cases, the machine learning model (11) may be configured to receive additional input of images of the diabetic patient related to cardiovascular disease.

[0060] Demographic characteristics, disease history, medication history, blood test results, and physical examination results can each consist of various variables, specific examples of which will be briefly explained shortly with reference to Tables 1 through 5. For reference, the term variable may also be referred to as feature, attribute, or element depending on the context.

[0061] Table 1 below shows examples of variables belonging to demographic characteristics. For reference, the range of variables such as age may include derived variables such as age groups (i.e., these derived variables may also be used as input variables for the machine learning model (11)).

[0062] Distinguishing variables (features) Demographic characteristics Age (age) Sex (sex)

[0063] Table 2 below shows examples of variables included in the disease history. For reference, the scope of disease variables such as hypertension may include, in addition to the presence or absence of the disease (i.e., onset), the specific type of the disease, the stage of progression, disease-related values ​​(e.g., blood pressure levels), the time of onset, the number of onsets, whether the disease was cured, the time of cured, the time of diagnosis, the duration of the disease, whether the disease recurred, the time of recurrence, the number of recurrences, the severity of symptoms, whether surgery was performed, the time of surgery, the number of surgeries, etc.

[0064] Distinguishing Variables (Features) Disease History - Hypertension - Dyslipidemia - Macrovascular Complications - Cerebrovascular Disease - Dementia - Parkinson's Disease - Lower Limb Amputation - Microvascular Complications - Diabetic Retinopathy - Proliferative Diabetic Retinopathy - Diabetic Neuropathy - Chronic Kidney Disease - Cancer

[0065] Table 3 below shows examples of variables included in the drug history. For reference, the scope of drug variables such as metformin may include, in addition to whether the drug was taken, derived variables such as dosage (e.g., recent dosage, average, median, mode, range, standard deviation, dosage increase / decrease trend / pattern, etc.), number of doses (frequency), time of administration, duration of administration, time of start, time of end, effect of administration, presence of side effects, and severity of side effects.

[0066] Differentiating Variables (Features) Drug History Antidiabetic drug Metformin Sulfonylurea Dipeptidyl peptidase-4 inhibitor Meglitinide Thiazolidinedione α-glucosidase inhibitor Insulin GLP-1 receptor agonist Sodium-glucose co-transporter 2 inhibitor Antihypertensive drug Angiotensin II receptor blocker Angiotensin-converting enzyme inhibitor Calcium channel blocker (CCB) Diuretics Beta blocker Dyslipidemia drug (dyslipidemia drug) Statin Fibrate Ezetimibe Omega-3 Other dyslipidemia drugs Antiplatelet agents Aspirin Clopidogrel Cilostazol Glycoprotein IIb / IIIa antagonist Other antiplatelet agents

[0067] Table 4 below shows examples of variables included in blood test results. For reference, the range of variables related to test items, such as glycated hemoglobin, may include not only the numerical values ​​of the test item (e.g., recent values, numerical range, average values ​​over a certain period, median, mode, numerical range, standard deviation, trend / pattern of increase / decrease in values, etc.) but also derived variables such as the time of the test and the number of tests.

[0068] Differentiating Variables (Features) Blood Test Results Glycated Hemoglobin (HbA1c) Serum Glucose Total Cholesterol Triglycerides High-Density Lipoprotein (HDL) Cholesterol Low-Density Lipoprotein (LDL) Cholesterol Serum Creatinine Aspartate Aminotransferase (AST) Alanine Aminotransferase (ALT) Gamma-Glutamyl Transferase (GGT) Alkaline Phosphate (ALP)

[0069] Table 5 below shows examples of variables included in the physical examination results. For reference, the range of variables related to examination items, such as body mass index, may include not only the numerical values ​​of the examination item (e.g., recent values, numerical range, average values ​​over a certain period, median, mode, numerical range, standard deviation, numerical increase / decrease trend / pattern, etc.) but also derived variables such as the time of examination and the number of examinations.

[0070] Distinguishing Variables (Features) Physical Examination Results Body Mass Index (BMI) Systolic Blood Pressure Diastolic Blood Pressure Pulse Rate

[0071] The cardiovascular disease-related risk information output (predicted) by the machine learning model (11) may include information such as the type of cardiovascular disease, risk level (e.g., probability of cardiovascular disease occurring within a specific period), occurrence (onset), and expected timing of occurrence. However, the scope of the present disclosure is not limited thereto. The machine learning model (11) described above may be designed and implemented in various ways. For example, the machine learning model (11) may be designed and implemented based on various types of models / algorithms such as decision tree, random forest, XGBoost (Extreme Gradient Boosting), LightGBM (Light Gradient Boosting Machine), CatBoost, SVM (Support Vector Machine), logistic regression, AdaBoost (Adaptive Boost), and neural network. Those skilled in the art will already be familiar with the structure and training methods of the exemplified models, so a description thereof will be omitted.

[0072] FIGS. 4 to 6 illustrate detailed embodiments of a machine learning model (11). FIGS. 4 to 6, for the clarity of the present disclosure, distinguish the reference numbers of the machine learning model (11) according to the embodiments as '11A', '11B', and '11C'.

[0073] First, FIG. 4 shows a case in which a machine learning model (11A) is implemented based on a random forest according to some embodiments of the present disclosure.

[0074] As illustrated in FIG. 4, in these embodiments, the machine learning model (11A) is configured to include N decision trees (41-1 to 41-N) and can be configured to output a final prediction result by synthesizing the prediction results of the decision trees (41-1 to 41-N) (i.e., performing prediction in an ensemble manner). 'N', the number of decision trees, is a hyperparameter, and the value of 'N' can be set through hyperparameter tuning (optimization) techniques such as grid search, random search, and Bayesian optimization. Since those skilled in the art are likely already familiar with such hyperparameter tuning techniques, the operating principles of random forests, and training methods, further description of these embodiments will be omitted.

[0075] FIG. 5 illustrates a case in which a machine learning model (11B) is implemented based on a neural network according to some other embodiments of the present disclosure.

[0076] As illustrated in FIG. 5, in these embodiments, the machine learning model (11B) may be configured to include an embedder (51), an image encoder (52), an integration encoder (53), and a predictor (54).

[0077] The embedder (51) is a neural network module that embeds the diabetic patient's state information (e.g., demographic characteristics, disease history, medication history, blood test results, physical examination results, etc.). The embedder (51) may be configured to receive the diabetic patient's state information and output one or more state embeddings (e.g., embedding vectors) corresponding thereto.

[0078] The embedder (51) may be implemented as any type of neural network. For example, the embedder (51) may be implemented based on a Multi-Layer Perceptron (MLP) (or a fully-connected layer) or an attention-based neural network such as a transformer.

[0079] The embedder (51) may consist of a single embedder or a set of multiple embedders. For example, the embedder (51) may be composed of a first embedder that embeds demographic characteristic information of a diabetic patient, a second embedder that embeds disease history, a third embedder that embeds medication history, a fourth embedder that embeds blood test results, and a fifth embedder that embeds physical examination results. In this case, if the disease history consists of a sequence of individual disease information (records) according to the order of onset (time), the second embedder may be implemented as a neural network that handles sequences, such as a Recurrent Neural Network (RNN) or a Transformer, to embed the disease history while considering the order of onset. Similarly, if the medication history consists of a sequence of individual medication information (records) according to the order of medication intake (time), the third embedder may also be implemented as a neural network that handles sequences.

[0080] Next, the image encoder (52) is a neural network module that encodes (embeds) images of diabetic patients associated with cardiovascular disease. The image encoder (52) may be configured to receive an image of a diabetic patient as input and output one or more corresponding image embeddings (e.g., embedding vectors). For example, a pretrained image encoder (or feature extractor) (e.g., VGG-16, ViT (Vision Transformer), etc.) may be used as the image encoder (52), but the scope of the present disclosure is not limited thereto. The image encoder (52) may, in some cases, be named as an 'image embedding' or a 'feature extractor'.

[0081] Next, the integration encoder (53) is a neural network module that encodes the state embedding output from the embedding (51) and the image embedding output from the image encoder (52) together. The integration encoder (53) can be configured to receive the state embedding and the image embedding as inputs, aggregate them, and output an integrated embedding (e.g., embedding vector).

[0082] The integrated encoder (53) may be implemented as any type of neural network. For example, the integrated encoder (53) may be implemented based on an MLP (or fully connected layer) or as an attention-based neural network such as a Transformer.

[0083] Next, the predictor (54) is a neural network module that predicts risk information related to cardiovascular disease in diabetic patients. The predictor (54) may be configured to receive an integrated embedding output from an integrated encoder (53) and to predict and output such risk information. That is, the predictor (54) may be configured to predict risk information related to cardiovascular disease by comprehensively analyzing various information contained in the integrated embedding (e.g., demographic characteristics, disease history, medication history, blood test results, physical examination results, images related to cardiovascular disease). Such a predictor (54) may be implemented, for example, based on an MLP (or a fully connected layer), but the scope of the present disclosure is not limited thereto.

[0084] The predictor (54) may be configured to output the risk (i.e., probability) of cardiovascular disease occurring in a diabetic patient within a specific period (e.g., 6 months, 1 year, 3 years, etc.) (or thereafter) (e.g., configured to output a confidence score regarding whether cardiovascular disease will occur), or may be configured to output the risk of occurrence by type of cardiovascular disease (e.g., configured to output a confidence score regarding whether cardiovascular disease will occur by type of cardiovascular disease). Alternatively, the predictor (54) may be configured to output the expected time of occurrence of cardiovascular disease.

[0085] The machine learning model (11B) described above can be trained using a supervised learning technique. That is, the parameters of the machine learning model (11B) are updated based on a loss representing the difference between the prediction result of the predictor (54) and the label information, and this process can be performed repeatedly on various samples of the training set. By doing so, the machine learning model (11B) can accurately predict risk information related to cardiovascular disease by comprehensively considering various condition information of diabetic patients (e.g., demographic characteristics, disease history, medication history, blood test results, physical examination results, images related to cardiovascular disease, etc.). For reference, each sample of the training set may represent condition information of an individual diabetic patient, and the training set may consist of these samples and their label information (i.e., cardiovascular disease information). Additionally, the details of the label information may be determined according to the task of the predictor (54).

[0086] FIG. 6 illustrates a case in which a machine learning model (11C) is implemented based on a neural network according to some other embodiments of the present disclosure. Hereinafter, for the clarity of the present disclosure, names such as 'predictor 1' and 'predictor 2' will be named as 'first predictor' and 'second predictor', and this naming rule will be applied in the same way to other names used in the present disclosure.

[0087] As illustrated in FIG. 6, the overall structure of the machine learning model (11C) is similar to that of the machine learning model (11B) in FIG. 5. However, the machine learning model (11C) differs from the machine learning model (11B) in that it includes a plurality of predictors (e.g., 61-1, 61-2). FIG. 6 illustrates a case where the machine learning model (11C) is equipped with two predictors (61-1, 61-2), but the scope of the present disclosure is not limited thereto. For instance, the machine learning model (11C) may further include a third predictor (not shown), etc.

[0088] The first predictor (61-1) is a neural network module that predicts first risk information related to cardiovascular disease, and the second predictor (61-2) is a neural network module that predicts second risk information different from the first risk information (see below for examples of each risk information). That is, the first predictor (61-1) and the second predictor (61-2) are configured to perform different tasks (i.e., a task to predict first risk information and a task to predict second risk information) based on an integrated embedding.

[0089] The machine learning model (11-C) described above can be trained using a multi-task learning technique, and the number and types of tasks can be defined and designed in various ways. That is, the number and types of predictors connected to the integrated encoder (53) can be designed in various ways. FIG. 6 assumes a case where multi-task learning is performed using two tasks (or predictors (61-1, 61-2)).

[0090] For example, a machine learning model (11C) can be trained through a first task that predicts first risk information related to a first cardiovascular disease (e.g., ischemic heart disease, etc.) and a second task that predicts second risk information related to a second cardiovascular disease (e.g., myocardial infarction, etc.). That is, parameters of the first predictor (61-1), integrated encoder (53), embedder (51) and / or image encoder (52) can be updated based on the prediction loss of the first task, and parameters of the second predictor (61-2), integrated encoder (53), embedder (51) and / or image encoder (52) can be updated based on the prediction loss of the second task. As a more specific example, a machine learning model (11C) can be trained by performing a first task of predicting the risk of ischemic heart disease occurring within a specific period (i.e., whether it will occur) through a first predictor (61-1), and a second task of predicting the risk of myocardial infarction occurring within a specific period through a second predictor (61-2).

[0091] As another example, the machine learning model (11C) can be trained through a first task that predicts the risk of cardiovascular disease occurring within a first period and a second task that predicts the risk of cardiovascular disease occurring within a second period (i.e., the first risk information is the risk of cardiovascular disease occurring within the first period and the second risk information is the risk of cardiovascular disease occurring within the second period). As a more specific example, the machine learning model (11C) can be trained by performing a first task that predicts the risk of cardiovascular disease occurring within one year through a first predictor (61-1) and a second task that predicts the risk of cardiovascular disease occurring within three years through a second predictor (61-2).

[0092] As another example, the machine learning model (11C) can be trained through a first task that predicts the risk of cardiovascular disease occurring within a specific period and a second task that predicts the expected time of occurrence of cardiovascular disease (i.e., the first risk information is the risk of cardiovascular disease occurring within a specific period, and the second risk information is the expected time of occurrence of cardiovascular disease). As a more specific example, the machine learning model (11C) can be trained by performing a first task that predicts the risk of cardiovascular disease occurring within 3 years through a first predictor (61-1), and by performing a second task that predicts the expected time of occurrence of cardiovascular disease through a second predictor (61-2) corresponding to the regression head.

[0093] As another example, the machine learning model (11C) can be trained through a first task that predicts first risk information related to cardiovascular disease and a second task that predicts second risk information related to cardiovascular disease and other diabetes complications (e.g., retinopathy, neuropathy, chronic kidney disease, neurodegenerative disease, etc.). As a more specific example, the machine learning model (11C) can be trained by performing a first task that predicts the risk of cardiovascular disease occurring (i.e., whether it will occur) within a specific period through a first predictor (61-1) and by performing a second task that predicts the risk of neurodegenerative disease (or retinopathy, etc.) occurring within a specific period through a second predictor (61-2).

[0094] As another example, a machine learning model (11C) may be trained based on various combinations of the examples described above.

[0095] Up to now, the input / output information / data, structure, and training method of the machine learning model (11) have been described with reference to FIGS. 3 to 6. Below, various methods that can be performed in the prediction system (10) described above will be described with reference to FIGS. 7 and subsequent figures.

[0096] For convenience of understanding, the following description will continue by assuming that all steps / operations of the methods described below are performed in a prediction system (10, e.g., at least one processor). Therefore, if the subject of a specific step / operation is omitted, it can be understood that the step / operation is performed by the prediction system (10). However, in an actual environment, some steps / operations of the methods described below may be performed on a different computing device. For example, the preparation process of the machine learning model (11) (e.g., training, performance evaluation, etc.) may be performed on a different computing device.

[0097] FIG. 7 is an exemplary flowchart illustrating a method for predicting cardiovascular disease risk in diabetic patients according to some embodiments of the present disclosure. However, this is merely an exemplary embodiment for achieving the purpose of the present disclosure, and it is understood that some steps may be added or deleted as necessary.

[0098] As illustrated in FIG. 7, the cardiovascular disease risk prediction method according to the embodiments may begin with step S71 of preparing a machine learning model (11) that predicts risk information related to cardiovascular disease in diabetic patients. An example of the detailed process of step S71 is illustrated in FIG. 8.

[0099] FIG. 8 is an exemplary flowchart showing the detailed process of the machine learning model (11) preparation step S71.

[0100] As illustrated in FIG. 8, a training set and a test set are prepared first (S81). Here, the training set may include a validation set used to improve (evaluate) the performance of the machine learning model (11) or to tune hyperparameters. The test set may be understood as a dataset for evaluating the final performance of the machine learning model (11). Each of the training set and the test set may consist of multiple samples and label information for each sample (i.e., cardiovascular disease information), and each sample may include condition information of an individual diabetic patient.

[0101] The specific method of preparing the training set and test set may vary depending on the example.

[0102] In some embodiments, as illustrated in FIG. 9, a training set and a test set may be prepared based on the records of diabetic patients (e.g., status information of a diabetic patient group) of two independent cohorts (or three or more cohorts). Specifically, the prediction system (10) may construct (create) a training set (95) based only on the records of diabetic patients of the first cohort (91) (i.e., the training set (95) does not include the records of diabetic patients of the second cohort (92)), and construct (create) a test set (96) based only on the records of diabetic patients of the second cohort (92) (i.e., the test set (96) does not include the records of diabetic patients of the first cohort (91)). Alternatively, the training set (95) may be constructed based on the records of diabetic patients of the first cohort (91), and the test set (96) may be constructed based on the records of diabetic patients of the first cohort (91) and the second cohort (92). Each of the training set (95) and the test set (96) may include, for example, status information (i.e., samples) of a group of diabetic patients who have developed cardiovascular disease and a group of diabetic patients who have not. FIG. 9 illustrates, as an example, a case where the first cohort (91) consists of a group of diabetic patients from a first medical institution (93, e.g., one or more medical institutions) and the second cohort (92) consists of a group of diabetic patients from a second medical institution (94, e.g., one or more medical institutions) (i.e., the two cohorts (91, 92) are distinguished by the difference in medical institutions), but the scope of the present disclosure is not limited thereto. According to this embodiment, by constructing the test set (96) based on the records of diabetic patients from an external cohort (92) that were not used for training the machine learning model (11), the performance of the machine learning model (11) can be evaluated objectively and thoroughly.

[0103] In the preceding embodiments, the average age of diabetic patients constituting the test set (96) may be designed to be lower than that of the training set (95). In this case, the performance of the machine learning model (11) can be evaluated more strictly (because, since young diabetic patients often have a lower risk of developing cardiovascular disease, samples with high prediction difficulty are included in the test set (96)).

[0104] In some other embodiments, as illustrated in FIG. 10, an over-sampling technique that increases the number of samples of a minority class may be applied to the training set and / or test set to address the data imbalance problem. For example, the prediction system (10) may generate synthetic samples (e.g., 101, 102) belonging to a minority class (i.e., a group of diabetic patients with cardiovascular disease) using an over-sampling technique such as SMOTE (Synthetic Minority Over-sampling Technique), but the scope of the present disclosure is not limited thereto. As another example, the prediction system (10) may calculate the variance of each variable value constituting the status information of the diabetic patient group over all samples. Then, the prediction system (10) can generate synthetic samples of the minority class (e.g., 101, 102) by fixing the value of the variable with a relatively small variance and sampling the value of the variable with a relatively large variance from a preset range (e.g., a range of values ​​that are a certain distance away from the mean of the minority class samples of the variable). In this case, the diversity of samples belonging to the minority class can be easily increased.

[0105] In some other embodiments, training sets and test sets may be prepared based on various combinations of the embodiments described above.

[0106] Referring again to Fig. 8, the explanation will be provided.

[0107] In step S82, multiple candidate machine learning models are trained (built) using the training set. For example, as illustrated in FIG. 11, the prediction system (10) can train (build) a first candidate machine learning model (111-1), a second candidate machine learning model (111-2), etc. using the training set (112). At this time, the prediction system (10) may use a portion of the training set (112) as a validation set to tune the hyperparameter values ​​of each of the candidate machine learning models (e.g., 111-1, 111-2). Here, the second candidate machine learning model (111-2) may be a model designed such that the type of model / algorithm, structure, and hyperparameter values ​​are at least partially different from the first candidate machine learning model (111-1).

[0108] In step S83, the performance of each candidate machine learning model is evaluated using a test set. For example, referring again to FIG. 11, the prediction system (10) can evaluate the performance of each trained candidate machine learning model (e.g., 111-1, 111-2) using a test set (113). At this time, the metrics used for performance evaluation may include accuracy, precision, sensitivity, specificity, balanced accuracy, F1 score, AUROC (Area Under ROC Curve), etc., but the scope of the present disclosure is not limited thereto.

[0109] In step S84, a machine learning model (11) for prediction (inference) is selected from among a plurality of candidate machine learning models based on the evaluation results. For example, the prediction system (10) may select one or more candidate machine learning models with performance above a threshold as the machine learning model (11) for prediction.

[0110] Meanwhile, in some embodiments, the prediction system (10) may build an additional machine learning model using the importance of variables. For example, as illustrated in FIG. 12, let us assume that the prediction system (10) trains a first machine learning model (11-1, e.g., a machine learning model selected for prediction) using a training set (121), and the importance (122) of each of a plurality of variables (i.e., variables constituting the condition information of a diabetic patient) is derived. Here, the variable importance (122) refers to the degree of influence that a specific variable (feature) has on the prediction result of the first machine learning model (11-1). Furthermore, let us assume that the plurality of variables are classified into core (key) variables, intermediate variables, and non-core variables based on their importance (wherein a core variable is a variable whose importance is greater than or equal to a first threshold, a non-core variable is a variable whose importance is lower than or equal to a second threshold, and an intermediate variable is a variable whose importance is less than or equal to a first threshold and greater than or equal to a second threshold). In this case, the prediction system (10) can enhance the training set (121) based on variable importance (122). For example, the prediction system (10) can remove non-core variables from the training set (121) (i.e., remove all values ​​of non-core variables). Then, the prediction system (10) can fix the values ​​of intermediate variables and generate multiple synthetic samples by sampling the values ​​of core variables within a preset range, and add the generated synthetic samples to the training set. For instance, the prediction system (10) can generate a synthetic sample of a first group of diabetic patients with cardiovascular disease by sampling the values ​​of the corresponding core variable within a range of values ​​that are more than a certain distance away from the mean of the specific core variable of the first group of diabetic patients with cardiovascular disease (i.e., a minority class).Similarly, the prediction system (10) can generate a synthetic sample of a group of second-diabetic patients by sampling the value of a specific key variable from a range of values ​​that are more than a certain distance away from the mean of the second-diabetic patient group (i.e., multiple classes) that has not developed cardiovascular disease. Next, the prediction system (10) can train (build) a second machine learning model (11-2) using an enhanced training set (123). In the inference step, the prediction system (10) can determine risk information for the target diabetic patient related to cardiovascular disease by combining the prediction results of the first machine learning model (11-1) and the prediction results of the second machine learning model (11-2). Any specific method may be used to combine the two prediction results.

[0111] Referring again to Fig. 7, the explanation will be provided.

[0112] In step S72, condition information of the target diabetic patient is obtained. As described above, the condition information may consist of the values ​​of a number of variables (i.e., input variables of the machine learning model (11)), and specific examples of these variables are to be referred to in Tables 1 through 5.

[0113] In step S73, the acquired state information is input into a machine learning model (11) to predict risk information for the target diabetic patient related to cardiovascular disease. For example, the prediction system (10) can input the state information into the machine learning model (11) to predict the risk (i.e., whether or not) that cardiovascular disease will occur in the target diabetic patient within a specific period. Alternatively, the prediction system (10) may predict the risk by type of cardiovascular disease, or predict the time (i.e., expected time) when cardiovascular disease will occur in the target diabetic patient. As a more specific example, let us assume that the first machine learning model is configured to output (predict) the risk of cardiovascular disease occurring within a specific period, and the second machine learning model is configured to output (predict) the expected time of occurrence of cardiovascular disease. In this case, the prediction system (10) can predict the risk of cardiovascular disease occurring in the target diabetic patient within a specific period through the first machine learning model. And, if the predicted risk is greater than or equal to the threshold, the prediction system (10) can predict the expected time of occurrence of cardiovascular disease in the target diabetic patient through a second machine learning model.

[0114] In some embodiments, the prediction system (10) may derive and provide a trend of increasing risk for cardiovascular disease (i.e., a trend of increasing risk over time). For example, let us assume that a machine learning model (11) is configured as illustrated in FIG. 6. And let us assume that a first predictor (61-1) is configured to output (predict) the risk of cardiovascular disease occurring within a first period (e.g., 1 year), and a second predictor (61-2) is configured to output (predict) the risk of cardiovascular disease occurring within a second period (e.g., 3 years) that is different from the first period. In this case, the prediction system (10) can predict the first risk of cardiovascular disease occurring in the target diabetic patient within the first period through the first predictor (61-1), and predict the second risk of cardiovascular disease occurring in the target diabetic patient within the second period through the second predictor (61-2). Next, the prediction system (10) can derive an increasing trend of risk for cardiovascular disease in the subject diabetic patient based on the difference between the first risk level and the second risk level. For example, if the difference between the first risk level and the second risk level is significantly large (provided that the second period is longer than the first period), the prediction system (10) can determine that the risk of cardiovascular disease increases relatively steeply over time.

[0115] The prediction system (10) can provide the prediction results to the target diabetic patient (e.g., by transmitting them to the target diabetic patient's terminal (21), etc.). In addition, if the risk of cardiovascular disease is high, the prediction system (10) may further provide the target diabetic patient with preventive information (e.g., information regarding dietary habits, lifestyle habits, exercise methods, etc.), medical institution information, etc.

[0116] Up to this point, a method for predicting the risk of cardiovascular disease in diabetic patients according to several embodiments of the present disclosure has been described with reference to FIGS. 8 to 12. As described above, by comprehensively analyzing various condition information of diabetic patients (e.g., demographic characteristics, disease history, medication history, blood test results, physical examination results, etc.) through a machine learning model (11), risk information regarding cardiovascular disease in the diabetic patient can be accurately predicted early. For example, the risk of cardiovascular disease occurring in the diabetic patient within a specific period can be accurately predicted. Furthermore, by implementing preventive interventions based on the accurate prediction of the risk of cardiovascular disease, the incidence of cardiovascular disease in diabetic patients and the resulting social costs can be significantly reduced.

[0117] Hereinafter, performance tests conducted by the inventors of the present disclosure will be briefly introduced with reference to FIGS. 13 to 15.

[0118] The inventors conducted experiments to evaluate the predictive performance regarding the risk of cardiovascular disease on various machine learning models.

[0119] Specifically, as illustrated in FIG. 13, the inventors constructed a training set based on the records of diabetic patients of a first longitudinal cohort and a test set based on the records of diabetic patients of a second longitudinal cohort (i.e., a cohort independent of the first longitudinal cohort). Here, the first longitudinal cohort consisted of a group of type 2 diabetic patients from one hospital, and the second longitudinal cohort consisted of a group of type 2 diabetic patients from two hospitals different from the first longitudinal cohort. After removing missing data, the training set consisted of status information (refer to the variables listed in Tables 1 to 5) of 11,571 diabetic patients who did not develop cardiovascular disease and 1,238 diabetic patients who developed cardiovascular disease (e.g., ischemic heart disease, myocardial infarction, heart failure, atrial fibrillation) within 3 years (i.e., within 3 years from the time of diagnosis of diabetes). In addition, the test set consisted of status information from 2,019 diabetic patients who had not developed cardiovascular disease and 32 diabetic patients who had developed cardiovascular disease within 3 years. The diabetic patients in the test set were, on average, younger than those in the training set.

[0120] Next, the inventors conducted performance experiments on XGBoost, Random Forest, LightGBM, AdaBoost, Logistic Regression, and SVM. The inventors performed model training, hyperparameter tuning, and performance evaluation (i.e., first-order performance evaluation) by applying a 10-fold cross-validation technique to the training set, and evaluated the final performance of each machine learning model using the test set. Performance metrics used included AUROC, accuracy, sensitivity, specificity, and balance accuracy, and the results of the performance evaluation are presented in Tables 6 and 7 and Figure 14 below. Specifically, Table 6 lists the performance evaluation results for the validation set (i.e., the dataset split from the training), and Table 7 lists the performance evaluation results for the test set. Additionally, Figure 14 illustrates the AUROC measurement results of Random Forest for the validation set (i.e., the dataset split from the training). In Tables 6 and 7, 'RF' and 'LR' represent Random Forest and Logistic Regression, respectively.

[0121] Model AUROC Accuracy(%) Sensitivity(%) Specificity(%) Balance Accuracy(%) XGBoost0.84576.176.076.176.1RF0.83074.774.674.774.6LightGBM0.84275.975.875.975.9AdaBoost0.81773.974.173.874.0LR0.78671.971.971.971.9SVM0.48842.058.640.249.4

[0122] Model AUROC Accuracy(%) Sensitivity(%) Specificity(%) Balance Accuracy(%) XGBoost0.71064.764.664.764.6RF0.72266.466.466.466.4LightGBM0.71764.964.964.964.9AdaBoost0.71665.365.365.365.3LR0.71765.465.465.465.4SVM0.52650.850.850.850.8

[0123] Referring to Tables 6, 7, and Fig. 14, it can be seen that the performance of each machine learning model is generally good. This is attributed to the fact that the machine learning models were designed to predict the occurrence of cardiovascular disease (i.e., risk) by comprehensively considering various variables related to diabetic patients (see Tables 1 to 5). According to the results of the inventors' performance experiments, Random Forest was found to have the best performance among the various machine learning models. Fig. 15 illustrates the top 15 variables with high importance obtained from the training results of Random Forest. The importance of the variables was calculated based on Gini impurity, and in Fig. 15, 'Cr', 'TG', 'TC', 'DU', and 'CeVD' represent creatinine, triglycerides, total cholesterol, diuretics, and cerebrovascular disease, respectively.

[0124] As shown in Figure 15, among the various variables related to diabetic patients, creatinine levels were identified as the variable that had the greatest impact on the performance of the machine learning model, followed by glycated hemoglobin (HbA1c), AST, ALP, and ALT levels, which were found to be of high importance.

[0125] Up to now, performance experiments conducted by the inventors have been briefly introduced with reference to FIGS. 13 to 15. Below, with reference to FIG. 16, an exemplary computing device (160) capable of implementing a prediction system (10) according to some embodiments of the present disclosure will be described.

[0126] FIG. 16 is an exemplary hardware configuration diagram showing a computing device (160).

[0127] As illustrated in FIG. 16, a computing device (160) may include one or more processors (161), a bus (163), a communication interface (164), a memory (162) for loading a computer program (166) executed by the processor (161), and a storage (165) for storing the computer program (166). However, FIG. 16 illustrates only the components related to the embodiments of the present disclosure. Therefore, a person skilled in the art to which the present disclosure belongs will understand that other general-purpose components may be included in addition to the components (161 to 166) illustrated in FIG. 16. That is, the computing device (160) may include various additional components in addition to the components (161 to 166) illustrated in FIG. 16. Furthermore, depending on the case, the computing device (160) may be configured in a form in which some of the components (161 to 166) illustrated in FIG. 16 are omitted. Below, each component of the computing device (160) is described.

[0128] The processor (161) can control the overall operation of each component of the computing device (160). The processor (161) may be configured to include at least one of a CPU (Central Processing Unit), MPU (Micro Processor Unit), MCU (Micro Controller Unit), GPU (Graphic Processing Unit), or any form of processor well known in the art of the present disclosure. Additionally, the processor (161) may perform operations on at least one application or program to execute specific steps / operations / methods. The computing device (160) may have one or more processors.

[0129] Next, the memory (162) may store various data, commands and / or information. The memory (162) may load a computer program (166) from storage (165) to execute specific steps / operations / methods. The memory (162) may be implemented as volatile memory such as RAM, but the technical scope of the present disclosure is not limited thereto.

[0130] Next, the bus (163) can provide communication functions between components of the computing device (160). The bus (163) can be implemented as various types of buses, such as an address bus, a data bus, and a control bus.

[0131] Next, the communication interface (164) may support wired and wireless internet communication of the computing device (160). Additionally, the communication interface (164) may support various communication methods other than internet communication. To this end, the communication interface (164) may be configured to include a communication module well known in the art of the present disclosure.

[0132] Next, the storage (165) may store one or more computer programs (166) non-temporarily. The storage (165) may be configured to include non-volatile memory such as ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), flash memory, a hard disk, a removable disk, or any form of computer-readable recording medium well known in the art to which this disclosure belongs.

[0133] Next, the computer program (166) may include instructions that cause the processor (161) to perform specific steps / actions / methods when loaded into memory (162). That is, the processor (161) can perform specific steps / actions / methods by executing the instructions loaded into memory (162).

[0134] For example, a computer program (166) may include instructions for the operation of acquiring one or more machine learning models (11) prepared to predict risk information related to cardiovascular disease of a diabetic patient, the operation of acquiring condition information of a target diabetic patient, and the operation of inputting the acquired condition information into one or more machine learning models (11) to predict risk information related to cardiovascular disease of a target diabetic patient.

[0135] As another example, a computer program (166) may include instructions to perform at least some of the steps / actions / methods described with reference to FIGS. 1 through 15.

[0136] As illustrated, a prediction system (10) according to some embodiments of the present disclosure can be implemented through a computing device (160).

[0137] Meanwhile, in some embodiments, the computing device (160) illustrated in FIG. 16 may refer to a virtual machine implemented based on cloud technology. For example, the computing device (160) may be a virtual machine running on one or more physical servers included in a server farm. In this case, at least some of the processor (161), memory (162), and storage (165) illustrated in FIG. 16 may be virtual hardware, and the communication interface (164) may also be implemented as a virtualized networking element such as a virtual switch.

[0138] Up to now, with reference to FIG. 16, an exemplary computing device (160) capable of implementing a prediction system (10) according to some embodiments of the present disclosure has been described.

[0139] Various embodiments of the present disclosure and effects according to those embodiments have been described with reference to FIGS. 1 to 16. The effects according to the technical concept of the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by a person skilled in the art from the description below.

[0140] Furthermore, just because the above embodiments describe a plurality of components being combined into one or operating in combination, the technical concept of the present disclosure is not necessarily limited to these embodiments. That is, within the scope of the purpose of the technical concept of the present disclosure, all such components may be selectively combined into one or more combinations to operate.

[0141] The technical concept of the present disclosure described above may be implemented as computer-readable code on a computer-readable recording medium. A computer program stored on a computer-readable recording medium may be transmitted to another computing device via a network such as the Internet and installed on said computing device, thereby being used on said computing device.

[0142] Although operations are depicted in a specific order in the drawings, it should not be understood that the operations must necessarily be executed in the specific order depicted or in a sequential order, or that all depicted operations must be executed to obtain the desired result. In certain situations, multitasking and parallel processing may be advantageous. Although various embodiments of the present disclosure have been described above with reference to the attached drawings, those skilled in the art will understand that the technical concept of the present disclosure may be implemented in other specific forms without altering the technical concept or essential features thereof. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. The scope of protection of the present disclosure shall be interpreted by the claims below, and all technical concepts within the equivalent scope shall be interpreted as being included within the scope of rights of the technical concept defined by the present disclosure.

Claims

1. A method performed by at least one processor, A step of acquiring one or more machine-learning models prepared to predict risk information related to cardiovascular disease in diabetic patients; A step of obtaining condition information of a target diabetic patient; and A method comprising the step of inputting the above state information into one or more machine learning models to predict risk information of the target diabetic patient related to the cardiovascular disease. Method for predicting cardiovascular disease risk in diabetic patients.

2. In Paragraph 1, The above one or more machine learning models include a random forest, Method for predicting cardiovascular disease risk in diabetic patients.

3. In Paragraph 1, The above status information includes demographic characteristics, disease history, medication history, blood test results, and physical examination results. Method for predicting cardiovascular disease risk in diabetic patients.

4. In Paragraph 1, The above status information includes test results regarding creatinine, glycated hemoglobin (HbA1c), AST (aspartate aminotransferase), ALP (alanine aminotransferase), and ALT (alkaline phosphatase), Method for predicting cardiovascular disease risk in diabetic patients.

5. In Paragraph 1, The above status information includes test results regarding HDL (high-density lipoprotein) cholesterol, LDL (low-density lipoprotein) cholesterol, triglycerides, total cholesterol, glucose, and body mass index (BMI), as well as drug history regarding calcium channel blockers and diuretics, and disease history regarding cerebrovascular disease. Method for predicting cardiovascular disease risk in diabetic patients.

6. In Paragraph 1, The preparation process for the above one or more machine learning models is: A step of preparing a training set and a test set based on the records of diabetic patients of the first cohort and the records of diabetic patients of the second cohort - the second cohort is an independent cohort from the first cohort -; A step of training a specific machine learning model using the above training set; and A method comprising the step of evaluating the performance of the specific machine learning model using the above test set, Method for predicting cardiovascular disease risk in diabetic patients.

7. In Paragraph 6, The above training set is configured based on the records of diabetes patients of the above first cohort, and A method for predicting cardiovascular disease risk in diabetic patients, wherein the above test set is constructed based on the records of diabetic patients of the above second cohort and does not include the records of diabetic patients of the above first cohort.

8. In Paragraph 6, The average age of diabetic patients constituting the above test set is lower than that of the above training set, Method for predicting cardiovascular disease risk in diabetic patients.

9. In Paragraph 1, The preparation process for the above one or more machine learning models is: A step of preparing a training set and a test set based on the records of diabetic patients of the first cohort and the records of diabetic patients of the second cohort - the second cohort is an independent cohort from the first cohort -; A step of training a plurality of candidate machine learning models using the above training set; A step of evaluating the performance of each of the plurality of candidate machine learning models using the above test set; and A method comprising the step of selecting one or more machine learning models from among the plurality of candidate machine learning models based on the results of the above evaluation. Method for predicting cardiovascular disease risk in diabetic patients.

10. In Paragraph 1, The preparation process for the above one or more machine learning models is: A step of training a first machine learning model using a training set - each sample constituting the training set includes condition information of an individual diabetic patient, and the condition information of the individual diabetic patient relates to multiple variables -; A step of deriving the importance of each of the plurality of variables using the training results of the first machine learning model - the plurality of variables are classified into core variables, intermediate variables, and non-core variables based on the importance -; A step of reinforcing the training set based on the above importance; and The method includes the step of training a second machine learning model using the above-mentioned enhanced training set, and The step of strengthening the above training set is, A step of removing the non-core variables from the training set; and The method includes the step of generating a plurality of synthetic samples by sampling the value of the core variable within a preset range while fixing the value of the intermediate variable, and adding the generated synthetic samples to the training set. The step of predicting risk information for the above-mentioned target diabetes patient is, A method comprising the step of determining risk information for the target diabetic patient by combining the prediction result of the first machine learning model and the prediction result of the second machine learning model. Method for predicting cardiovascular disease risk in diabetic patients.

11. In Paragraph 1, Among the one or more machine learning models mentioned above, a specific machine learning model is: An embedder that generates a state embedding by embedding the state information of the above-mentioned diabetic patient; An image encoder that generates image embeddings by encoding an image of the diabetic patient associated with the above cardiovascular disease; An integrated encoder that generates an integrated embedding by encoding the state embedding and the image embedding; A first predictor that predicts the risk of the cardiovascular disease occurring within a first period based on the above integrated embedding; and It includes a second predictor that predicts the risk of the cardiovascular disease occurring within a second period different from the first period based on the above integrated embedding, and The step of predicting risk information for the above-mentioned target diabetes patient is, A step of predicting a first risk of the cardiovascular disease occurring in the target diabetic patient within the first period through the first predictor; A step of predicting a second risk of the cardiovascular disease occurring in the target diabetic patient within the second period through the second predictor; and A step comprising deriving an increasing trend of risk for cardiovascular disease based on the difference between the first risk level and the second risk level. Method for predicting cardiovascular disease risk in diabetic patients.

12. One or more processors; and It includes memory for storing computer programs executed by one or more of the above processors, and The above computer program is: The operation of acquiring one or more machine-learning models prepared to predict risk information related to cardiovascular disease in diabetic patients; An action of acquiring status information of a target diabetic patient; and Instructions for an operation to predict risk information of the target diabetic patient related to the cardiovascular disease by inputting the above state information into the above one or more machine learning models, Cardiovascular disease risk prediction system for diabetic patients.

13. In Paragraph 12, The preparation process for the above one or more machine learning models is: A step of preparing a training set and a test set based on the records of diabetic patients of the first cohort and the records of diabetic patients of the second cohort - the second cohort is an independent cohort from the first cohort -; The operation of training a specific machine learning model using the above training set; and A method including an operation to evaluate the performance of the specific machine learning model using the above test set, Cardiovascular disease risk prediction system for diabetic patients.

14. Combined with the computer processor, A step of acquiring one or more machine-learning models prepared to predict risk information related to cardiovascular disease in diabetic patients; A step of obtaining condition information of a target diabetic patient; and A computer-readable recording medium stored therein for executing the step of inputting the above state information into the above one or more machine learning models to predict risk information of the subject diabetic patient related to the cardiovascular disease, Computer program.

Images