Method, program and device for interpreting medical data based on explainable artificial intelligence

Abstract

According to an embodiment of the present disclosure, a method, program and device for interpreting medical data based on explainable artificial intelligence, executed by a computing device, is disclosed, which may include training a first neural network model based on first medical data to predict whether a disease is positive or negative for the first medical data, and training a second neural network model that transforms features of the second medical data using the trained first neural network model to predict whether a disease is positive or negative for the second medical data.

Description

[Technical Field]

[0001] The present disclosure relates to deep learning technology in the medical field, and more particularly to a method for interpreting the decision-making process of a deep learning model used for disease detection and explaining correlations between medical data and diseases based on the interpretation results.

[0002] [Background technology]

[0003] The biggest limitation of AI is its inability to accurately reveal its decision-making process, i.e., its black box limitations. In other words, we do not know the process and reasons behind AI's misjudgments. This limitation hinders error monitoring and detection, which is fatal in the medical field. Much research is currently being conducted to overcome this limitation.

[0004] For example, one prior study uses a sensitivity map to display data regions that are important for detecting disease. However, a sensitivity map has the drawback of only displaying regions that are deemed important and not explaining which features in those regions are associated with disease. Another prior study uses an ensemble technique to detect disease by integrating modules that explain each characteristic of the disease. This study can explain which characteristics were involved in the decision to detect disease. However, because this study uses only predetermined characteristics as modules, it has the limitation of not knowing which decision the artificial intelligence will actually make.

[0005] Summary of the Invention [Problem to be solved by the invention]

[0006] The present disclosure has been devised in response to the background art described above, and aims to provide a method that can explain the reasons for the judgments and decisions of a deep learning model for disease detection, and that can interpret which features of medical data are associated with disease based on such explanations.

[0007] However, the problems to be solved by the present disclosure are not limited to those mentioned above, and other problems not mentioned will be clearly understood from the description below.

[0008] [Means for solving the problem]

[0009] To achieve the above-described object, one embodiment of the present disclosure discloses a method for interpreting medical data based on explainable artificial intelligence, which is executed by a computing device, and includes the steps of: training a first neural network model based on first medical data to predict whether a disease is positive or negative for the first medical data; and training a second neural network model using the trained first neural network model to transform features of the second medical data so as to predict whether a disease is positive or negative for the second medical data inversely.

[0010] Alternatively, the second neural network model may include a first sub-neural network model that generates third medical data by transforming features of the second medical data so that the positivity or negativity of the disease is estimated opposite to that of the second medical data, and a second sub-neural network model that generates fourth medical data by transforming features of the third medical data so that the positivity or negativity of the disease is estimated the same as that of the second medical data.

[0011] Alternatively, the step of training a second neural network model using the trained first neural network model to transform features of the second medical data so that the positive or negative of the disease for the second medical data is predicted inversely can include the steps of transforming features of the second medical data using the second neural network model and predicting the positive or negative of the transformed second medical data for the features using the trained first neural network model, and training the second neural network model based on a loss function that has at least one of the transformed second medical data for the features or the predicted positive or negative result for the transformed second medical data for the features as an input variable.

[0012] Alternatively, the step of transforming the features of the second medical data using the second neural network model and estimating the positivity or negativity of the transformed second medical data using the trained neural network model may include the steps of: generating third medical data that is estimated to be positive, opposite to the second medical data, by transforming the features of the second medical data that are estimated to be negative based on a first sub-neural network model included in the second neural network model; and generating fourth medical data that corresponds to the second medical data that is estimated to be negative based on a second sub-neural network model included in the second neural network model.

[0013] Alternatively, the step of transforming the features of the second medical data using the second neural network model and estimating the positivity or negativity of the feature-transformed second medical data using the trained neural network model may further include the steps of inputting the second medical data estimated to be negative to the second sub-neural network model to generate fifth medical data corresponding to the second medical data estimated to be negative, and inputting the third medical data to the trained first neural network model to generate prediction data indicating the result of estimating the positivity or negativity of the disease for the third medical data.

[0014] Alternatively, the loss function may include a first loss function for evaluating whether the first sub-neural network model transforms input features corresponding to a negative result of the disease to generate an output corresponding to a positive result of the disease; a second loss function for evaluating whether the second sub-neural network model transforms output features of the first sub-neural network model to restore the input of the first sub-neural network model; and a third loss function for evaluating whether the second sub-neural network model generates an output that is the same as the input of the first sub-neural network model, based on the input of the first sub-neural network model.

[0015] Alternatively, the step of training the second neural network model based on a loss function having as an input variable at least one of the second medical data transformed from the features or a positive or negative prediction result for the second medical data transformed from the features may include the step of training the first sub-neural network model and the second sub-neural network model based on a loss function having as an input variable at least one of the fourth medical data, the fifth medical data, or the prediction data.

[0016] Alternatively, the step of training the first sub-neural network model and the second sub-neural network model based on a loss function having at least one of the fourth medical data, the fifth medical data, and the predicted data as an input variable may include the steps of: calculating a first loss function having the predicted data as an input variable, and training the first sub-neural network model so that a first loss, which is a result of the calculation of the first loss function, decreases; calculating a second loss function having the fourth medical data as an input variable, and training at least one of the first sub-neural network model or the second sub-neural network model so that a second loss, which is a result of the calculation of the second loss function, decreases; and calculating a third loss function having the fifth medical data as an input variable, and training the second sub-neural network model so that a third loss, which is a result of the calculation of the third loss function, decreases.

[0017] Alternatively, the first medical data and the second medical data may include electrocardiogram data, and the disease may include hyperkalemia.

[0018] Alternatively, the characteristics of the second medical data may be based on morphological differences between the hyperkalemia-negative electrocardiogram data and the hyperkalemia-positive electrocardiogram data.

[0019] Meanwhile, according to an alternative embodiment of the present disclosure for achieving the above-mentioned object, a method for interpreting medical data based on explainable artificial intelligence, executed by a computing device, is disclosed. The method includes the steps of acquiring medical data including electrocardiogram data, and generating output data in which a first neural network model predicts whether a disease is positive or negative inversely to the medical data by transforming features of the medical data based on a second neural network model. Here, the second neural network model may be previously trained using the first neural network model trained to predict whether a disease is positive or negative for the medical data.

[0020] Alternatively, the method may further comprise the step of generating a user interface for visually comparing the medical data with the output data.

[0021] According to one embodiment of the present disclosure, there is provided a computer program stored on a computer-readable storage medium. When executed by one or more processors, the computer program performs operations for interpreting medical data based on explainable artificial intelligence. The operations may include: training a first neural network model based on first medical data to predict whether a disease is present or absent for the first medical data; and training a second neural network model using the trained first neural network model to transform features of the second medical data to predict whether a disease is present or absent for the second medical data.

[0022] To achieve the above-mentioned object, one embodiment of the present disclosure provides a computing device for interpreting medical data based on explainable artificial intelligence. The device includes a processor including at least one core, a memory including program code executable by the processor, and a network unit for acquiring medical data. The processor is capable of training a first neural network model based on first medical data to predict whether a disease is present or absent for the first medical data, and using the trained first neural network model, training a second neural network model that transforms features of the second medical data to predict whether a disease is present or absent for the second medical data.

[0023] [Effects of the Invention]

[0024] The present disclosure can explain the reasons for the judgments and decisions of deep learning models for disease detection, and provide a way to interpret which features of medical data are associated with disease through such explanations.

[0025] [Brief explanation of the drawings]

[0026] [Figure 1] FIG. 1 is a block diagram of a computing device according to one embodiment of the present disclosure.

[0027] [Figure 2] FIG. 1 is a block diagram illustrating a process of classifying a disease as positive or negative using a first neural network model according to one embodiment of the present disclosure.

[0028] [Figure 3] FIG. 10 is a block diagram illustrating a process for interpreting medical data using a second neural network model according to an embodiment of the present disclosure.

[0029] [Figure 4] 10 is a graph showing a simulation result of a second neural network model trained according to an embodiment of the present disclosure.

[0030] [Figure 5] 1 is a flowchart illustrating a method for training a neural network model according to an embodiment of the present disclosure.

[0031] [Figure 6] 1 is a flowchart illustrating a method for interpreting medical data using a neural network model according to one embodiment of the present disclosure.

[0032] DETAILED DESCRIPTION OF THE INVENTION

[0033] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present disclosure. The embodiments presented in this disclosure are provided to enable those skilled in the art to use or practice the contents of the present disclosure. Therefore, various modifications to the embodiments of the present disclosure will be apparent to those skilled in the art. That is, the present disclosure may be embodied in various different forms and is not limited to the following embodiments.

[0034] Throughout the specification of the present disclosure, the same or similar reference numerals refer to the same or similar components. In addition, in order to clearly explain the present disclosure, reference numerals of parts that are not relevant to the explanation of the present disclosure may be omitted from the drawings.

[0035] The term "or" as used in this disclosure is intended to mean an inclusive "or" rather than an exclusive "or." That is, unless otherwise specified or otherwise clear from the context in this disclosure, "X uses A or B" should be understood to mean one of the natural inclusive permutations. For example, unless otherwise specified or otherwise clear from the context in this disclosure, "X uses A or B" can be interpreted as either X uses A, X uses B, or X uses both A and B.

[0036] The term "and / or" as used in this disclosure must be understood to indicate and include all possible combinations of one or more of the associated listed concepts.

[0037] The terms "comprises" and / or "comprising" as used in this disclosure should be understood to mean that the specified features and / or components are present. However, the terms "comprises" and / or "comprising" should not be understood to exclude the presence or addition of one or more other features, other components and / or combinations thereof.

[0038] In this disclosure, unless otherwise specified or clear from the context as referring to the singular form, the singular should generally be construed as including "one or more."

[0039] The term "Nth (N is a natural number)" used in this disclosure can be understood as an expression used to distinguish components of the present disclosure from one another based on a predetermined criterion, such as functional, structural, or convenience of description. For example, in this disclosure, components that perform different functional roles can be classified as a first component or a second component. However, components that are substantially identical within the technical concept of the present disclosure but must be distinguished for convenience of description can also be classified as a first component or a second component.

[0040] The term "acquire" as used in this disclosure may be understood to mean not only receiving data from an external device or system via a wired or wireless communication network, but also generating data in an on-device form.

[0041] Meanwhile, the terms "module" or "unit" used in this disclosure may be understood to refer to an independent functional unit that processes computing resources, such as a computer-related entity, firmware, software or a portion thereof, hardware or a portion thereof, or a combination of software and hardware. Here, a "module" or "unit" may refer to a unit composed of a single element or a unit expressed as a combination or collection of multiple elements. For example, as a concept of connotation, a "module" or "unit" may refer to a hardware element or a collection of hardware elements of a computing device, an application program that performs a specific software function, a processing procedure implemented by executing software, or a collection of instructions for executing a program. Furthermore, as a broad concept, a "module" or "unit" may refer to a computing device itself that constitutes a system, or an application executed on a computing device. However, the above concepts are merely examples, and the concepts of a "module" or "unit" may be defined in various ways within the scope of what one skilled in the art can understand based on the contents of this disclosure.

[0042] The term "model" as used in this disclosure may be understood as a system implemented using mathematical concepts and language to solve a specific problem, a set of software units for solving a specific problem, or an abstract model of a processing process for solving a specific problem. For example, a neural network "model" may refer to a system implemented as a neural network that has problem-solving capabilities through learning. Here, a neural network may have problem-solving capabilities by optimizing parameters connecting nodes or neurons through learning. A neural network "model" may include a single neural network or a neural network ensemble that combines multiple neural networks.

[0043] The term "block" used in this disclosure can be understood as a collection of components classified by various criteria, such as type, function, etc. Therefore, the components classified into one "block" can vary depending on the criteria. For example, a neural network "block" can be understood as a collection of neural networks including at least one neural network. Here, the neural networks included in a neural network "block" can be assumed to perform a certain operation to achieve a common purpose, which serves as the classification criterion.

[0044] The explanations of the above terms are intended to aid in understanding the present disclosure. Therefore, unless the above terms are explicitly stated as matters that limit the contents of the present disclosure, care should be taken not to use them in a way that limits the technical ideas of the contents of the present disclosure.

[0045] FIG. 1 is a block diagram of a computing device according to one embodiment of the present disclosure.

[0046] The computing device 100 according to an embodiment of the present disclosure may be a hardware device or part of a hardware device that performs comprehensive data processing and calculations, or may be a software-based computing environment connected via a communication network. For example, the computing device 100 may be a server that performs intensive data processing functions and shares resources, or a client that shares resources by interacting with the server. The computing device 100 may also be a cloud system in which multiple servers and clients interact with each other to comprehensively process data. The above description is merely an example of a type of computing device 100, and various types of computing devices 100 may be configured within the scope of what one skilled in the art would understand based on the contents of this disclosure.

[0047] 1, a computing device 100 according to an embodiment of the present disclosure may include a processor 110, a memory 120, and a network unit 130. However, since FIG. 1 is merely an example, the computing device 100 may include other components for implementing a computer environment. Also, the computing device 100 may include only some of the disclosed components.

[0048] The processor 110 according to an embodiment of the present disclosure may be understood as a component including hardware and / or software for performing computing operations. For example, the processor 110 may read a computer program to perform data processing for machine learning. The processor 110 may process operations such as input data processing for machine learning, feature extraction for machine learning, and error calculation based on backpropagation. The processor 110 for performing such data processing may include a central processing unit (CPU), a general-purpose graphics processing unit (GPGPU), a tensor processing unit (TPU), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc. The types of processor 110 described above are merely examples, and various types of processor 110 may be configured within the scope of what one skilled in the art would understand based on the present disclosure.

[0049] The processor 110 can perform training on a deep learning model used to interpret the judgment and decision-making process of an artificial intelligence for disease detection based on medical data. The processor 110 can train the deep learning model based on the medical data to provide a basis for the artificial intelligence's judgment on which features of the medical data affect the onset of a particular disease. For example, the processor 110 can input the medical data into the deep learning model and transform the medical data to predict whether or not the disease has occurred (i.e., whether the result is positive or negative). If the medical data is medical data of a person who has developed a disease (i.e., a positive person), the processor 110 can use the deep learning model to transform the input medical data so that it is predicted to be medical data of a person who has not developed the disease (i.e., a negative person). If the medical data is medical data of a person who has not developed the disease, the processor 110 can use the deep learning model to transform the input medical data so that it is predicted to be medical data of a person who has developed the disease. The data generated by such conversion may exhibit characteristics opposite to the input based on the presence or absence of a disease. The processor 110 may train the deep learning model by repeatedly performing forward propagation and backpropagation of the deep learning model so that the characteristics opposite to the input indicated by the medical data converted by the deep learning model are clearly expressed. The processor 110 may use the deep learning model trained by such a process to generate evidence that can explain the decision-making process of the artificial intelligence for diagnosing a specific disease.

[0050] The processor 110 may generate a user interface for interpreting the judgment and decision-making process of the artificial intelligence for disease detection. The processor 110 may generate a user interface for visualizing the judgment basis of the artificial intelligence provided using the deep learning model trained as described above. For example, the processor 110 may generate a graphical user interface for comparing medical data transformed by the trained deep learning model with pre-transformation medical data corresponding to the input of the deep learning model. The medical data transformed by the deep learning model may exhibit characteristics opposite to those of the input based on whether or not a disease is present. Therefore, by comparing the medical data transformed by the deep learning model with the pre-transformation medical data, we can easily understand which characteristics of the medical data affect the onset of a disease. Furthermore, by comparing the medical data transformed by the deep learning model with the pre-transformation medical data, we can easily understand how the artificial intelligence for disease detection interprets the characteristics of the medical data that affect the onset of a disease. To enable the user to easily perform such comparison and understanding, the processor 110 can generate a user interface that graphically represents the medical data converted by the deep learning model and the medical data before conversion.

[0051] The memory 120 according to an embodiment of the present disclosure may be understood as a component including hardware and / or software for storing and managing data processed by the computing device 100. That is, the memory 120 may store any type of data generated or determined by the processor 110 and any type of data received by the network unit 130. For example, the memory 120 may include at least one type of storage medium selected from the group consisting of flash memory, hard disk, multimedia card micro, card-type memory, random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. The memory 120 may also include a database system that manages data in a predetermined manner. The types of memory 120 described above are merely examples, and various configurations of the memory 120 are possible within the scope of what would be understood by one skilled in the art based on the present disclosure.

[0052] The memory 120 may structure and organize and manage data, data combinations, and program code executable by the processor 110 required for the processor 110 to perform calculations. For example, the memory 120 may store medical data received via the network unit 130 (described below). The memory 120 may store program code for operating a neural network model to receive medical data and perform learning, program code for operating the neural network model to receive medical data and perform inference according to the intended use of the computing device 100, and processed data generated by executing the program code.

[0053] The network unit 130 according to an embodiment of the present disclosure may be understood as a component that transmits and receives data via any type of known wired or wireless communication system. For example, the network unit 130 may transmit and receive data using a wired or wireless communication system such as a local area network (LAN), wideband code division multiple access (WCDMA), long term evolution (LTE), wireless broadband internet (WiBro), 5G, ultra wide-band, ZigBee, radio frequency (RF) communication, wireless LAN, wireless fidelity (WiFi), near field communication (NFC), or Bluetooth. The above-described communication systems are merely examples, and various wired and wireless communication systems for transmitting and receiving data by the network unit 130 may be applied in addition to the above examples.

[0054] The network unit 130 may receive data necessary for the processor 110 to perform calculations via wired or wireless communication with any system or any client. The network unit 130 may also transmit data generated by calculations by the processor 110 via wired or wireless communication with any system or any client. For example, the network unit 130 may receive medical data via communication with a database in a hospital environment, a cloud server that performs tasks such as standardizing medical data, or a computing device. The network unit 130 may transmit output data of the neural network model, and intermediate data and processed data derived during the calculation process of the processor 110 via communication with the database, server, computing device, or the like.

[0055] FIG. 2 is a block diagram illustrating a process of disease positive or negative classification using a first neural network model according to one embodiment of the present disclosure.

[0056] 2, a processor 110 of a computing device 100 according to an embodiment of the present disclosure may perform training on a first neural network model 200 for disease detection based on first medical data 10. The processor 110 may train the first neural network model 200 based on the first medical data 10 so that the first neural network model 200 classifies whether a patient is positive or negative for a disease. Here, the first medical data 10 may include data related to biological signals whose morphological interpretation is utilized for diagnosing the disease.

[0057] For example, the processor 110 may input electrocardiogram data included in the first medical data 10 into the first neural network model 200 and predict whether hyperkalemia is positive or negative for the measurement subject of the first medical data 10. The processor 110 may compare the prediction result of whether hyperkalemia is positive or negative for the first medical data 10 with ground truth (GT) using a loss function. The processor 110 may reconfigure parameters such as weights of the first neural network model 200 based on the comparison result. The processor 110 may repeatedly perform such calculations until the loss function converges, thereby training the first neural network model 200 based on the first medical data 10. Training of the first neural network model 200 may be performed using supervised learning, as exemplified above, as well as semi-supervised learning, unsupervised learning, reinforcement learning, and the like.

[0058] Meanwhile, the first neural network model 200 may include a neural network 210 for extracting features from the first medical data 10 and a neural network 220 for classifying whether a disease is positive or negative based on the extracted features. For example, the neural network 210 for feature extraction of the first neural network model 200 may include a residual neural network. The neural network 210 for feature extraction may be composed of n (n is a natural number) residual blocks. Each of the n residual blocks may include a convolution layer, an activation layer, a dropout layer, and a batch normalization layer. The neural network 220 for classification of the first neural network model 200 may channel-wise average the feature maps generated by the neural network 210 for feature extraction. The neural network 220 for classification can calculate the probability of being positive or negative for a disease through a fully connected layer (FCL) and a softmax activation layer.

[0059] FIG. 3 is a block diagram illustrating a process for interpreting medical data using a second neural network model according to one embodiment of the present disclosure.

[0060] The processor 110 of the computing device 100 according to an embodiment of the present disclosure may perform training of a second neural network model for interpreting the judgment and decision-making process of the first neural network model 200 for disease detection based on second medical data 20. The processor 110 may train the second neural network model based on the second medical data 20 so that the second neural network model generates a counter factor for the second medical data 20 based on a task of the first neural network model 200. The processor 110 may train the second neural network model so that the second neural network model generates comparison data that can be used to explain the data interpretation and decision-making process of the first neural network model 200. Here, the processor 110 may use the first neural network model 200 previously trained in the training process of the second neural network model. The second medical data 20 may include data related to biological signals whose morphological interpretation is utilized for disease diagnosis.

[0061] 3, the processor 110 may transform features of the second medical data 20 based on a first sub-neural network model 310 included in the second neural network model. Here, the feature transformation of the second medical data 20 may be understood as a computational process of generating new data based on the second medical data 20 so as to derive a result opposite to the prediction result of the first neural network model 200 for the second medical data 20. The processor 110 may transform features of the second medical data 20 via the first sub-neural network model 310 to generate third medical data 30 so as to infer the positivity or negativity of a disease opposite to that of the second medical data 20. Here, the first sub-neural network model 310 may include a neural network 311 for extracting features from the second medical data 20 and a neural network 312 for transforming the extracted features to generate third medical data 30 in which the positivity or negativity of a disease is inferred opposite to that of the second medical data 20. The neural network 311 for feature extraction of the first sub-neural network model 310 may correspond to the neural network 210 for feature extraction of the first neural network model 200. Therefore, in the learning process of the first sub-neural network model 310, learning of the neural network 311 for feature extraction is not performed, and only learning of the neural network 312 for generating the third medical data 30 can be performed.

[0062] For example, the processor 110 may input electrocardiogram data included in the second medical data 20 to the first sub-neural network model 310. Here, the electrocardiogram data included in the second medical data 20 may be electrocardiogram data of a person who is negative for hyperkalemia. The processor 110 may transform morphological features of the electrocardiogram data included in the second medical data 20, such as the PR interval, QRS duration, and T amplitude, through the first sub-neural network model 310. The processor 110 may then generate third medical data 30 including electrocardiogram data estimated to be positive for hyperkalemia by transforming the morphological features of the second medical data 20 using the first sub-neural network model 310. That is, the processor 110 may transform the morphological features of the electrocardiogram data estimated to be negative for hyperkalemia using the first sub-neural network model 310 to generate electrocardiogram data estimated to be positive for hyperkalemia using the first sub-neural network model 310.

[0063] The processor 110 may transform features of the third medical data 30 based on the second sub-neural network model 320 included in the second neural network model. Here, the feature transformation of the third medical data 30 may be understood as a computational process of restoring the third medical data 30 to the second medical data 20 so that the same prediction result as the first neural network model 200 for the second medical data 20 is derived. The processor 110 may transform the features of the third medical data 30 via the second sub-neural network model 320 so that the positive or negative status of the disease is estimated to be the same as that of the second medical data 20, thereby generating fourth medical data 40 corresponding to the second medical data 20. Here, the second sub-neural network model 320 may include a neural network 321 for extracting features from the third medical data 30 and a neural network 322 for transforming the extracted features to generate fourth medical data 40 corresponding to the second medical data 20. The neural network 321 for feature extraction of the second sub-neural network model 320 may correspond to the neural network 210 for feature extraction of the first neural network model 200. Therefore, in the learning process of the second sub-neural network model 320, learning of the neural network 321 for feature extraction is not performed, and only learning of the neural network 322 that generates the fourth medical data 40 can be performed.

[0064] For example, the processor 110 may input the third medical data 30, including electrocardiogram data generated via the first sub-neural network model 310, to the second sub-neural network model 320. Here, the electrocardiogram data included in the third medical data 30 may be data that is estimated by the first neural network model 200 to be positive for hyperkalemia. The processor 110 may convert morphological features of the electrocardiogram data included in the third medical data 30 based on indices such as the PR interval, QRS duration, and T amplitude of the electrocardiogram via the second sub-neural network model 320. The processor 110 may then generate fourth medical data 40 that is similar to the second medical data 20 by converting the morphological features of the third medical data 30 based on the second sub-neural network model 320. In other words, the processor 110 may perform a calculation to restore the third medical data 30 generated by the first sub-neural network model 310 to the second medical data 20 via the second sub-neural network model 320. That is, the processor 110 can use the second sub-neural network model 320 to transform the morphological features of the electrocardiogram data that are presumed to be positive for hyperkalemia to generate electrocardiogram data that are negative for hyperkalemia.

[0065] As described above, the processor 110 can convert the domain of the second medical data 20 using the first sub-neural network model 310 and the second sub-neural network model 320. Here, the domain of the second medical data 20 can be understood as a domain classified based on whether the second medical data 20 is positive or negative for a disease. For example, the processor 110 can convert the second medical data 20 corresponding to the negative domain of a specific disease into the positive domain through the first sub-neural network model 310. The processor 110 can convert the second medical data 20 converted into the positive domain back into the negative domain through the second sub-neural network model 320. Here, the positive domain conversion using the first sub-neural network model 310 and the negative domain conversion using the second sub-neural network model 320 can be understood as a computational process of converting the style of the second medical data 20 while maximally maintaining the content of the second medical data 20.

[0066] The processor 110 can predict whether a disease is positive or negative for the third medical data 30 generated by the first sub-neural network model 310 based on the pre-trained first neural network model 200. The processor 110 can input the third medical data 30 to the pre-trained first neural network model 200 and generate prediction data 50 including the result of estimating whether a disease is positive or negative for the third medical data 30. The processor 110 can confirm whether the third medical data 30 generated by the first sub-neural network model 310 is predicted to be positive or negative for a disease, as opposed to the second medical data 20, through the pre-trained first neural network model 200. That is, the processor 110 can evaluate the calculation result of the first sub-neural network model 310 using the pre-trained first neural network model 200. In other words, the pre-trained first neural network model 200 can be understood as a model for discriminating the calculation result of the first sub-neural network model 310.

[0067] For example, the processor 110 may input the third medical data 30 generated by inputting the second medical data 20 including electrocardiogram data negative for hyperkalemia to the first sub-neural network model 310 to the first neural network model 200. The processor 110 may extract features of the electrocardiogram data included in the third medical data 30 via the feature extraction neural network 210 of the first neural network model 200. The processor 110 may then generate prediction data 50 including a probability that the third medical data 30 is positive or negative for hyperkalemia based on the features of the third medical data 30 via the classification neural network 220 of the first neural network model 200. If the first sub-neural network model 310 successfully generates the third medical data 30 according to its task, the first neural network model 200 may output prediction data 50 including a result indicating that the third medical data 30 is positive for hyperkalemia. That is, the processor 110 can evaluate, via the first neural network model 200, whether the first sub-neural network model 310 transformed the features of the second medical data 20 to successfully generate the third medical data 30, which is positive for hyperkalemia, as opposed to the second medical data 20.

[0068] The processor 110 can input the second medical data 20 to the second sub-neural network model 320 and generate fifth medical data 60 corresponding to the second medical data 20. Here, the generation of the fifth medical data 60 can be understood as a calculation process in which the second sub-neural network model 320 evaluates whether the second medical data 20 is positive or negative for a disease and generates corresponding data. The second sub-neural network model 320 can basically perform the task of restoring the second medical data 20 based on the third medical data 30. Therefore, when the second medical data 20 is input to the second sub-neural network model 320, the second sub-neural network model 320 should theoretically generate fifth medical data 60 corresponding to the second medical data 20. That is, the processor 110 can input the second medical data 20 to the second sub-neural network model 320 and verify whether the second sub-neural network model 320 normally performs its task.

[0069] For example, the processor 110 may input the second medical data 20, including electrocardiogram data that is negative for hyperkalemia, to the second sub-neural network model 320. The processor 110 may generate the fifth medical data 60 by converting the morphological features of the electrocardiogram data included in the second medical data 20 via the second sub-neural network model 320. The second sub-neural network model 320 aims to generate data corresponding to the same domain as the second medical data 20 by converting the style while maintaining the content of the input. Therefore, the fifth medical data 60 may be the same data as the second medical data 20 that is negative for hyperkalemia. In other words, if the second sub-neural network model 320 successfully generates the fifth medical data 60 according to its task, it can be understood that the second sub-neural network model 320 directly outputs the second medical data 20 that is negative for hyperkalemia.

[0070] 3, the processor 110 may perform training on the first sub-neural network model 310 based on a first loss function. Here, the first loss function may be a loss function for evaluating whether the first sub-neural network model 310 transforms input features and generates an output that is opposite to the input and the positive or negative state of the disease. The first loss function may use prediction data 50 including a predicted result of the positive or negative state of the disease for the third medical data 30 and GT (ground truth) as input variables. For example, the first loss function may be expressed as follows:

[0071]

number

[0072] where y A is GT (ground truth), JPEG0007760713000002.jpg 55 is the predicted probability for positive or negative results included in the prediction data 50. Although Mathematical formula 1 expresses a cross-entropy function as the loss function, the present disclosure is not limited to this function.

[0073] The processor 110 can derive the first loss by calculating a first loss function using the prediction data 50 and ground truth (GT) as input variables. The processor 110 can train the first sub-neural network model 310 so that the first loss decreases. That is, the processor 110 can reconfigure the parameters of the first sub-neural network model 310 so that the first sub-neural network model 310 reduces the first loss, so that the first sub-neural network model 310 can deceive the first neural network model 200. For example, when the first sub-neural network model 310 receives electrocardiogram data that is negative for hyperkalemia, the processor 110 can repeatedly calculate the first loss function and reconfigure the parameters of the generating neural network 312 of the first sub-neural network model 310 so that the first loss decreases. Here, the parameter reconstruction of the generating neural network 312 of the first sub-neural network model 310 can be understood as a process of training the generating neural network 312 of the first sub-neural network model 310 so that the first neural network model 200 predicts the output of the first sub-neural network model 310 as electrocardiogram data indicating positive hyperkalemia. Here, since the feature extraction neural network 311 of the first sub-neural network model 310 corresponds to the feature extraction neural network 210 of the first neural network model 200, training of the feature extraction neural network 311 of the first sub-neural network model 310 does not need to be performed in the training process using the first loss function.

[0074] The processor 110 may perform training on at least one of the first sub-neural network model 310 or the second sub-neural network model 320 based on a second loss function. Here, the second loss function may be a loss function for evaluating whether the second sub-neural network model 320 converts the output features of the first sub-neural network model 310 to restore the input of the first sub-neural network model 310. The second loss function may use, as an input variable, fourth medical data 40 generated by the second sub-neural network model 320 based on the second medical data 20 and the third medical data 30 that are input to the first sub-neural network model 310. That is, the second loss function may be a function for comparing the input of the first sub-neural network model 310 with the output of the second sub-neural network model 320 based on the output of the first sub-neural network model 310. For example, the second loss function may be expressed as follows:

[0075]

number

[0076] where x real A is the second medical data 20, x recover A is the fourth medical data 40. Although Equation 2 expresses the mean square error function as the loss function, the present disclosure is not limited to this function.

[0077] The processor 110 can calculate a second loss function using the second medical data 20 and the fourth medical data 40 as input variables to derive the second loss. The processor 110 can train at least one of the first sub-neural network model 310 or the second sub-neural network model 320 so as to reduce the second loss. That is, the processor 110 can reconfigure parameters of at least one of the first sub-neural network model 310 or the second sub-neural network model 320 so as to reduce the second loss, so as to restore the fourth medical data 40 to the second medical data 20. For example, when the first sub-neural network model 310 receives electrocardiogram data that is negative for hyperkalemia, the processor 110 can iteratively calculate the second loss function and reconfigure parameters of the generating neural network 312 of the first sub-neural network model 310 and the generating neural network 322 of the second sub-neural network model 320 so as to reduce the second loss. Here, the reconstruction of the parameters of the generation neural networks 312 and 322 can be understood as a process of training the generation neural networks 312 and 322 so that the second sub-neural network model 320 generates electrocardiogram data negative for hyperkalemia that is identical to the input of the first sub-neural network model 310. Here, the feature extraction neural network 311 of the first sub-neural network model 310 and the feature extraction neural network 321 of the second sub-neural network model 320 correspond to the feature extraction neural network 210 of the first neural network model 200, so training of the feature extraction neural networks 311 and 321 does not need to be performed in the training process using the first loss function. Through training using such a second loss function, the processor 110 can prevent the second sub-neural network model 320 from generating an output unrelated to the input of the first sub-neural network model 310. In other words, the processor 110 can, through learning using the second loss function, ensure that the output of the second sub-neural network model 320 is a form in which only the style is transformed while maintaining the content of the input of the first sub-neural network model 310 to the greatest extent possible.

[0078] The processor 110 may perform training on the second sub-neural network model 320 based on a third loss function. Here, the third loss function may be a loss function for evaluating whether the second sub-neural network model 320 generates an output that is the same as the input of the first sub-neural network model 310 based on the input of the first sub-neural network model 310. The third loss function may use, as an input variable, the fifth medical data 60 generated by the second sub-neural network model 320 based on the second medical data 20 and the third medical data 30 that are input to the first sub-neural network model 310. That is, the third loss function may be a function for comparing the input of the first sub-neural network model 310 with the output of the second sub-neural network model 320 based on the input of the first sub-neural network model 310. For example, the third loss function may be expressed as the following Equation 3.

[0079]

number

[0080] where x real A is the second medical data 20, x iden A is the fifth medical data 60. Although Equation 3 expresses the mean square error function as the loss function, the present disclosure is not limited to this function.

[0081] The processor 110 can calculate a third loss function using the second medical data 20 and the fifth medical data 60 as input variables to derive the third loss. The processor 110 can train the second sub-neural network model 320 to reduce the third loss. That is, the processor 110 can reconfigure the parameters of the second sub-neural network model 320 to reduce the third loss so as to minimize the difference between the fifth medical data 60 and the second medical data 20. For example, when the second sub-neural network model 320 receives electrocardiogram data that is negative for hyperkalemia, the processor 110 can iteratively calculate the third loss function and reconfigure the parameters of the generating neural network 322 of the second sub-neural network model 320 to reduce the third loss. Here, the parameter reconstruction of the generating neural network 322 of the second sub-neural network model 320 can be understood as a process of training the generating neural network 322 of the second sub-neural network model 320 so that the second sub-neural network model 320 generates electrocardiogram data that is negative for hyperkalemia and identical to the input electrocardiogram data. Here, because the feature extraction neural network 321 of the second sub-neural network model 320 corresponds to the feature extraction neural network 210 of the first neural network model 200, training of the feature extraction neural network 321 of the second sub-neural network model 320 does not need to be performed in the training process using the third loss function. Through training using this third loss function, the second sub-neural network model 320 can accurately identify the domain of the data to be converted. That is, the processor 110 can train the second sub-neural network model 320 through training using the third loss function so that the second sub-neural network model 320 generates the same domain as the input of the first sub-neural network model 310.

[0082] Meanwhile, the loss function for training the second neural network model including the first sub-neural network model 310 and the second sub-neural network model 320 can be expressed as the sum of the first loss function, the second loss function, and the third loss function. That is, the processor 110 can train the second neural network model in a direction to reduce the sum of the losses derived as the calculation results of the above-mentioned respective loss functions. Through such training, the second neural network model can generate an adverse factor for the input medical data as a basis for explaining which feature of the medical data the first neural network model 200 interpreted to predict whether or not a disease was present.

[0083] As described above, when the second neural network model is trained to generate opposing factors for the input medical data, the prediction result of the first neural network model 200 for the medical data and the prediction result of the first neural network model 200 for the output of the second neural network model receiving the medical data may be derived to be opposite. For example, if the prediction result of the pre-trained first neural network model 200 for the medical data is negative, the prediction result of the pre-trained first neural network model 200 for the output of the second neural network model receiving the medical data may be positive. Therefore, by comparing the input and output of the second neural network model, it is possible to easily explain which features of the medical data the first neural network model 200 used to determine whether a disease was positive or negative. In other words, the second neural network model can be effectively used to explain the data interpretation and decision-making process of the first neural network model 200.

[0084] FIG. 4 is a graph showing simulation results of the second neural network model trained according to one embodiment of the present disclosure.

[0085] To validate the second neural network model trained according to an embodiment of the present disclosure, nine negative samples were extracted from the electrocardiogram recordings of patients classified as negative for hyperkalemia by moving a 2-second window at 1-second intervals. The nine negative samples were then input into the trained second neural network model and converted into positive samples. Figure 4 shows the results of comparing the samples. The three graphs superimposed in Figure 4 are a first graph 81 corresponding to the negative samples, a second graph 82 corresponding to the positive samples generated by the second neural network model, and a third graph 83 corresponding to the samples of patients actually diagnosed as positive for hyperkalemia.

[0086] Comparing first graph 81 with second graph 82, it can be seen that the positive samples generated by the second neural network model have QRS durations and PR intervals that are 1.14 times and 1.64 times larger on average than the negative samples. Furthermore, the proportion of positive samples generated by the second neural network model that have Tall T is 45.34%, which is a significant increase of more than twice that of the negative samples. Here, Tall T can be understood as the case where the T amplitude is more than half the R peak amplitude. Comparing second graph 82 with third graph 83, it can be seen that second graph 82 exhibits a similar change pattern to third graph 83.

[0087] The above results show that the second neural network model trained according to an embodiment of the present disclosure can appropriately convert and propose morphological features of an electrocardiogram that affect the prediction of whether hyperkalemia is positive or negative. In other words, by using the second neural network model trained according to an embodiment of the present disclosure, it is possible to explain the criteria for which morphological features of an electrocardiogram a neural network model for diagnosing a disease (e.g., the first neural network model of the present disclosure) should consider to predict whether hyperkalemia is positive or negative.

[0088] FIG. 5 is a flowchart illustrating a method for training a neural network model according to an embodiment of the present disclosure.

[0089] Referring to FIG. 5 , a computing device 100 according to an embodiment of the present disclosure may train a first neural network model to predict whether a disease is positive or negative for the first medical data based on the first medical data (S110). Here, the first medical data may be biological signal-related data including sequential information, such as an electrocardiogram. The disease predicted by the first neural network model may be hyperkalemia. Because hyperkalemia is often asymptomatic up to extremely dangerous levels, diagnosing hyperkalemia is difficult, especially outside of a hospital. Therefore, there is growing interest in diagnosing hyperkalemia using electrocardiograms, which are non-invasive and can be obtained in daily life. In response to this need, the first neural network model may receive electrocardiogram data and classify whether or not a subject measured in the electrocardiogram data has hyperkalemia. However, the data and disease types are merely examples, and the task of the first neural network model of the present disclosure is not limited to the above examples.

[0090] The computing device 100 can use the first neural network model trained in step S110 to train a second neural network model that transforms the features of the second medical data so that the second medical data is conversely predicted to be positive or negative for a disease (S120). Here, the second neural network model can be understood as a model that proposes a basis for explaining the judgment and decision-making process of the first neural network model. The second medical data, like the first medical data, can be biological signal-related data including sequential information such as an electrocardiogram. The disease for the second medical data can be hyperkalemia.

[0091] Specifically, the computing device 100 may transform features of the second medical data using a second neural network model. The computing device 100 may use the first neural network model trained in step S110 to estimate positivity or negativity for the feature-transformed second medical data. Here, the second neural network model may include a first sub-neural network model that generates third medical data by transforming features of the second medical data so that the positivity or negativity of the disease is estimated opposite to that of the second medical data, and a second sub-neural network model that generates fourth medical data by transforming features of the third medical data so that the positivity or negativity of the disease is estimated the same as that of the second medical data.

[0092] For example, the computing device 100 may generate third medical data that is predicted to be positive, opposite to the second medical data, by transforming features of the second medical data that are predicted to be negative based on the first sub-neural network model included in the second neural network model. If the second medical data is electrocardiogram data of a patient diagnosed as negative for hyperkalemia, the computing device 100 may generate third medical data that is electrocardiogram data predicted to be positive for hyperkalemia by the first neural network model by transforming morphological features of the second medical data through the first sub-neural network model included in the second neural network model. That is, the first sub-neural network model may perform an operation to transform features of data based on a morphological difference between electrocardiogram data that is negative for hyperkalemia and electrocardiogram data that is positive for hyperkalemia.

[0093] The computing device 100 can generate fourth medical data corresponding to the second medical data that is predicted to be negative by transforming the features of the third medical data based on the second sub-neural network model included in the second neural network model. If the third medical data is electrocardiogram data predicted to be positive for hyperkalemia by the first neural network model, the computing device 100 can generate fourth medical data corresponding to the second medical data by transforming the morphological features of the third medical data through the second sub-neural network model included in the second neural network model. That is, the second sub-neural network model can perform an operation to transform the features of the data based on the morphological difference between the electrocardiogram data that is negative for hyperkalemia and the electrocardiogram data that is positive for hyperkalemia.

[0094] The computing device 100 inputs the third medical data into the first neural network model trained in step S110, and can generate prediction data indicating the result of estimating whether the third medical data is positive or negative for a disease. If the second medical data is electrocardiogram data of a patient diagnosed as negative for hyperkalemia, the third medical data generated by the first sub-neural network model should be estimated as positive for hyperkalemia by the first neural network model. Therefore, to evaluate whether the first sub-neural network model has successfully generated the third medical data, the computing device 100 can analyze the third medical data through the first neural network model to determine whether the third medical data corresponds to data indicating positive for hyperkalemia.

[0095] The computing device 100 can input second medical data that is estimated to be negative to the second sub-neural network model and generate fifth medical data corresponding to the second medical data that is estimated to be negative. If the second medical data is electrocardiogram data of a patient diagnosed with negative hyperkalemia, the fifth medical data generated by the second sub-neural network model should also be estimated by the first neural network model to be negative for hyperkalemia, just like the second medical data. Therefore, to evaluate whether the second sub-neural network model correctly identifies the data domain, the computing device 100 can verify whether the second sub-neural network model generates data that is the same as the second medical data.

[0096] The computing device 100 can train the second neural network model based on a loss function having as an input variable at least one of the feature-transformed second medical data or a positive or negative prediction result for the feature-transformed second medical data. In other words, the computing device 100 can train the first sub-neural network model and the second sub-neural network model included in the second neural network model based on a loss function having as an input variable at least one of the fourth medical data, the fifth medical data, and the prediction data. Here, the loss function can include a first loss function reflecting whether the first sub-neural network model transforms input features corresponding to a negative result of a disease to generate an output corresponding to a positive result of a disease, a second loss function reflecting whether the second sub-neural network model transforms output features of the first sub-neural network model to restore the input of the first sub-neural network model, and a third loss function reflecting whether the second sub-neural network model generates an output identical to the input of the first sub-neural network model based on the input of the first sub-neural network model.

[0097] For example, the computing device 100 may calculate a first loss function using the predicted data as an input variable and train the first sub-neural network model so that the first loss, which is the calculation result of the first loss function, decreases. If the second medical data is electrocardiogram data of a patient diagnosed with negative hyperkalemia, the computing device 100 may compare the predicted data with ground truth (GT) corresponding to electrocardiogram data positive for hyperkalemia via the first loss function. The computing device 100 may update the neural network parameters of the first sub-neural network model to minimize the first loss derived as a result of the comparison. Here, minimizing the first loss can be understood as training the first sub-neural network model so that the first sub-neural network model recognizes the third medical data generated by the first sub-neural network model as electrocardiogram data of a patient diagnosed with positive hyperkalemia.

[0098] The computing device 100 can calculate a second loss function using the fourth medical data as an input variable and train at least one of the first sub-neural network model or the second sub-neural network model so that the second loss, which is the calculation result of the second loss function, is reduced. If the second medical data is electrocardiogram data of a patient diagnosed as negative for hyperkalemia, the computing device 100 can compare the second medical data with the fourth medical data using the first loss function. The computing device 100 can update neural network parameters of at least one of the first sub-neural network model or the second sub-neural network model to minimize the second loss derived as a comparison result. Here, minimizing the second loss can be understood as training at least one of the first sub-neural network model or the second sub-neural network model so that the fourth medical data generated by the second sub-neural network model corresponds to data obtained by restoring the second medical data from the third medical data.

[0099] The computing device 100 calculates a third loss function using the fifth medical data as an input variable and trains the second sub-neural network model so that the third loss, which is the calculation result of the third loss function, is reduced. If the second medical data is electrocardiogram data of a patient diagnosed with negative hyperkalemia, the computing device 100 can compare the second medical data with the fifth medical data using the third loss function. The computing device 100 can update the neural network parameters of the second sub-neural network model to minimize the third loss derived as a comparison result. Here, minimizing the third loss can be understood as training the second sub-neural network model so that the second sub-neural network model can output the same fifth medical data as the second medical data.

[0100] The second neural network model trained as described above has the advantage of being independent of the structure of the first neural network model to be interpreted. That is, the second neural network model according to an embodiment of the present disclosure has the advantage of being flexible enough to interpret any model structure as long as it classifies a disease as positive or negative. Furthermore, the second neural network model according to an embodiment of the present disclosure has the advantage of not necessarily requiring paired data for training. In the other two conditions, since there is no need to prepare two electrocardiograms from the same patient to analyze morphological differences in electrocardiograms, data collection for training the second neural network model is simple. This is because the second neural network model according to an embodiment of the present disclosure can recognize morphological differences between both groups in unpaired data sets and generate counter factors to the input.

[0101] FIG. 6 is a flow chart illustrating a method for interpreting medical data using a neural network model according to one embodiment of the present disclosure.

[0102] 6, a computing device 100 according to an embodiment of the present disclosure may acquire medical data including electrocardiogram data (S210). For example, if the computing device 100 is a server or client of a cloud system, the computing device 100 may receive electrocardiogram data through communication with a database in a hospital environment or communication with an electrocardiogram measurement device. If the computing device 100 is a database in a hospital environment, the computing device 100 may generate electrocardiogram data through communication with an electrocardiogram measurement device in a hospital environment. Also, if the computing device 100 is an electrocardiogram measurement device, the computing device 100 may perform an electrocardiogram measurement process itself to generate electrocardiogram data.

[0103] The computing device 100 may generate output data in which a positive or negative diagnosis of a disease is predicted inversely to the medical data by transforming the characteristics of the medical data acquired in step S210 using a second neural network model (S220). Here, the second neural network model may be pre-trained using a first neural network model trained to predict whether a disease is positive or negative for medical data. The training process of the second neural network model using the pre-trained first neural network model is the same as that shown in FIG. 5 above, and therefore a detailed description thereof will be omitted below. For example, if the computing device 100 acquires electrocardiogram data in which hyperkalemia is determined to be negative, the computing device 100 may input the acquired electrocardiogram data into a second neural network model to transform the morphological characteristics of the electrocardiogram data. Here, the second neural network model may modify the shape of the input electrocardiogram data based on indicators such as the PR interval, QRS duration, and T amplitude of the electrocardiogram so that the data generated as output is determined to be positive for hyperkalemia. The computing device 100 can generate electrocardiogram data that can be determined to be positive for hyperkalemia by feature transformation using the second neural network model, where the electrocardiogram data corresponding to the output of the second neural network model can be electrocardiogram data that can be determined to be positive by the first neural network model that classifies hyperkalemia as positive or negative.

[0104] The computing device 100 may generate a user interface for visually comparing the medical data acquired in step S110 with the output data of the second neural network model generated in step S120 (S230). The output data of the second neural network model generated in step S120 may indicate factors opposite to those of the medical data acquired in step S110, based on whether a disease is positive or negative. That is, the output data of the second neural network model generated in step S120 may serve as a basis for explaining the AI's judgment process for classifying whether a disease is positive or negative. Therefore, in order to allow a user to easily understand the AI's judgment process by comparing the medical data acquired in step S110 with the output data of the second neural network model generated in step S120, the computing device 100 may generate a user interface for visually comparing the two data.

[0105] For example, as shown in FIG. 4, the computing device 100 may generate a graph-type graphic for each of the medical data acquired in step S110 and the output data of the second neural network model generated in step S120. Here, the computing device 100 may implement both data generated in the graph-type graphic in a region of the user interface. To facilitate comparison between the two data, the computing device 100 may superimpose the graph-type graphic in a region of the user interface and display it. Here, the computing device 100 may perform a scale matching operation for clear comparison of the superimposed graphs.

[0106] Meanwhile, the computing device 100 may share a user interface with a client and provide graphics to the user through the client. The computing device 100 may also implement a user interface through its own input / output unit and provide graphics to the user.

[0107] The various embodiments of the present disclosure described above can be combined with additional embodiments and can be modified within the scope that can be understood by those skilled in the art from the above detailed description. The embodiments of the present disclosure are illustrative in all respects and should not be construed as limiting. For example, each component described as a single type can also be implemented in a distributed form, and similarly, components described as distributed can also be implemented in a combined form. Therefore, all modifications and variations derived from the meaning, scope, and equivalent concepts of the claims of the present disclosure should be construed as being within the scope of the present disclosure. [Explanation of symbols]

[0108] 100: Computing equipment 110: Processor 120: Memory 130: Network Department 200: First neural network model 210: Feature Extraction Neural Network 220: Classification Neural Networks 310: First sub-neural network model 311: Feature Extraction Neural Network 312: Generative Neural Networks 320: Second sub-neural network model 321: Feature Extraction Neural Network 322: Generative Neural Networks

Claims

1. 1. A method for interpreting medical data based on explainable artificial intelligence, executed by a computing device including at least one processor, comprising: training a first neural network model based on first medical data to predict whether a disease is positive or negative for the first medical data; a step of training a second neural network model that transforms the features of the input second medical data, wherein the second neural network model is trained so that when the trained first neural network model is used, the predicted positive or negative result of the disease for the second medical data is reversed before and after the transformation; A method comprising:

2. The second neural network model is a first sub-neural network model for generating third medical data by transforming features of the second medical data so that the positivity or negativity of the disease is predicted inversely to the second medical data; a second sub-neural network model that generates fourth medical data by transforming the features of the third medical data so that the positivity or negativity of the disease is estimated to be the same as that of the second medical data; The method of claim 1 , comprising:

3. A step of training a second neural network model that transforms the characteristics of input second medical data, wherein when the trained first neural network model is used, the second neural network model is trained so that the predicted positive or negative results of the disease for the second medical data are opposite before and after the transformation, transforming features of the second medical data using the second neural network model, and predicting whether the features are positive or negative for the transformed second medical data using the trained first neural network model; training the second neural network model based on a loss function having as input variables at least one of the second medical data transformed from the features or a positive or negative prediction result for the second medical data transformed from the features; The method of claim 1 , comprising:

4. The step of transforming the features of the second medical data using the second neural network model and estimating the positivity or negativity of the features for the transformed second medical data using the trained first neural network model includes: generating third medical data that is predicted to be positive, opposite to the second medical data, by transforming features of the second medical data that are predicted to be negative based on a first sub-neural network model included in the second neural network model; generating fourth medical data corresponding to the second medical data that is presumed to be negative by transforming features of the third medical data based on a second sub-neural network model included in the second neural network model; The method of claim 3, comprising:

5. The step of transforming the features of the second medical data using the second neural network model and estimating the positivity or negativity of the features for the transformed second medical data using the trained first neural network model includes: inputting the third medical data into the trained first neural network model and generating prediction data indicating a result of estimating whether the third medical data is positive or negative for the disease; The method of claim 4 further comprising:

6. The step of transforming the features of the second medical data using the second neural network model and estimating the positivity or negativity of the features for the transformed second medical data using the trained first neural network model includes: inputting the second medical data estimated to be negative into the second sub-neural network model to generate fifth medical data corresponding to the second medical data estimated to be negative; The method of claim 5 further comprising:

7. The loss function is a first loss function for evaluating whether the first sub-neural network model transforms input features corresponding to a negative for the disease to generate an output corresponding to a positive for the disease; a second loss function for evaluating whether the second sub-neural network model transforms the output features of the first sub-neural network model to restore the input features of the first sub-neural network model; a third loss function for evaluating whether the second sub-neural network model generates the same output as the input of the first sub-neural network model based on the input of the first sub-neural network model; The method of claim 6, comprising:

8. The step of training the second neural network model based on a loss function having as input variables at least one of the second medical data transformed from the features or a positive or negative prediction result for the second medical data transformed from the features, training the first sub-neural network model and the second sub-neural network model based on a loss function having at least one of the fourth medical data, the fifth medical data, and the prediction data as an input variable; The method of claim 6, comprising:

9. the step of training the first sub-neural network model and the second sub-neural network model based on a loss function having at least one of the fourth medical data, the fifth medical data, and the prediction data as an input variable, calculating a first loss function using the prediction data as an input variable, and training the first sub-neural network model so that a first loss, which is a calculation result of the first loss function, is reduced; calculating a second loss function using the fourth medical data as an input variable, and training at least one of the first sub-neural network model and the second sub-neural network model so that a second loss, which is a calculation result of the second loss function, is reduced; calculating a third loss function using the fifth medical data as an input variable, and training the second sub-neural network model so that a third loss, which is a calculation result of the third loss function, is reduced; The method of claim 8, comprising:

10. the first medical data and the second medical data include electrocardiogram data; 10. The method of claim 1, wherein the disease comprises hyperkaleemia.

11. The second medical data feature may be a morphological difference between the electrocardiogram data negative for hyperkalemia and the electrocardiogram data positive for hyperkalemia.

11. The method of claim 10, wherein the difference is based on the

12. 1. A method for interpreting medical data based on explainable artificial intelligence, executed by a computing device including at least one processor, comprising: acquiring medical data including electrocardiogram data; a step of training a second neural network model that transforms the features of the input second medical data, wherein the second neural network model is trained so that when the trained first neural network model is used, the predicted result of whether a disease is positive or negative for the second medical data is reversed before and after the transformation; Including, A method wherein the second neural network model is pre-trained using the first neural network model trained to predict disease positivity or negativity for the medical data.

13. generating a user interface for visually comparing the medical data with output data; 13. The method of claim 12, further comprising:

14. A computer program stored on a computer-readable storage medium, comprising: The computer program, when executed by one or more processors, performs operations for interpreting medical data based on explainable artificial intelligence; The operation is an operation of training a first neural network model based on first medical data to predict whether the first medical data is positive or negative for a disease; an operation of training a second neural network model that transforms the features of input second medical data, wherein when the trained first neural network model is used, the second neural network model is trained so that the positive or negative prediction result for the disease for the second medical data is reversed before and after the transformation; a computer program comprising:

15. 1. A computing device for explainable artificial intelligence based interpretation of medical data, comprising: a processor including at least one core; a memory containing program code executable by the processor; a network unit for acquiring medical data; Including, The processor: training a first neural network model based on first medical data to predict whether the first medical data is positive or negative for a disease; An apparatus that trains a second neural network model that transforms the features of input second medical data, and trains the second neural network model so that when the trained first neural network model is used, the predicted positive or negative result of the disease for the second medical data is opposite before and after the transformation.

Images