Method for generating representative lesion image of pathological diagnosis case, and computing system for performing same

Abstract

Provided are a method for generating a representative lesion image representing a pathological diagnosis case from among partial images of each of a plurality of biological tissue images included in the pathological diagnosis case, and a computing system for performing same. Provided is the method comprising the steps of: acquiring pathological diagnosis case data including a plurality of biological tissue images and a pixel unit diagnosis result of each of the plurality of biological tissue images; acquiring a first lesion pattern and a second lesion pattern of the pathological diagnosis case; searching for a first partial region, a second partial region and a third partial region of the biological tissue image with respect to each of the plurality of biological tissue images included in the pathological diagnosis case; and selecting a representative lesion image representing the pathological diagnosis case from among the first partial region, the second partial region and the third partial region of each of the plurality of biological tissue images, and outputting same.

Description

Method for generating representative lesion images of pathological diagnosis cases and computing system for performing the same

[0001] The present invention relates to a method for generating a representative lesion image representing a pathology diagnosis case from among partial images of each of a plurality of biological tissue images included in the pathology diagnosis case, and a computing system for performing the method.

[0002]

[0003] In medicine, pathology, which involves interpreting actual specimens, is crucial for accurately diagnosing and predicting the prognosis of serious diseases. Conventional pathology diagnostic methods involve visual observation and interpretation of diagnostic pathology slides produced from specimens through an optical microscope by a pathologist. The dawn of digital pathology began with the use of a computer-connected microscope camera to convert pathology slides into digital images, which are then viewed and interpreted on a monitor. Recently, the advent of digital slide scanners has led to the widespread adoption of this method, which converts entire pathology slides into a single digital image, which is then viewed and interpreted on a computer monitor. Digital pathology-based pathology, which interprets scanned images on a monitor, is replacing the traditional method of visually examining specimen slides through an optical microscope.

[0004] Meanwhile, to diagnose serious diseases such as cancer, part or all of the tissue is collected, an image of the biological tissue is created, and histopathological examination is performed to determine the severity of the disease. There is an agreed-upon system for reporting the histological severity for each disease, and these systems grade and report the severity based on the morphological characteristics of the tissue. For example, in the case of prostate cancer, there is a grading system called the Gleason grading system, which classifies the tissue pattern into grades from 1 to 5 based on the morphological characteristics of the gland tissue, and grades the overall severity based on the proportion of each grade area in the entire tissue. In addition, breast cancer can be graded based on the histological grade.

[0005] Histopathological examination of tissue images can also be used to histologically classify lesions. For example, it can be used to distinguish between invasive and intraepithelial breast lesions, or between invasive and precancerous lung lesions (atypical adenomatous (glandular) hyperplasia).

[0006] Meanwhile, histological examinations are sometimes performed on multiple biopsy images from a single patient. For example, multiple cores are extracted from a prostate biopsy, each core is made into slides for histological analysis. In this case, multiple slides produced from multiple cores constitute a single pathological diagnostic case.

[0007] When explaining these diagnostic results to patients or sharing them with other pathologists, the results of annotating a representative tissue image with a severity grade, such as a Gleason pattern, can be utilized. An example of this is inserting a severity grade annotation on a specific tissue image representing the case into a report to a patient or specialist.

[0008] However, the whole slide image generated by the slide scanner needs to be scanned at a magnification of 200x or more for an accurate diagnosis, and the number of pixels in the image generated in this way reaches 2.4 billion when scanning a 2cm x 3cm area at 200x, and 9.6 billion when scanning at 400x. Therefore, it is difficult to directly use the biological tissue image due to its massive size, and a technology is needed to accurately extract a certain portion of the lesion area that can represent the case among the numerous biological tissue images included in the pathological diagnosis case.

[0009]

[0010] The technical problem to be achieved by the present invention is to provide a method for extracting a lesion area representing a pathological diagnosis case composed of a plurality of biological tissue images, and a computing system for performing the method.

[0011]

[0012] According to one aspect of the present invention, there is provided a method for generating a representative lesion image of a pathology diagnosis case including a plurality of biological tissue images, the method comprising: a step of: a computing system obtaining pathology diagnosis case data including the plurality of biological tissue images and pixel-wise diagnosis results of each of the plurality of biological tissue images, wherein the pixel-wise diagnosis results of each of the biological tissue images include a lesion pattern for each pixel constituting a corresponding biological tissue image, and the lesion pattern means a grade according to a predetermined severity grading system or a histological classification of a predetermined lesion; a step of: the computing system obtaining a primary lesion pattern and a secondary lesion pattern of the pathology diagnosis case; a step of: the computing system searching, for each of the plurality of biological tissue images included in the pathology diagnosis case, a first partial region, a second partial region, and a third partial region of the biological tissue image; And the computing system includes a step of selecting and outputting a representative lesion image representing the pathological diagnosis case from among the first partial region, the second partial region, and the third partial region of each of the plurality of biological tissue images, wherein the step of searching the first partial region, the second partial region, and the third partial region of the biological tissue image comprises: a step of searching, among the partial regions of the biological tissue image, the first partial region in which the pixel-wise diagnosis result corresponding to the corresponding region contains the largest number of the primary lesion pattern, wherein the partial region of the biological tissue image is a region that is a part of the biological tissue image and has a predefined shape and area; a step of searching, among the partial regions of the biological tissue image, the second partial region in which the pixel-wise diagnosis result corresponding to the corresponding region contains the largest number of the secondary lesion pattern; a step of the computing system generating a modified pixel-wise diagnosis result by removing the pixel-wise diagnosis result corresponding to the first partial region from the pixel-wise diagnosis result of the biological tissue image;And the computing system includes a step of searching for the third partial region, among the partial regions of the biological tissue image, in which the secondary lesion pattern is most included in the modified pixel-unit diagnosis result corresponding to the corresponding region, and the step of selecting and outputting a representative lesion image representing the pathological diagnosis case from among the first partial region, the second partial region, and the third partial region of each of the plurality of biological tissue images includes a step of the computing system selecting a first representative lesion image in which the primary lesion pattern is most included in the pixel-unit diagnosis corresponding to the corresponding region from among the first partial region of each of the plurality of biological tissue images and the second partial region of each of the plurality of biological tissue images; the step of the computing system selecting a second representative lesion image in which the secondary lesion pattern is most included in the pixel-unit diagnosis corresponding to the corresponding region from among the first partial region of each of the plurality of biological tissue images, the second partial region of each of the remaining biological tissue images excluding the biological tissue image including the first representative lesion image from among the plurality of biological tissue images, and the third partial region of the biological tissue image including the first representative lesion image; A method is provided, including a step of outputting the first representative lesion image and the second representative lesion image as representative lesion images representing the pathological diagnosis case.;

[0013] In one embodiment, the step of searching the first partial region may include a step of searching the first partial region in a sliding window manner in which a shape and an area of ​​a window are set to be the same as a partial region of the biological tissue image, the step of searching the second partial region may include a step of searching the second partial region in a sliding window manner in which a shape and an area of ​​a window are set to be the same as a partial region of the biological tissue image, and the step of searching the third partial region may include a step of searching the third partial region in a sliding window manner in which a shape and an area of ​​a window are set to be the same as a partial region of the biological tissue image.

[0014] In one embodiment, the step of outputting the first representative lesion image and the second representative lesion image as representative lesion images representing the pathological diagnosis case may include the step of overlapping and outputting a pixel-wise diagnosis result corresponding to the first representative lesion image on the first representative lesion image; and the step of overlapping and outputting a pixel-wise diagnosis result corresponding to the second representative lesion image on the second representative lesion image.

[0015] In one embodiment, the lesion pattern may be any one of a Gleason pattern according to the Gleason grading system for prostate cancer, a tumor grade according to the histologic grading system for breast cancer, a classification of invasive carcinoma lesions and intraepithelial carcinoma lesions of the breast, and a classification of invasive carcinoma lesions and precancerous lesions of the lung.

[0016] According to another aspect of the present invention, a computer program is provided, which is installed in a data processing device and recorded on a recording medium for performing the above-described method.

[0017] According to another aspect of the present invention, a computer-readable recording medium having recorded thereon a computer program for performing the above-described method is provided.

[0018] According to another aspect of the present invention, a computing system is provided, comprising: a processor; and a memory storing a computer program, wherein the computer program, when executed by the processor, causes the computing system to perform the above-described method.

[0019] According to another aspect of the present invention, there is provided a computing system for performing a method of generating a representative lesion image of a pathology diagnosis case including a plurality of biological tissue images, the computing system comprising: a first acquisition module for acquiring pathology diagnosis case data including the plurality of biological tissue images and pixel-wise diagnosis results of each of the plurality of biological tissue images, wherein the pixel-wise diagnosis results of each biological tissue image include a lesion pattern for each pixel constituting a corresponding biological tissue image, and the lesion pattern means a grade according to a predetermined severity grading system or a histological classification of a predetermined lesion; a second acquisition module for acquiring a first lesion pattern and a second lesion pattern of the pathology diagnosis case; a search module for searching a first partial region, a second partial region, and a third partial region of the biological tissue image, respectively, for each of the plurality of biological tissue images included in the pathology diagnosis case; And an output module for selecting and outputting a representative lesion image representing the pathological diagnosis case from among the first partial region, the second partial region, and the third partial region of each of the plurality of biological tissue images, wherein the search module comprises: a first partial region search module for searching, among the partial regions of the biological tissue image, the first partial region in which the pixel-wise diagnosis result corresponding to the corresponding region contains the largest number of the first lesion pattern; wherein the partial region of the biological tissue image is a region that is a part of the biological tissue image and has a predefined shape and area; a second partial region search module for searching, among the partial regions of the biological tissue image, the second partial region in which the pixel-wise diagnosis result corresponding to the corresponding region contains the largest number of the second lesion pattern; a modification module for generating a modified pixel-wise diagnosis result by removing the pixel-wise diagnosis result corresponding to the first partial region from the pixel-wise diagnosis result of the biological tissue image;And a third partial region search module that searches for a third partial region among the partial regions of the biological tissue image, in which the second lesion pattern is most included in the modified pixel unit diagnosis result corresponding to the corresponding region, and the output module includes a first representative lesion image selection module that selects a first representative lesion image in which the first lesion pattern is most included in the pixel unit diagnosis corresponding to the corresponding region from among the first partial region of each of the plurality of biological tissue images and the second partial region of each of the plurality of biological tissue images; a second representative lesion image selection module that selects a second representative lesion image in which the second lesion pattern is most included in the pixel unit diagnosis corresponding to the corresponding region from among the first partial region of each of the plurality of biological tissue images, the second partial region of each of the remaining biological tissue images excluding the biological tissue image including the first representative lesion image among the plurality of biological tissue images, and the third partial region of the biological tissue image including the first representative lesion image; And a computing system including a representative lesion image output module that outputs the first representative lesion image and the second representative lesion image as representative lesion images representing the pathological diagnosis case is provided.;

[0020] In one embodiment, the first partial region search module searches the first partial region in a sliding window manner in which the shape and area of ​​the window are set to be the same as the partial region of the biological tissue image, the second partial region search module searches the second partial region in a sliding window manner in which the shape and area of ​​the window are set to be the same as the partial region of the biological tissue image, and the third partial region search module searches the third partial region in a sliding window manner in which the shape and area of ​​the window are set to be the same as the partial region of the biological tissue image.

[0021] In one embodiment, the representative lesion image output module may output a pixel-wise diagnosis result corresponding to the first representative lesion image by overlapping the first representative lesion image, and may output a pixel-wise diagnosis result corresponding to the second representative lesion image by overlapping the second representative lesion image.

[0022]

[0023] According to the technical idea of ​​the present invention, a method for extracting a lesion region representative of a pathological diagnosis case including a plurality of biological tissue images and a computing system for performing the same can be provided. In particular, a method for detecting a portion of a biological tissue image in which a specific grade in a predetermined grading system for grading the severity of a disease such as cancer is most clearly expressed, or a portion of a lesion in which a histological classification is most clearly expressed, can be provided, and a computing system for performing the same can be provided.

[0024]

[0025] In order to more fully understand the drawings cited in the detailed description of the present invention, a brief description of each drawing is provided.

[0026] FIG. 1 is a drawing for explaining a schematic system configuration for implementing a method for generating a representative lesion image of a pathology diagnosis case according to an embodiment of the present invention.

[0027] FIG. 2 is a flowchart illustrating a method for generating a representative lesion image according to one embodiment of the present invention.

[0028] FIG. 3 is a drawing illustrating an example of step S120 of FIG. 2 in more detail.

[0029] Figure 4 is a diagram showing slide images corresponding to each of three biological tissues and the number of pixels for each Gleason pattern of each slide image.

[0030] FIG. 5 is a diagram illustrating in more detail a process in which a computing system according to one embodiment of the present invention searches for a first partial region, a second partial region, and a third partial region of a specific biological tissue image.

[0031] Figure 6 is a drawing illustrating an example of a biological tissue image and a partial region of the biological tissue image.

[0032] Figure 7 is a diagram illustrating an initial part of the process of searching the first sub-area using a sliding window method.

[0033] FIG. 8(a) illustrates an example of a first partial region searched by a computing system according to one embodiment of the present invention.

[0034] FIG. 8(b) illustrates an example of a second partial region searched by a computing system according to one embodiment of the present invention.

[0035] Figure 8(c) shows an example of the result of removing the pixel unit diagnosis result corresponding to the first partial area.

[0036] FIG. 8(d) illustrates an example of a third partial region searched by a computing system according to one embodiment of the present invention.

[0037] Figure 9 is a drawing illustrating step S150 of Figure 2 in more detail.

[0038] FIG. 10 is a diagram illustrating examples of the first partial region, the second partial region, and the third partial region searched in each of the biological tissue images, such as the example illustrated in FIG. 4.

[0039] Figure 11 is a drawing that illustrates the process of Figure 9 for easier understanding.

[0040] Figures 13 to 15 are block diagrams illustrating the logical configuration of a computing system according to one embodiment of the present invention.

[0041] FIG. 16 is a block diagram illustrating the physical configuration of a computing system according to one embodiment of the present invention.

[0042]

[0043] The present invention is susceptible to various modifications and embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, but rather to encompass all modifications, equivalents, and alternatives falling within the spirit and technical scope of the present invention. In describing the present invention, detailed descriptions of related known technologies will be omitted if they are deemed to obscure the gist of the present invention.

[0044] Terms such as "first," "second," etc. may be used to describe various components, but these components should not be limited by these terms. Terms such as "first," "second," etc. do not denote a particular order and are used solely to distinguish one component from another.

[0045] The terminology used in this application is solely for the purpose of describing specific embodiments and is not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0046] In this specification, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0047] Additionally, in the present specification, when a component "transmits" data to another component, it means that the component may transmit the data directly to the other component, or may transmit the data to the other component via at least one other component. Conversely, when a component "directly transmits" data to another component, it means that the data is transmitted from the component to the other component without going through the other component.

[0048] Hereinafter, the present invention will be described in detail, focusing on embodiments thereof, with reference to the attached drawings. The same reference numerals in each drawing represent the same components.

[0049] FIG. 1 is a drawing for explaining a schematic system configuration for implementing a representative lesion image generation method for a pathology diagnosis case according to an embodiment of the present invention (hereinafter referred to as “representative lesion image generation method”).

[0050] Referring to FIG. 1, a method for generating a representative lesion image according to the technical concept of the present invention can be performed by a computing system (100). The computing system (100) can select a lesion region representing a pathological diagnosis case including a plurality of biological tissue images and generate a representative lesion image of the pathological diagnosis case. The lesion region may be a portion of the biological tissue image. In this case, the lesion region may be a partial region of the biological tissue image having a predetermined shape and area.

[0051] A biological tissue image may be an image generated from a slide of a pathological specimen tissue stained using a predetermined staining method. The pathological specimen tissue may be a biopsy taken from various organs of the human body or a surgically excised biological tissue. In one embodiment, the pathological specimen tissue may be a biological tissue collected through a core needle biopsy. Meanwhile, the biological tissue image may be a digital slide image of a stained pathological specimen or a portion of a digital slide image. The pathological specimen slide may be a portion of a sliced ​​pathological specimen. The digital slide image of a pathological specimen may be generated by slicing a pathological specimen to produce a glass slide, staining the glass slide with a predetermined staining agent, and digitizing the glass slide.

[0052] A pathology diagnosis case may be composed of multiple slide images of biological tissues satisfying certain conditions. Typically, a pathology diagnosis case may be an image generated from each slide of multiple biological tissues collected from a single patient (e.g., tissue cores collected through biopsy). However, the technical concept of the present invention is not necessarily limited thereto. For example, a pathology diagnosis case may be composed of slide images of biological tissues generated from multiple biological tissues collected from a group of patients classified according to certain conditions (e.g., a group composed of multiple patients exhibiting the same symptoms).

[0053] In one embodiment, a computing system (100) may be installed on a predetermined server (10) to implement the technical idea of ​​the present invention. The server (10) refers to a data processing device having a computing capability for implementing the technical idea of ​​the present invention. Generally, a person skilled in the art will be able to easily infer that not only a data processing device that can be accessed by a client through a network, but also any device capable of performing a specific service, such as a personal computer or a mobile terminal, can be defined as a computing device.

[0054] According to one embodiment, the computing system (100) may need to directly determine a pixel-wise diagnosis result of a biological tissue image (e.g., a Gleason pattern for each pixel, etc.) or a severity grade of a biological tissue image (e.g., a Gleason score, etc.) or a histological classification of a biological tissue image (e.g., a histological grade of breast cancer, etc.). In this case, the computing system (100) may use a pre-trained deep learning model (200-1, 200-2). The deep learning model (200-1, 200-2) may be an artificial neural network that receives a biological tissue image or a patch obtained by dividing a biological tissue image into a certain size as input, and outputs a result value for determining a pixel-wise diagnosis result of the input image or a severity grade or histological classification of the input image itself (e.g., a probability corresponding to each Gleason pattern, a probability corresponding to each severity grade, etc.).

[0055] The above deep learning model (200-1, 200-2) is a neural network artificially constructed based on the operating principles of human neurons, includes a multilayer perceptron model, and may refer to a set of information expressing a series of design specifications defining an artificial neural network. The above deep learning model (200-1, 200-2) may include, but is not limited to, a convolutional neural network (CNN) widely known in the fields of artificial intelligence, machine learning, or deep learning.

[0056] The server (10) including the computing system (100) may be a system that stores or applies the results (i.e., the generated representative lesion image) output by the computing system (100). For example, the server (10) may be a system for generating a digital document including the representative lesion image of the pathology diagnosis case generated by the computing system (100), or a diagnostic assistance system for providing information necessary for a doctor to diagnose a disease, but is not limited thereto. The deep learning model (200-1, 200-2) and the computing system (100) may be provided in one physical device, i.e., the server (10), but may be provided in different physical devices depending on the embodiment, and various modifications may be possible as needed, as an average expert in the technical field of the present invention will be able to easily infer.

[0057] In one embodiment, the server (10) and / or the computing system (100) may communicate with a user terminal (20). For example, the user terminal (20) may transmit a biological tissue image to the computing system (100) and may also receive a result generated from the computing system (100).

[0058] Meanwhile, in FIG. 1, an example is shown in which the computing system (100) is implemented in the form of a subsystem installed in a server (10), but it is obvious that, depending on the embodiment, the computing system (100) may be implemented as an independent single system. In this case, the computing system (100) may be a computing system that is a data processing device having a computing capability for implementing the technical idea of ​​the present invention, and may generally include not only a server that is a data processing device that can be accessed by a client through a network, but also a computing device such as a personal computer or a mobile terminal.

[0059] FIG. 2 is a flowchart illustrating a method for generating a representative lesion image according to one embodiment of the present invention.

[0060] The computing system can obtain pathology diagnosis case data (S110). At this time, the pathology diagnosis case data can include a plurality of biological tissue images and pixel-level diagnostic results of each of the plurality of biological tissue images.

[0061] More specifically, the computing system (100) can acquire a biological tissue image constituting a pathology diagnosis case (S111). The biological tissue image may be a full slide image or a part of a full slide image created by digitally scanning a slide of biological tissue collected through a biopsy or surgery. In one embodiment, the computing system (100) may receive a biological tissue image from the user terminal (20), or acquire multiple biological tissue images from a database or storage device provided by the server (10) or the computing system (100). The sizes of the biological tissue images constituting a pathology diagnosis case may be the same.

[0062] Meanwhile, the computing system (100) can obtain pixel-wise diagnostic results of each of the plurality of biological tissue images (S111). At this time, the pixel-wise diagnostic results of the biological tissue images can include a lesion pattern for each pixel constituting the biological tissue image.

[0063] In this specification, a lesion pattern may mean a grade according to a severity grading system of a given disease, such as cancer, or may mean a histological classification of a given lesion.

[0064] For example, the lesion pattern may be a Gleason pattern according to the Gleason grading system for prostate cancer. The Gleason pattern is a representative grading system indicating the severity of prostate cancer tissue, and is classified into a benign or a pattern of 1 to 5 depending on the histological differentiation. A classification of 1 indicates differentiation close to normal and low malignancy, whereas a score of 5 indicates cancer with the most severe malignancy. The Gleason pattern used in the present invention can be divided into a severity grade of 1 to 5 indicating prostate cancer and a benign grade for each pixel, but in some cases, it can be divided into a grade of 3 to 5 and a benign grade.

[0065] Another example of a lesion pattern is the tumor grade according to the histologic grading system for breast cancer. In addition to grades indicating severity, such as the Gleason pattern or histologic grade of breast cancer, as mentioned above, a lesion pattern can also refer to a histologic classification of a given lesion, such as the classification of invasive versus non-invasive lesions in the breast, or invasive versus precancerous lesions (atypical adenomatous hyperplasia) in the lung.

[0066] The pixel-wise diagnosis result of the biological tissue image may be in the form of a two-dimensional array of the same size as the biological tissue image. For example, if the biological tissue image has a size of W pixels × H pixels, the pixel-wise diagnosis result of the biological tissue image may be a two-dimensional array of W × H, and each element of the array may be assigned a pixel-wise diagnosis result of the pixel corresponding to that element.

[0067] For example, if the lesion pattern is a Gleason pattern, each element of the array may be assigned a value indicating the corresponding Gleason pattern if the pixel corresponding to the element corresponds to Gleason pattern 1 to 5, and a value indicating positivity (e.g., 0) may be assigned otherwise.

[0068] In an embodiment where the lesion pattern is a histological classification of a breast lesion, i.e., a classification of an invasive lesion and an intraepithelial carcinoma lesion, each element of the array may be assigned a value corresponding to the classification (e.g., 1) if the pixel corresponding to the element is classified as an invasive lesion, a value corresponding to the classification (e.g., 2) if the pixel is classified as an intraepithelial carcinoma, and a value indicating positivity (e.g., 0) otherwise.

[0069] However, depending on the embodiment, each element of the array may be implemented such that if the pixel corresponding to the element does not belong to the tissue region, a value indicating that it is not a tissue region is assigned, and if it belongs to the tissue region, a pixel-by-pixel diagnostic result of the pixel corresponding to the element is assigned. For example, each element of the array may be assigned -1 if the pixel corresponding to the element belongs to the non-tissue region, 0 if it is benign, and otherwise a value corresponding to the lesion pattern.

[0070] For convenience of explanation, below, an embodiment is described in which the same positive value (e.g., 0) is assigned to both cases in which a pixel belongs to a non-organized area and cases in which it is positive.

[0071] In one embodiment, the pixel-by-pixel diagnostic results of the biological tissue image may be input into the computing system together with the biological tissue image as a result of manual annotation by a pathologist.

[0072] According to an embodiment, the computing system (100) may analyze the biological tissue image to directly obtain a pixel-wise diagnosis result of the biological tissue image. In this case, the computing system (100) may obtain a pixel-wise diagnosis result of the biological tissue image using a pre-trained deep learning model (200-1). More specifically, the computing system (100) may input each of the biological tissue images or patches divided into a grid shape into an input layer of the deep learning model (200-1) and determine a lesion pattern for each pixel of the biological tissue image based on an output value output from an output layer of the deep learning model (200-1). In this case, the deep learning model (200-1) may be an artificial neural network that has been trained in advance to determine a pixel-wise lesion pattern of an input image, and may be an artificial neural network that has been trained in advance to receive an image through an input layer and output a probability that each pixel included in the input image corresponds to each lesion pattern.

[0073] The computing system (100) can acquire the primary lesion pattern and the secondary lesion pattern of the pathological diagnosis case (S120). The primary lesion pattern and the secondary lesion pattern of the pathological diagnosis case are lesion patterns of the same type as the lesion pattern for each pixel included in the pixel-by-pixel diagnosis result of the biological tissue image.

[0074] For example, if the pixel-wise diagnosis result of each biological tissue image included in the above pathology diagnosis case is composed of a Gleason pattern for each pixel, the computing system (100) can obtain the Gleason score of the pathology diagnosis case, and the Gleason score is composed of a primary Gleason pattern and a secondary Gleason pattern. The primary Gleason pattern and the secondary Gleason pattern may be classified into grades 1 to 5 and benign, or grades 3 to 5 and benign, depending on the embodiment. A Gleason score in which the primary Gleason pattern is a and the secondary Gleason pattern is b is typically expressed as 'a+b'. For example, if the Gleason score is expressed as 3+4, this indicates that the primary Gleason pattern is 3 and the secondary Gleason pattern is 4. In some cases, a and b may be the same value.

[0075] In one embodiment, the computing system (100) can calculate the ratio of each lesion pattern in all biological tissue images constituting a pathology diagnosis case and determine the primary lesion pattern and the secondary lesion pattern of the pathology diagnosis case based on the calculated ratio.

[0076] More specifically, the computing system (100) counts the number of pixels for each lesion pattern from the pixel-by-pixel diagnosis results of each biological tissue image constituting the pathology diagnosis case, and adds the number of pixels for each lesion pattern for all biological tissue images, thereby calculating the ratio of each lesion pattern in all biological tissue images constituting the pathology diagnosis case. An example of the process is illustrated in FIG. 3.

[0077] Referring to FIG. 3, the computing system (100) calculates, for each of the first to Nth biological tissue images constituting a pathology diagnosis case (where N is the number of biological tissue images included in the pathology diagnosis case), the number C of each lesion pattern (in the example of FIG. 3, the number of lesion patterns is a natural number M greater than 2) included in the corresponding biological tissue image. i,j can be produced (S121, S122). It is obvious that which lesion pattern each pixel of the biological tissue image corresponds to can be determined through the pixel-by-pixel diagnosis result of the biological tissue image. Meanwhile, the computing system (100) adds up the number of pixels of the corresponding lesion pattern included in the first biological tissue image to the Nth biological tissue image for each lesion pattern, and calculates the total number of pixels (T1 to T) in the pathological diagnosis case corresponding to the corresponding lesion pattern for each lesion pattern. M ) can be produced (S123, S124).

[0078] Afterwards, the computing system (100) calculates the total number of pixels (T1 to T) for each lesion pattern in the pathology diagnosis case. M ) can determine the primary lesion pattern and secondary lesion pattern of the pathological diagnosis case (S125). For example, the computing system (100) can determine the lesion pattern with the largest total number of pixels within the case as the primary lesion pattern, and the lesion pattern with the next largest total number of pixels as the secondary lesion pattern.

[0079] FIG. 4 is a diagram showing slide images corresponding to three biological tissues A, B, and C, respectively (each slide image is annotated with a Gleason pattern in a different color) and the number of pixels for each Gleason pattern in each slide image. In the entire case of FIG. 4, a total of 35 (= 20 + 15) pixels are counted for Gleason pattern 3, a total of 80 (= 35 + 40 + 5) pixels are counted for Gleason pattern 4, and a total of 0 pixels are counted for Gleason pattern 5, so the computing system (100) can determine Gleason pattern 4 as the primary lesion pattern and Gleason pattern 3 as the secondary lesion pattern.

[0080] Meanwhile, in another embodiment, the computing system (100) may obtain the primary lesion pattern and the secondary lesion pattern of the biological tissue image that are stored in advance in a storage device provided by the computing system (100) or the server, or may obtain the primary lesion pattern and the secondary lesion pattern of the biological tissue image from the user terminal (20).

[0081] Or, according to an embodiment, the computing system (100) may analyze the biological tissue image or the pixel-wise diagnosis result of the biological tissue image to obtain the primary lesion pattern and the secondary lesion pattern of the biological tissue image. At this time, the computing system (100) may use a pre-trained deep learning model (200-2). The deep learning model (200-2) may be an artificial neural network that is pre-trained to receive an input image or a pixel-wise diagnosis result of an image and determine the primary lesion pattern and the secondary lesion pattern of the corresponding image, and may be an artificial neural network that is pre-trained to receive an image or a pixel-wise diagnosis result of an image through an input layer and output a probability that the corresponding image corresponds to a predetermined lesion pattern.

[0082] Referring again to FIG. 2, the computing system (100) can search for a first partial region, a second partial region, and a third partial region of each of the plurality of biological tissue images included in the pathology diagnosis case (S130, S140).

[0083] FIG. 5 is a drawing illustrating in more detail the process (i.e., step S140) in which the computing system (100) searches for a first partial region, a second partial region, and a third partial region of a specific biological tissue image in one embodiment of the present invention.

[0084] Referring to FIG. 5, the computing system (100) can search for a first partial region among the partial regions of the biological tissue image, in which the primary lesion pattern is most frequently included in the pixel-unit diagnostic results corresponding to the corresponding region (S141). At this time, the partial region of the biological tissue image may be a region having a predefined shape and area as a part of the biological tissue image. In other words, the shape and area of ​​the partial region may be preset within the computing system (100).

[0085] Fig. 6 is a diagram illustrating an example of a biological tissue image and a partial region of the biological tissue image. The partial region (2) of the biological tissue image (1) may be any part of the biological tissue image (1). In the example of Fig. 3, the partial region (2) is a rectangular region having a predetermined size of w pixels × h pixels (w is a natural number such that w < W, and h is a natural number such that h < H).

[0086] Referring back to FIG. 5, the computing system (100) can search the first partial region in a sliding window manner in which the shape and area of ​​the window are set to be the same as the partial region of the biological tissue image. For example, if the size of the partial region is set as in FIG. 6, the window can also be a rectangular shape having a size of w pixels × h pixels. In this case, the computing system (100) can calculate the number of pixels in the corresponding window having the primary lesion pattern by moving the rectangular window having the size of w × h by a predetermined sliding step (one or more pixels), and can determine the window that contains the largest number of the primary lesion patterns as the first partial region.

[0087] The computing system (100) can search for a second partial region among the partial regions of the biological tissue image, in which the pixel-by-pixel diagnostic results corresponding to the corresponding region contain the largest number of the secondary lesion patterns (S142). It goes without saying that the sliding window method can also be used in the process in which the computing system (100) searches for the second partial region.

[0088] Thereafter, the computing system (100) can generate a modified pixel unit diagnosis result by removing the pixel unit diagnosis result corresponding to the first partial region from the pixel unit diagnosis result of the biological tissue image (S143).

[0089] Thereafter, the computing system (100) can search for a third partial region among the partial regions of the biological tissue image, in which the second lesion pattern is most frequently included in the modified pixel-unit diagnostic results corresponding to the corresponding region (S144). It goes without saying that the sliding window method can also be used in the process in which the computing system (100) searches for the second partial region.

[0090] FIG. 7 is a diagram illustrating an initial part of a process for searching a first partial region using a sliding window method. FIG. 7 illustrates a pixel-by-pixel diagnosis result and a window (bold box) for each pixel of a biological tissue image. Meanwhile, FIG. 7 exemplifies a case where the lesion pattern is a Gleason pattern. In the example of FIG. 7, the computing system (100) scans the pixel-by-pixel diagnosis result for each pixel, which is classified into Gleason patterns 3 to 5 and benign (indicated as 0), in a 6×4 window. At this time, the computing system (100) can calculate the number of primary Gleason patterns within the window by moving the window one pixel at a time. FIG. 7 illustrates only an initial part of this process. In FIG. 7 (a), (b), and (c), a 6×4 window moved one pixel at a time is indicated by a bold box. If the scan of one line is completed, the computing system (100) will calculate the number of primary Gleason patterns within the window by moving one pixel at a time from the beginning of the next line.

[0091] Fig. 8(a) illustrates an example of a first partial region searched by the computing system (100). If the first Gleason pattern is 4, and the computing system searches the first partial region as described with reference to Fig. 7, the computing system (100) will determine that the region on the biological tissue image corresponding to the region (3-1) of Fig. 8(a) containing the largest number of the first Gleason pattern (i.e., pattern 4) is the first partial region (step S141 of Fig. 5).

[0092] Fig. 8(b) illustrates an example of a second partial region searched by the computing system (100). If the second Gleason pattern is 3, and the computing system searches the second partial region as described with reference to Fig. 7, the computing system (100) will determine that the region on the biological tissue image corresponding to the region (3-2) of Fig. 8(b) containing the largest number of second Gleason patterns (i.e., pattern 3) is the second partial region (step S142 of Fig. 5).

[0093] Thereafter, the computing system (100) can generate a modified pixel-by-pixel diagnosis result as shown in FIG. 8(c) by removing the pixel-by-pixel diagnosis result corresponding to the first partial region from the pixel-by-pixel diagnosis result of the biological tissue image (S143 of FIG. 5). FIG. 8 illustrates an example of assigning 0, indicating positive, to the region in order to remove the pixel-by-pixel diagnosis result corresponding to the first partial region. However, depending on the embodiment, a value indicating non-tissue or a third value indicating that the region is a deleted region may be assigned to the region.

[0094] Thereafter, the computing system (100) can sequentially scan the modified pixel-by-pixel diagnostic results, such as those in FIG. 8(c), in a 6×4 sized window to search for the third partial region containing the largest number of secondary Gleason patterns. Since the secondary Gleason pattern is 3, the computing system (100) will determine that the region on the biological tissue image corresponding to the region (3-3) in FIG. 5(d) is the third partial region (step S144 in FIG. 2).

[0095] Those skilled in the art will readily understand that the above description with reference to FIGS. 7 and 8 can be applied almost similarly to cases where the lesion pattern is not a Gleason pattern.

[0096] Referring again to FIG. 2, the computing system (100) can select and output a representative lesion image representing a pathological diagnosis case from among the first partial region, the second partial region, and the third partial region of each of the plurality of biological tissue images searched through the preceding process (S150).

[0097] Figure 9 is a drawing illustrating step S150 of Figure 2 in more detail.

[0098] Referring to FIG. 9, the computing system (100) can select a partial region in which the primary lesion pattern is most included in the pixel unit diagnosis corresponding to the corresponding region among the first partial region of each of the plurality of biological tissue images and the second partial region of each of the plurality of biological tissue images as a first representative lesion image (S151).

[0099] In addition, the computing system (100) can select a second representative lesion image that includes the second lesion pattern most in the pixel unit diagnosis corresponding to the corresponding area among the first partial area of ​​each of the plurality of biological tissue images, the second partial area of ​​each of the remaining biological tissue images excluding the biological tissue image including the first representative lesion image among the plurality of biological tissue images, and the third partial area of ​​the biological tissue image including the first representative lesion image (S152).

[0100] FIG. 10 is a diagram showing examples of a first partial region, a second partial region, and a third partial region searched in each of the biological tissue images, such as the example illustrated in FIG. 4. In FIG. 10(a), P_A1, P_B1, and P_C1 represent first partial images searched in biological tissue images A, B, and C, respectively, in FIG. 9(b), S1_A1, and S1_C1 represent second partial images searched in biological tissue images A, C, respectively, and in FIG. 9(c), S2_A1, and S2_C1 represent third partial images searched in biological tissue images A, C, respectively.

[0101] An example of the process of FIG. 9 is explained with reference to FIG. 10 as follows.

[0102] As illustrated in FIG. 10, when the first partial region, the second partial region, and the third partial region of each biological tissue image are searched, the computing system (100) can select P_A1, which is the partial region that contains the most of the first lesion pattern (i.e., pattern 4) in the pixel unit diagnosis corresponding to the corresponding region among P_A1, P_B1, P_C1 of FIG. 9(a) and S1_A1, S1_C1 of FIG. 9(b), as the first representative lesion image (S151).

[0103] In addition, the computing system (100) may select, as a first representative lesion image, a second partial region (S1_C1) of each of the plurality of biological tissue images, excluding the biological tissue image (i.e., biological tissue image A) including the first representative lesion image (P_A1) among the plurality of biological tissue images, and a third partial region (S2_A1) of the biological tissue image (i.e., biological tissue image A) including the first representative lesion image (P_A1), a partial region S2_A1 that includes the second lesion pattern (i.e., pattern 3) in the pixel unit diagnosis corresponding to the corresponding region (S152).

[0104] A diagram illustrating the above process to make it easier to understand is Fig. 11. Fig. 11(a) shows candidates for the first representative lesion image (i.e., P_A1, P_B1, P_C1, S1_A1, S1_C1) and that P_A1 was selected as the first representative lesion image. Fig. 11(b) shows candidates for the second representative lesion image (i.e., P_A1, P_B1, P_C1, S2_A1, S1_C1) and that S2_A1 was selected as the second representative lesion image.

[0105] Referring again to FIG. 9, the computing system (100) can output the first representative lesion image and the second representative lesion image selected through the preceding process as representative lesion images representing the pathological diagnosis case (S153).

[0106] The computing system (100) may output the first representative lesion image and the second representative lesion image in the form of separate image files and store them in a storage device provided by the computing system (100) or the server (10) or transmit them to an external device (e.g., the user terminal (20)). Alternatively, the computing system may output information that can identify the first representative lesion image and the second representative lesion image (e.g., coordinates and sizes of reference points on a biological tissue image, etc.).

[0107] In one embodiment, the computing system (100) can output a pixel-by-pixel diagnostic result corresponding to the first representative lesion image by overlapping the first representative lesion image.

[0108] For example, the computing system (100) can display the pixel-by-pixel diagnosis result of each pixel in a specific color and overlap it with the first representative lesion image of the biological tissue image. For example, the computing system (100) can set a certain level of transparency to an image in which the pixel-by-pixel diagnosis result is yellow if it is Gleason pattern 3, orange if it is Gleason pattern 4, and red if it is Gleason pattern 5, and overlap it with the first representative lesion image and / or the second representative lesion image. Fig. 12a illustrates an example of a biological tissue image in which a pixel-by-pixel diagnosis result is overlapped, and Fig. 12b illustrates an enlarged result (4) in which the pixel-by-pixel diagnosis result is overlapped with the first representative lesion image searched in Fig. 12a.

[0109] Meanwhile, the computing system (100) can, of course, output the pixel-by-pixel diagnostic results corresponding to the second partial area by overlapping them with the second representative lesion image.

[0110] Figures 13 to 15 are block diagrams illustrating the logical configuration of a computing system (100) according to one embodiment of the present invention.

[0111] The computing system (100) may refer to a logical configuration equipped with hardware resources and / or software necessary to implement the technical idea of ​​the present invention, and does not necessarily refer to a single physical component or device. That is, the computing system (100) may refer to a logical combination of hardware and / or software provided to implement the technical idea of ​​the present invention, and, if necessary, may be implemented as a set of logical configurations for implementing the technical idea of ​​the present invention by being installed in devices spaced apart from each other and performing their respective functions. In addition, the computing system (100) may refer to a set of configurations that are separately implemented for each function or role for implementing the technical idea of ​​the present invention. Each configuration of the computing system (100) may be located on different physical devices or may be located on the same physical device. In addition, depending on the implementation example, the combination of software and / or hardware constituting each component of the computing system (100) may also be located on different physical devices, and the configurations located on different physical devices may be organically combined with each other to implement each of the modules.

[0112] Furthermore, the term "module" in this specification may refer to a functional and structural combination of hardware for implementing the technical concepts of the present invention and software for operating the hardware. For example, the module may refer to a logical unit of a given code and hardware resources for executing the given code, and it is readily apparent to an average expert in the technical field of the present invention that it does not necessarily refer to physically connected code or a single type of hardware.

[0113] Referring to FIG. 13, the computing system (100) may include a first acquisition module (110), a second acquisition module (120), a search module (130), and an output module (140). Depending on the embodiment of the present invention, some of the above-described components may not necessarily correspond to components essential to the implementation of the present invention, and, of course, depending on the embodiment, the computing system (100) may include more components than this. For example, the computing system (100) may further include a communication module (not shown) for communicating with an external device, a storage module (not shown) for storing data, a control module (not shown) for controlling components and resources of the computing system (100), etc.

[0114] The first acquisition module (110) can acquire pathology diagnosis case data including a plurality of biological tissue images constituting a pathology diagnosis case and pixel-wise diagnosis results of each of the plurality of biological tissue images. The biological tissue images may be slide images of biological tissue collected through a biopsy, and the pixel-wise diagnosis results of the biological tissue images may include a lesion pattern for each pixel constituting the biological tissue image.

[0115] The above second acquisition module (120) can acquire the primary lesion pattern and the secondary lesion pattern of the above pathological diagnosis case.

[0116] The above search module (130) can search the first partial region, the second partial region, and the third partial region of each of the plurality of biological tissue images included in the pathology diagnosis case, and the output module (140) can select and output a representative lesion image representing the pathology diagnosis case from among the first partial region, the second partial region, and the third partial region of each of the plurality of biological tissue images.

[0117] Figure 14 is a block diagram showing a specific configuration of a search module (130) according to one embodiment of the present invention.

[0118] Referring to FIG. 14, the search module (130) may include a first partial area search module (131), a second partial area search module (132), a modification module (133), and a third partial area search module (134).

[0119] The first partial region search module (131) can search for the first partial region among the partial regions of the biological tissue image, in which the first lesion pattern is most frequently included in the pixel-unit diagnosis results corresponding to the corresponding region. At this time, the partial region of the biological tissue image is a region that is a part of the biological tissue image and has a predefined shape and area.

[0120] In one embodiment, the first partial region search module (131) can search the first partial region in a sliding window manner in which the shape and area of ​​the window are set to be the same as the partial region of the biological tissue image.

[0121] The second partial region search module (132) can search for the second partial region among the partial regions of the biological tissue image, in which the second lesion pattern is most frequently included in the pixel-unit diagnosis results corresponding to the corresponding region. At this time, the partial region of the biological tissue image is a region that is a part of the biological tissue image and has a predefined shape and area.

[0122] In one embodiment, the second partial region search module (132) can search the second partial region in a sliding window manner in which the shape and area of ​​the window are set to be the same as the partial region of the biological tissue image.

[0123] The above correction module (133) can generate a corrected pixel unit diagnosis result by removing the pixel unit diagnosis result corresponding to the first partial region from the pixel unit diagnosis result of the biological tissue image.

[0124] The third partial region search module (134) can search for a third partial region among the partial regions of the biological tissue image, in which the second lesion pattern is most included in the modified pixel unit diagnosis result corresponding to the corresponding region.

[0125] In one embodiment, the third partial region search module (134) can search the third partial region in a sliding window manner in which the shape and area of ​​the window are set to be the same as the partial region of the biological tissue image.

[0126] Figure 15 is a block diagram showing a specific configuration of an output module (140) according to one embodiment of the present invention.

[0127] Referring to FIG. 15, the output module (140) may include a first representative lesion image selection module (141), a second representative lesion image selection module (142), and a representative lesion image output module (143).

[0128] The first representative lesion image selection module (141) can select a first representative lesion image that includes the most first lesion patterns in the pixel unit diagnosis corresponding to the corresponding region among the first partial region of each of the plurality of biological tissue images and the second partial region of each of the plurality of biological tissue images.

[0129] The second representative lesion image selection module (142) can select a second representative lesion image that includes the second lesion pattern most frequently in a pixel-unit diagnosis corresponding to the corresponding area among the first partial area of ​​each of the plurality of biological tissue images, the second partial area of ​​each of the remaining biological tissue images excluding the biological tissue image including the first representative lesion image among the plurality of biological tissue images, and the third partial area of ​​the biological tissue image including the first representative lesion image.

[0130] The representative lesion image output module (143) above can output the first representative lesion image and the second representative lesion image as representative lesion images representing the pathological diagnosis case. For example, the representative lesion image output module (143) can output the first representative lesion image and the second representative lesion image to a predetermined storage device or output device (e.g., a display device) connected to the computing system (100) or to a predetermined external device (e.g., the user terminal (20)) connected via a network.

[0131] In one embodiment, the representative lesion image output module (143) may output a pixel-wise diagnosis result corresponding to the first representative lesion image by overlapping the first representative lesion image, and may output a pixel-wise diagnosis result corresponding to the second representative lesion image by overlapping the second representative lesion image.

[0132] Meanwhile, the above-described content describes the process of extracting a representative lesion image corresponding to the primary lesion pattern (i.e., the primary representative lesion image) and a representative lesion image corresponding to the secondary lesion pattern (i.e., the secondary representative lesion image), but the lesion image extraction method according to the technical idea of ​​the present invention can of course also be applied to a method of extracting three or more representative lesion images.

[0133] Meanwhile, depending on the implementation example, the computing system (100) may include a processor and a memory that stores a program executed by the processor. In this case, the computing system (100) may have a configuration as illustrated in FIG. 16. FIG. 16 is a diagram illustrating a schematic configuration of a computing system (100) according to an embodiment of the present invention.

[0134] The above computing system (100) may be equipped with a memory (102) in which a program for implementing the technical idea of ​​the present invention is stored, and a processor (101) for executing the program stored in the memory (102).

[0135] An average expert in the technical field of the present invention will be able to easily infer that the processor (101) may be named by various names such as CPU, APU, mobile processor, etc., depending on the implementation example of the computing system (100). The processor may include a single-core CPU or a multi-core CPU. In addition, the computing system (100) may be implemented by organically combining a plurality of physical devices, and in this case, an average expert in the technical field of the present invention will be able to easily infer that the computing system (100) of the present invention may be implemented by providing at least one processor (101) for each physical device.

[0136] The above memory (102) stores the program and may be implemented as any type of storage device that the processor can access to run the program. The memory (102) may include a high-speed random access memory and may also include non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to the memory by the processor and other components may be controlled by a memory controller. In addition, depending on the hardware implementation example, the memory (102) may be implemented as a plurality of storage devices rather than a single storage device. In addition, the memory (102) may include a temporary storage device as well as a main memory device. In addition, it may be implemented as a volatile memory or a non-volatile memory, and may be defined to mean all types of information storage means that are implemented so that the program can be stored and run by the processor.

[0137] The above program, when executed by the processor (101), can cause the computing system (100) to perform the representative lesion image generation method described above.

[0138] Meanwhile, the method according to an embodiment of the present invention may be implemented in the form of computer-readable program commands and stored on a computer-readable recording medium, and the control program and target program according to an embodiment of the present invention may also be stored on a computer-readable recording medium. A computer-readable recording medium includes all types of recording devices that store data that can be read by a computer system.

[0139] The program commands recorded on the recording medium may be specially designed and configured for the present invention or may be known and available to those skilled in the software field.

[0140] Examples of computer-readable storage media include magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Additionally, the computer-readable storage media can be distributed over network-connected computer systems so that the computer-readable code can be stored and executed in a distributed manner.

[0141] Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a device that processes information electronically, such as a computer, using an interpreter.

[0142] The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

[0143] The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will readily appreciate that the present invention can be readily modified into other specific forms without altering the technical spirit or essential characteristics of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single entity may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined manner.

[0144] The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

[0145]

[0146] The present invention can be used in a method for generating a representative lesion image of a pathological diagnosis case and a computing system for performing the same.

Claims

1. A method for generating a representative lesion image of a pathological diagnosis case including multiple biological tissue images, A step of a computing system acquiring pathological diagnosis case data including the plurality of biological tissue images and pixel-wise diagnosis results of each of the plurality of biological tissue images, wherein the pixel-wise diagnosis results of each biological tissue image include a lesion pattern for each pixel constituting a corresponding biological tissue image, and the lesion pattern means a grade according to a predetermined severity grading system or a histological classification of a predetermined lesion; A step in which the computing system acquires a primary lesion pattern and a secondary lesion pattern of the pathological diagnosis case; The computing system searches for a first partial region, a second partial region, and a third partial region of each of the plurality of biological tissue images included in the pathology diagnosis case; and The computing system includes a step of selecting and outputting a representative lesion image representing the pathological diagnosis case from among the first partial region, the second partial region, and the third partial region of each of the plurality of biological tissue images, The step of exploring the first part region, the second part region, and the third part region of the above biological tissue image is: A step of searching for the first partial region among the partial regions of the biological tissue image, wherein the first partial region includes the most primary lesion patterns in the pixel-unit diagnosis results corresponding to the corresponding region, wherein the partial region of the biological tissue image is a region that is a part of the biological tissue image and has a predefined shape and area; A step of searching for the second partial region among the partial regions of the above biological tissue image, in which the pixel unit diagnosis result corresponding to the region contains the most of the secondary lesion pattern; The computing system generates a modified pixel-by-pixel diagnosis result by removing the pixel-by-pixel diagnosis result corresponding to the first partial region from the pixel-by-pixel diagnosis result of the biological tissue image; and The computing system includes a step of searching for a third partial region among the partial regions of the biological tissue image, wherein the second lesion pattern is most frequently included in the modified pixel unit diagnosis result corresponding to the corresponding region, The step of selecting and outputting a representative lesion image representing the pathological diagnosis case from among the first, second, and third partial regions of each of the plurality of biological tissue images is as follows: A step in which the computing system selects a first representative lesion image that includes the most first lesion patterns in pixel unit diagnosis corresponding to the corresponding region among the first partial region of each of the plurality of biological tissue images and the second partial region of each of the plurality of biological tissue images; The computing system selects a second representative lesion image that includes the second lesion pattern most frequently in a pixel-unit diagnosis corresponding to the corresponding area from among a first partial area of each of the plurality of biological tissue images, a second partial area of each of the remaining biological tissue images excluding the biological tissue image including the first representative lesion image among the plurality of biological tissue images, and a third partial area of the biological tissue image including the first representative lesion image; and A method comprising a step of outputting the first representative lesion image and the second representative lesion image as representative lesion images representing the pathological diagnosis case.

2. In paragraph 1, The step of exploring the above first part area is: A step of searching the first partial region using a sliding window method in which the shape and area of the window are set to be the same as the partial region of the biological tissue image, The step of exploring the above second part area is: A step of searching the second partial region in a sliding window manner in which the shape and area of the window are set to be the same as the partial region of the biological tissue image, The step of exploring the above third part area is: A method comprising a step of searching the third partial region in a sliding window manner in which the shape and area of the window are set to be the same as the partial region of the biological tissue image.

3. In paragraph 1, The step of outputting the first representative lesion image and the second representative lesion image as representative lesion images representing the pathological diagnosis case is as follows: A step of overlapping and outputting a pixel-level diagnosis result corresponding to the first representative lesion image on the first representative lesion image; and A method comprising a step of overlapping and outputting a pixel-by-pixel diagnosis result corresponding to the second representative lesion image on the second representative lesion image.

4. In paragraph 1, The above lesion pattern is, Gleason pattern according to the Gleason grading system for prostate cancer, Tumor grade according to the histologic grading system for breast cancer, Classification of invasive breast carcinoma and intraepithelial carcinoma lesions, and One of the methods for classifying invasive lesions and precancerous lesions of the lung.

5. A computer program recorded on a recording medium installed in a data processing device and for performing the method described in any one of claims 1 to 4.

6. A computer-readable recording medium having recorded thereon a computer program for performing the method described in any one of paragraphs 1 to 4.

7. As a computing system, a processor; and a memory for storing a computer program, The above computer program, A computing system that, when executed by the processor, causes the computing system to perform the method described in any one of claims 1 to 4.

8. A computing system that performs a method for generating a representative lesion image of a pathological diagnosis case including multiple biological tissue images, A first acquisition module for acquiring pathological diagnosis case data including the plurality of biological tissue images and pixel-wise diagnosis results of each of the plurality of biological tissue images, wherein the pixel-wise diagnosis results of each biological tissue image include a lesion pattern for each pixel constituting a corresponding biological tissue image, and the lesion pattern means a grade according to a predetermined severity grading system or a histological classification of a predetermined lesion; A second acquisition module for acquiring the primary lesion pattern and the secondary lesion pattern of the above pathological diagnosis case; For each of the plurality of biological tissue images included in the above pathology diagnosis case, a search module that searches for a first partial region, a second partial region, and a third partial region of the biological tissue image; and The computing system includes an output module that selects and outputs a representative lesion image representing the pathological diagnosis case from among the first partial region, the second partial region, and the third partial region of each of the plurality of biological tissue images. The above search module, A first partial region search module that searches for the first partial region among the partial regions of the biological tissue image, wherein the first lesion pattern is most frequently included in the pixel-unit diagnosis results corresponding to the corresponding region, wherein the partial region of the biological tissue image is a region that is a part of the biological tissue image and has a predefined shape and area; A second partial region search module that searches for the second partial region among the partial regions of the above biological tissue image, wherein the pixel unit diagnosis result corresponding to the region contains the most of the second lesion pattern; A modification module that generates a modified pixel-by-pixel diagnosis result by removing the pixel-by-pixel diagnosis result corresponding to the first partial region from the pixel-by-pixel diagnosis result of the above biological tissue image; and Among the partial regions of the above biological tissue image, a third partial region search module is included that searches for the third partial region in which the second lesion pattern is most included in the modified pixel unit diagnosis result corresponding to the corresponding region. The above output module is, A first representative lesion image selection module that selects a first representative lesion image that contains the most first lesion patterns in pixel unit diagnosis corresponding to the corresponding region among the first partial region of each of the plurality of biological tissue images and the second partial region of each of the plurality of biological tissue images; A second representative lesion image selection module that selects a second representative lesion image that includes the second lesion pattern most frequently in a pixel-unit diagnosis corresponding to the corresponding region from among a first partial region of each of the plurality of biological tissue images, a second partial region of each of the remaining biological tissue images excluding the biological tissue image including the first representative lesion image among the plurality of biological tissue images, and a third partial region of the biological tissue image including the first representative lesion image; and A computing system including a representative lesion image output module that outputs the first representative lesion image and the second representative lesion image as representative lesion images representing the pathological diagnosis case.

9. In paragraph 8, The above first part area search module is, The first partial region is searched using a sliding window method in which the shape and area of the window are set to be the same as the partial region of the biological tissue image, The above second part area search module is, The second partial region is searched using a sliding window method in which the shape and area of the window are set to be the same as the partial region of the biological tissue image, The above third part area search module is, A computing system that searches the third partial region using a sliding window method in which the shape and area of the window are set to be the same as the partial region of the biological tissue image.

10. In paragraph 8, The above representative lesion image output module is, Overlapping the pixel-level diagnostic results corresponding to the first representative lesion image with the first representative lesion image and outputting them, A computing system that overlaps and outputs pixel-level diagnostic results corresponding to the second representative lesion image on the second representative lesion image.

Images