Information processing device, method, and program, learning device, method, and program, and discrimination model
The information processing device uses discriminant models to iteratively refine infarct and occlusion identifications in non-contrast CT images, addressing the inaccuracies of existing methods and enabling timely diagnosis and treatment of cerebral infarction.
Patent Information
- Application Number
- JP2022034783
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-03-07
- Publication Date
- 2025-12-23
- Estimated Expiration
- 2042-03-07
AI Technical Summary
Existing methods for diagnosing cerebral infarction and major artery occlusion using non-contrast CT images are inaccurate due to the subtle differences in pixel values and the difficulty in distinguishing the hyperdense artery sign (HAS) from other structures, leading to delayed treatment and poor prognosis.
An information processing device and method that utilizes a series of discriminant models, including convolutional neural networks (CNN) and U-Nets, to iteratively update and refine the identification of infarct regions and major artery occlusions in non-contrast CT images, incorporating anatomical and clinical information, and using symmetrical brain midline information for enhanced accuracy.
Accurately identifies infarct regions and major artery occlusions in non-contrast CT images, reducing the time to diagnosis and enabling timely treatment by improving the precision of disease area identification.
Smart Images

Figure 0007791015000001 
Figure 0007791015000002 
Figure 0007791015000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to an information processing device, a method, and a program, a learning device, a method, and a program, and a discrimination model. [Background technology]
[0002] In recent years, advances in medical equipment such as CT (Computed Tomography) and MRI (Magnetic Resonance Imaging) have made it possible to perform diagnostic imaging using higher quality, higher resolution medical images. In particular, when the target area is the brain, diagnostic imaging using CT and MRI images can identify areas of cerebral vascular disorders such as cerebral infarction and cerebral hemorrhage. For this reason, various methods have been proposed to support diagnostic imaging.
[0003] Cerebral infarction is a disease in which brain tissue is damaged by cerebral blood vessel blockage and is known to have a poor prognosis. Once a cerebral infarction develops, irreversible cell death progresses over time, making shortening the time until treatment can begin a key issue. When applying thrombectomy, a typical treatment for cerebral infarction, two pieces of information are required: the extent of the infarction and the presence or absence of large vessel occlusion (LVO) (see Guidelines for Proper Use of Percutaneous Transluminal Cerebral Thrombectomy Devices, 4th Edition, March 2020, p. 12-(1)).
[0004] On the other hand, when diagnosing patients suspected of having a brain disease, the presence or absence of intracerebral hemorrhage is often confirmed before confirming cerebral infarction. Because intracerebral hemorrhage can be clearly identified on non-contrast CT images, patients suspected of having a brain disease are first diagnosed using non-contrast CT images. However, in non-contrast CT images, the pixel value difference between the area of cerebral infarction and other areas is not significant. Furthermore, although it is possible to visually identify a high-absorption structure (hyperdense artery sign (HAS)) that reflects a thrombus causing major artery occlusion, the image is not very clear, making it difficult to identify the location of the occlusion in the major arteries. Thus, using non-contrast CT images, it is often difficult to identify the area of infarction and the location of the occlusion in the major arteries. Therefore, after diagnosing using non-contrast CT images, MRI or contrast CT images are acquired to diagnose whether or not cerebral infarction has occurred, identify the location of the occlusion in the major arteries, and, if cerebral infarction has occurred, confirm the extent of the occlusion.
[0005] However, if MRI and contrast CT images are obtained after a diagnosis using CT images to determine whether or not a cerebral infarction has occurred, the time that has passed since the onset of the infarction will be long, which will delay the start of treatment and result in a higher likelihood of a poor prognosis.
[0006] For this reason, methods have been proposed for automatically extracting infarct regions and occlusion sites of major arteries from non-contrast CT images. For example, Patent Document 1 proposes a method for identifying infarct regions and thrombus regions using a classifier trained to extract infarct regions from non-contrast CT images and a classifier trained to extract thrombus regions from non-contrast CT images. [Prior art documents] [Patent documents]
[0007] [Patent Document 1] Japanese Patent Publication No. 2020-054580 Summary of the Invention [Problem to be solved by the invention]
[0008] On the other hand, the HAS, which indicates the location of the occlusion of a major artery, appears in different locations depending on which blood vessel is blocked, and its appearance also varies depending on the angle of the cross-section of the CT image relative to the brain, the characteristics of the thrombus, and the degree of occlusion. It can also be difficult to distinguish it from similar structures in the vicinity, such as calcification. Furthermore, the infarcted area occurs in the vascular area controlled by the blood vessel in which the HAS occurred. Therefore, if the location of the occlusion of a major artery can be identified, it becomes easier to identify the infarcted area. Furthermore, vascular occlusion is not limited to the brain; it can also occur in other organs, such as the heart.
[0009] The present disclosure has been made in consideration of the above circumstances, and aims to enable accurate identification of a first disease area, such as an infarction area, contained in a medical image, and a second disease area, such as an occlusion site related to the first disease area. [Means for solving the problem]
[0010] An information processing device according to the present disclosure includes at least one processor, The processor obtains a medical image and a first disease region in the medical image; deriving a second disease region associated with the first disease region in the medical image based on the medical image and the first disease region; updating the first disease region based on the medical image and the second disease region; updating a second disease region based on the medical image and the updated first disease region; The updating of the first disease region and the updating of the second disease region are repeated until a predetermined termination condition is satisfied.
[0011] In addition, with regard to the first disease area and the second disease area, in the medical image, not only are they composed of multiple pixels, but also areas consisting of only one pixel are considered to be areas in this disclosure, and it is possible that a first disease area and a second disease area consisting of only one pixel may be derived.
[0012] In addition, in the information processing device according to the present disclosure, the processor may update the first disease area and derive and update the second disease area using a first discriminant model trained to output a second disease area when a medical image and a first disease area are input, and a second discriminant model trained to output the first disease area when a medical image and a second disease area are input.
[0013] In addition, in the information processing device according to the present disclosure, the processor may further update the first disease area and derive and update the second disease area based on at least one of information representing the anatomical area of the organ including the first and second disease areas and clinical information.
[0014] In the information processing device according to the present disclosure, the processor may acquire the first disease region by extracting the first disease region from the medical image.
[0015] In addition, in the information processing device according to the present disclosure, the processor derives quantitative information about at least one of the first disease region and the second disease region; It may also display quantitative information.
[0016] In the information processing device according to the present disclosure, the medical image is a non-contrast CT image of the patient's brain, The first diseased area is either an infarcted area or a major artery occlusion area in a non-contrast CT image; The second diseased area may be the other of the infarcted area and the occlusion site of the major artery in the non-contrast CT image.
[0017] In addition, in the information processing device according to the present disclosure, the processor may further use first information on a region of interest with respect to the brain midline in at least the non-contrast CT image of the non-contrast CT image and the first disease region to derive and update the second disease region, and may further use second information on a region of interest with respect to the brain midline in at least the non-contrast CT image of the non-contrast CT image and the second disease region to update the first disease region.
[0018] In addition, in the information processing device according to the present disclosure, the first information may be first inverted information obtained by inverting the non-contrast CT image and at least the non-contrast CT image of the first disease region based on the midline of the brain, and the second information may be second inverted information obtained by inverting the non-contrast CT image and at least the non-contrast CT image of the second disease region based on the midline of the brain.
[0019] A learning device according to the present disclosure includes at least one processor, The processor acquires training data including a medical image including a first disease area and input data consisting of the first disease area in the medical image, and ground truth data consisting of a second disease area related to the first disease area in the medical image; By machine learning a neural network using learning data, a discriminant model is constructed that outputs a second disease area when a medical image and a first disease area are input.
[0020] The discriminant model according to the present disclosure receives a medical image and a first disease region in the medical image as input, and outputs a second disease region related to the first disease region in the medical image.
[0021] The information processing method according to the present disclosure includes obtaining a medical image and a first disease region in the medical image; deriving a second disease region associated with the first disease region in the medical image based on the medical image and the first disease region; updating the first disease region based on the medical image and the second disease region; updating a second disease region based on the medical image and the updated first disease region; The updating of the first disease region and the updating of the second disease region are repeated until a predetermined termination condition is satisfied.
[0022] The learning method according to the present disclosure includes acquiring learning data including a medical image including a first disease area, input data consisting of the first disease area in the medical image, and ground truth data consisting of a second disease area related to the first disease area in the medical image; By machine learning a neural network using learning data, a discriminant model is constructed that outputs a second disease area when a medical image and a first disease area are input.
[0023] The information processing method and learning method according to the present disclosure may be provided as a program for causing a computer to execute the method. [Effects of the Invention]
[0024] According to the present disclosure, a first disease area and a second disease area related to the first disease area contained in a medical image can be identified with high accuracy. [Brief explanation of the drawings]
[0025] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a medical information system to which an information processing device and a learning device according to a first embodiment of the present disclosure are applied. [Figure 2] FIG. 1 is a diagram showing a schematic configuration of an information processing device and a learning device according to a first embodiment; [Figure 3] Functional configuration diagram of an information processing device and a learning device according to the first embodiment [Figure 4] FIG. 1 is a schematic block diagram showing a configuration of an information derivation unit according to a first embodiment. [Figure 5] Schematic diagram of the U-Net configuration [Figure 6] Diagram to explain the inversion of feature maps [Figure 7]FIG. 1 is a diagram showing training data for training a U-Net that constructs a second discriminant model in the first embodiment. [Figure 8] FIG. 10 is a diagram showing training data for training a U-Net that constructs a third discriminant model in the first embodiment. [Figure 9] Diagram explaining arteries and their territories in the brain [Figure 10] Diagram showing the display screen [Figure 11] 1 is a flowchart showing a learning process performed in the first embodiment. [Figure 12] 1 is a flowchart showing information processing performed in the first embodiment. [Figure 13] FIG. 10 is a schematic block diagram showing the configuration of an information derivation unit according to a second embodiment. [Figure 14] 10 is a flowchart showing information processing performed in the second embodiment. [Figure 15] FIG. 10 is a schematic block diagram showing the configuration of an information derivation unit according to a third embodiment. [Figure 16] FIG. 10 is a diagram showing training data for training a U-Net that constructs a second discriminant model in the third embodiment. [Figure 17] FIG. 10 is a diagram showing training data for training a U-Net that constructs a third discriminant model in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0026] A first embodiment of the present disclosure will be described below with reference to the drawings. Fig. 1 is a hardware configuration diagram showing an overview of a diagnosis support system to which an information processing device and a learning device according to the first embodiment of the present disclosure are applied. As shown in Fig. 1, in the diagnosis support system, an information processing device 1 according to the first embodiment, a three-dimensional image capturing device 2, and an image storage server 3 are connected in a communicable state via a network 4. Note that the information processing device 1 includes a learning device according to this embodiment.
[0027] The three-dimensional imaging device 2 is a device that captures an image of a diagnostic target region of a subject to generate a three-dimensional image representing the region, and is specifically a CT device, an MRI device, a PET device, or the like. The medical images generated by the three-dimensional imaging device 2 are transmitted to and stored in an image storage server 3. In this embodiment, the diagnostic target region of the subject is the brain, and the three-dimensional imaging device 2 is a CT device that generates a three-dimensional CT image G0 of the head of the subject. In this embodiment, the CT image G0 is a non-contrast CT image acquired by performing imaging without using a contrast agent.
[0028] The image storage server 3 is a computer that stores and manages various data and is equipped with a large-capacity external storage device and database management software. The image storage server 3 communicates with other devices via a wired or wireless network 4, sending and receiving image data and the like. Specifically, it acquires various data, including image data of CT images generated by the 3D imaging device 2, via the network and stores and manages the data on a recording medium such as a large-capacity external storage device. The image storage server 3 also stores training data for building a discrimination model, as described below. The storage format of the image data and communication between devices via the network 4 are based on protocols such as DICOM (Digital Imaging and Communication in Medicine).
[0029] Next, an information processing device and a learning device according to a first embodiment of the present disclosure will be described. FIG. 2 describes the hardware configuration of the information processing device and the learning device according to the first embodiment. As shown in FIG. 2, the information processing device and the learning device (hereinafter referred to as the information processing device) 1 includes a CPU (Central Processing Unit) 11, non-volatile storage 13, and memory 16 as a temporary storage area. The information processing device 1 also includes a display 14 such as a liquid crystal display, an input device 15 such as a keyboard and a mouse, and a network I / F (Interface) 17 connected to a network 4. The CPU 11, the storage 13, the display 14, the input device 15, the memory 16, and the network I / F 17 are connected to a bus 18. The CPU 11 is an example of a processor in the present disclosure.
[0030] The storage 13 is realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, etc. The storage 13 as a storage medium stores an information processing program 12A and a learning program 12B. The CPU 11 reads the information processing program 12A and the learning program 12B from the storage 13, expands them in the memory 16, and executes the expanded information processing program 12A and the learning program 12B.
[0031] Next, the functional configuration of the information processing device according to the first embodiment will be described. Fig. 3 is a diagram showing the functional configuration of the information processing device according to the first embodiment. As shown in Fig. 3, the information processing device 1 includes an information acquisition unit 21, an information derivation unit 22, a learning unit 23, a quantitative value derivation unit 24, and a display control unit 25. The CPU 11 executes an information processing program 12A to function as the information acquisition unit 21, the information derivation unit 22, the quantitative value derivation unit 24, and the display control unit 25. The CPU 11 also executes a learning program 12B to function as the learning unit 23.
[0032] The information acquisition unit 21 acquires a non-contrast CT image G0 of the patient's head from the image storage server 3. The information acquisition unit 21 also acquires, from the image storage server 3, training data for training a neural network to construct a discrimination model, which will be described later.
[0033] The information derivation unit 22 derives the infarct region and the occlusion location of the major artery in the CT image G0. The infarct region and the occlusion location of the major artery are examples of a first disease region and a second disease region, respectively, according to the present disclosure. Specifically, the information derivation unit 22 derives the occlusion location of the major artery in the CT image G0 based on the CT image G0 and the infarct region, and updates the infarct region in the CT image G0 based on the CT image G0 and the derived occlusion location of the major artery. Furthermore, the information derivation unit 22 updates the occlusion location of the major artery based on the CT image G0 and the updated infarct region. The information derivation unit 22 then repeats updating the infarct region and the occlusion location of the major artery until a predetermined termination condition is satisfied, and derives the infarct region and the occlusion location of the major artery when the predetermined termination condition is satisfied as the final infarct region and the final occlusion location of the major artery.
[0034] FIG. 4 is a schematic block diagram showing the configuration of the information derivation unit 22. As shown in FIG. 4, the information derivation unit 22 includes a first discriminant model 22A, a second discriminant model 22B, and a third discriminant model 22C. The first discriminant model 22A is constructed by machine learning a convolutional neural network (CNN) so as to extract a cerebral infarction region as a first disease region from a CT image G0 to be processed. The first discriminant model 22A can be constructed, for example, by using the technique described in Patent Document 1. Specifically, the first discriminant model 22A can be constructed by machine learning a CNN using a non-contrast CT image of the head and a mask image representing the infarction region in the non-contrast CT image as training data. As a result, the first discriminant model 22A extracts the infarction region in the CT image G0 from the CT image G0 and outputs a mask image M0 representing the infarction region in the CT image G0.
[0035] The second discriminant model 22B is constructed by machine learning U-Net, a type of convolutional neural network, using a large amount of training data to extract the occlusion site of the major artery from the CT image G0 as a second disease area based on the CT image G0 and a mask image M0 representing the infarct area in the CT image G0.
[0036] The third discriminant model 22C is constructed by machine learning a U-Net, a type of convolutional neural network, using a large amount of training data to extract the infarct area from the CT image G0 as an updated first disease area based on the CT image G0 and a mask image H0 representing the occlusion site of the major artery in the CT image G0.
[0037] FIG. 5 is a diagram schematically illustrating the configuration of a U-Net. Here, the U-Net that constructs the second discriminant model 22B will be described, but the U-Net that constructs the third discriminant model 22C has a similar configuration, except for different inputs and outputs. As shown in FIG. 5, the second discriminant model 22B is composed of nine layers, namely, a first layer 31 to a ninth layer 39. In this embodiment, when deriving the second disease region, information on regions symmetrical about the brain midline in the CT image G0 and the mask image M0 representing the infarct region is used. Information on regions symmetrical about the brain midline will be described later.
[0038] In this embodiment, the CT image G0 and a mask image M0 representing the infarct region in the CT image G0 are combined and input to the first layer 31. Note that, depending on the CT image G0, the brain midline may be tilted relative to the perpendicular bisector of the CT image G0. In such cases, it is preferable to rotate the brain in the CT image G0 so that the brain midline coincides with the perpendicular bisector of the CT image G0. Also, the center of the brain may be shifted from the center of the CT image G0. In such cases, it is preferable to translate the brain in the CT image G0 so that the center of the brain coincides with the center of the CT image G0. In this case, it is necessary to perform the same rotation and / or translation process on the mask image M0.
[0039] The first layer 31 has two convolution layers and outputs a feature map F1 obtained by integrating two feature maps, the convolved CT image G0 and the mask image M0. The integrated feature map F1 is input to the ninth layer 39, as indicated by the dashed line in FIG. 5 . The integrated feature map F1 is then pooled to reduce its size by half and input to the second layer 32. In FIG. 5 , the pooling is indicated by a downward arrow. In this embodiment, a 3×3 kernel is used for the convolution, for example, but is not limited to this. In addition, the maximum value of four pixels is used for the pooling, but is not limited to this.
[0040] The second layer 32 has two convolutional layers, and the feature map F2 output from the second layer 32 is input to the eighth layer 38, as indicated by the dashed line in Figure 5. The feature map F2 is also pooled to reduce its size by half and then input to the third layer 33.
[0041] The third layer 33 also has two convolutional layers, and the feature map F3 output from the third layer 33 is input to the seventh layer 37, as indicated by the dashed line in Figure 5. The feature map F3 is also pooled to reduce its size by half and then input to the fourth layer 34.
[0042] Furthermore, in this embodiment, when deriving the second disease region, information on regions symmetrical with respect to the brain midline in the CT image G0 and the mask image M0 representing the infarct region is used. Therefore, in the third layer 33 of the second discriminant model 22B, the pooled feature map F3 is flipped horizontally with respect to the brain midline to derive an inverted feature map F3A. The inverted feature map F3A is an example of inversion information in the present disclosure. FIG. 6 is a diagram for explaining the inversion of the feature map. As shown in FIG. 6, the feature map F3 is flipped horizontally with respect to the brain midline C0 to derive the inverted feature map F3A. Note that, although the inversion information is generated within the U-Net in this embodiment, when the CT image G0 and the mask image M0 are input to the first layer 31, an inverted image of at least the CT image G0 may be generated from among the CT image G0 and the mask image M0, and the CT image G0, the inverted image of the CT image G0, and the mask image M0 may be combined and input to the first layer 31. Alternatively, an inverted image of the mask image M0 may be generated in addition to an inverted image of the CT image G0, and the CT image G0, the inverted image of the CT image G0, the mask image M0, and the inverted image of the mask image M0 may be combined and input to the first layer 31. In this case, the inverted image may be generated by rotating the brain in the CT image G0 so that the midline of the brain coincides with the perpendicular bisector of the CT image G0, or by translating the brain in the CT image G0 so that the center of the brain coincides with the center of the CT image G0. Furthermore, the mask image M0 may also be rotated and / or translated in the same manner as the CT image G0.
[0043] The fourth layer 34 also has two convolutional layers, and the pooled feature map F3 and the inverted feature map F3A are input to the first convolutional layer. The feature map F4 output from the fourth layer 34 is input to the sixth layer 36, as shown by the dashed line in Figure 5. The feature map F4 is also pooled and reduced in size by half, and then input to the fifth layer 35.
[0044] The fifth layer 35 has one convolutional layer, and the feature map F5 output from the fifth layer 35 is upsampled to double its size and input to the sixth layer 36. In FIG. 5, upsampling is indicated by an upward arrow.
[0045] The sixth layer 36 has two convolution layers, and performs a convolution operation by integrating the feature map F4 from the fourth layer 34 and the upsampled feature map F5 from the fifth layer 35. The feature map F6 output from the sixth layer 36 is upsampled to double its size and input to the seventh layer 37.
[0046] The seventh layer 37 has two convolution layers and performs a convolution operation by integrating the feature map F3 from the third layer 33 and the upsampled feature map F6 from the sixth layer 36. The feature map F7 output from the seventh layer 37 is upsampled and input to the eighth layer 38.
[0047] The eighth layer 38 has two convolution layers and performs a convolution operation by integrating the feature map F2 from the second layer 32 and the upsampled feature map F7 from the seventh layer 37. The feature map output from the eighth layer 38 is upsampled and input to the ninth layer 39.
[0048] The ninth layer 39 has three convolution layers and performs a convolution operation by integrating the feature map F1 from the first layer 31 and the upsampled feature map F8 from the eighth layer 38. The feature map F9 output from the ninth layer 39 is an image in which the occlusion areas of the major arteries in the CT image G0 are extracted.
[0049] 7 is a diagram showing training data for training a U-Net that constructs the second discriminant model 22B in the first embodiment. As shown in FIG. 7, training data 40 consists of input data 41 and supervised data 42. The input data 41 consists of a non-contrast CT image 43 and a mask image 44 that represents an infarct region in the non-contrast CT image 43. The supervised data 42 is a mask image that represents the location of occlusion in a major artery in the non-contrast CT image 43.
[0050] In this embodiment, a large amount of learning data 40 is stored in the image storage server 3, and the learning data 40 is acquired from the image storage server 3 by the information acquisition unit 21 and used for training the U-Net by the learning unit 23.
[0051] The learning unit 23 inputs the non-contrast CT image 43 and the mask image 44, which are input data 41, into the U-Net for constructing the second discriminant model 22B, and causes the U-Net to output an image representing the occlusion site of a major artery in the non-contrast CT image 43. Specifically, the learning unit 23 causes the U-Net to extract the occlusion site of a major artery in the non-contrast CT image 43 and output a mask image in which the occlusion site of the major artery is masked. The learning unit 23 derives the difference between the output image and the ground truth data 42 as a loss, and learns the connection weights and kernel coefficients of each layer in the U-Net to minimize the loss. Note that perturbations may be applied to the mask image 44 during learning. Possible perturbations include, for example, applying morphological processing to the mask with random probability or filling the mask with zeros. By adding perturbations to the mask image 44, it is possible to respond to the pattern seen in hyperacute cerebral infarction cases, in which there is no significant infarction area and only a thrombus appears on the image, and further, it is possible to prevent the second discrimination model 22B from relying too heavily on the input mask image during discrimination.
[0052] The learning unit 23 then repeatedly performs learning until the loss becomes equal to or less than a predetermined threshold. As a result, when a non-contrast CT image G0 and a mask image M0 representing an infarct region in the CT image G0 are input, a second discriminant model 22B is constructed that extracts a major artery occlusion site included in the CT image G0 as a second disease region and outputs a mask image H0 representing the major artery occlusion site in the CT image G0. Note that the learning unit 23 may construct the second discriminant model 22B by repeatedly performing learning a predetermined number of times.
[0053] 8 is a diagram showing training data for training U-Net that constructs the third discriminant model 22C in the first embodiment. As shown in FIG. 8, training data 45 consists of input data 46 and correct answer data 47. The input data 46 consists of a non-contrast CT image 48 and a mask image 49 that represents the occlusion site of a major artery in the non-contrast CT image 48. The correct answer data 47 is a mask image that represents the infarct region in the non-contrast CT image 48.
[0054] The learning unit 23 inputs a non-contrast CT image 48 and a mask image 49, which are input data 46, into a U-Net for constructing the third discriminant model 22C, and causes the U-Net to output an image representing an infarct region in the non-contrast CT image 48. Specifically, the learning unit 23 causes the U-Net to extract the infarct region in the non-contrast CT image 48 and output a mask image in which the infarct region is masked. The learning unit 23 derives the difference between the output image and the ground truth data 47 as a loss and learns the connection weights and kernel coefficients of each layer in the U-Net to minimize the loss. Note that perturbations may be applied to the mask image 49 during training. Examples of perturbations include applying morphological processing to the mask with random probability or filling the mask with zeros. Applying perturbations to the mask image 49 allows the third discriminant model 22C to handle patterns in which no significant thrombus is visible in the image (e.g., in the case of atherosclerotic cerebral infarction) and prevents the third discriminant model 22C from relying too heavily on the input mask image during discrimination.
[0055] The learning unit 23 then repeatedly performs learning until the loss becomes equal to or less than a predetermined threshold. As a result, when a non-contrast CT image G0 and a mask image H0 representing the occlusion site of a major artery in the CT image G0 are input, a third discriminant model 22C is constructed that extracts an infarct region included in the CT image G0 as a second disease region and outputs a mask image M1 representing the infarct region in the CT image G0. Note that the learning unit 23 may construct the third discriminant model 22C by repeatedly performing learning a predetermined number of times.
[0056] The configuration of the U-Net that constitutes the second discriminant model 22B and the third discriminant model 22C is not limited to that shown in Fig. 5. For example, in the U-Net shown in Fig. 5, the inverted feature map F3A is derived from the feature map F3 output from the third layer 33, but the inverted feature map may be used in any layer in the U-Net. Furthermore, the number of convolutional layers in each layer in the U-Net is not limited to that shown in Fig. 5.
[0057] The information derivation unit 22 inputs the CT image G0 and the mask image M0 representing the infarct region derived by the first discriminant model 22A into the second discriminant model 22B constructed as described above. Then, the information derivation unit 22 causes the second discriminant model 22B to extract the occluded area of the major artery in the CT image G0 and output a mask image H0 representing the occluded area of the major artery. The information derivation unit 22 also inputs the CT image G0 and the mask image H0 representing the occluded area of the major artery into the third discriminant model 22C. Then, the information derivation unit 22 causes the third discriminant model 22C to extract the updated infarct region in the CT image G0 and output a mask image M1 representing the updated infarct region.
[0058] The information derivation unit 22 also inputs the CT image G0 and a mask image M1 representing the updated infarct region to the second discriminant model 22B. The information derivation unit 22 then updates the occluded location of the major artery by causing the second discriminant model 22B to extract the updated occluded location of the major artery in the CT image G0 and output a mask image H1 representing the updated occluded location of the major artery. The information derivation unit 22 then repeats updating the infarct region and the occluded location of the major artery until a predetermined termination condition is satisfied, and derives the infarct region and the occluded location of the major artery when the predetermined termination condition is satisfied as the final infarct region and the occluded location of the major artery.
[0059] The termination condition may be that the updating of the infarct region and the occlusion location of the major artery are repeated a predetermined number of times. Alternatively, the termination condition may be that at least one of the difference between the updated infarct region and the infarct region immediately before the update and the difference between the updated occlusion location of the major artery and the occlusion location of the major artery immediately before the update is equal to or less than a predetermined threshold. Here, the difference may be determined by using a correlation value between the updated infarct region and the infarct region immediately before the update on the CT image G0, or a correlation value between the updated occlusion location of the major artery and the occlusion location of the major artery immediately before the update.
[0060] The quantitative value derivation unit 24 derives a quantitative value for at least one of the infarct region and the occlusion site of the major artery derived by the information derivation unit 22. The quantitative value is an example of quantitative information in the present disclosure. In this embodiment, the quantitative value derivation unit 24 derives quantitative values for both the infarct region and the occlusion site of the major artery, but may derive a quantitative value for either the infarct region or the occlusion site of the major artery. Since the CT image G0 is a three-dimensional image, the quantitative value derivation unit 24 may derive the volume of the infarct region, the volume of the occlusion site of the major artery, and the length of the occlusion site of the major artery as quantitative values. Furthermore, the quantitative value derivation unit 24 may derive the ASPECTS score as a quantitative value.
[0061] "ASPECTS" is an abbreviation for Alberta Stroke Program Early CT Score, and is a scoring method that quantifies early CT signs of cerebral infarction in the middle cerebral artery region using plain CT. Specifically, when the medical image is a CT image, the middle cerebral artery region is divided into 10 regions in two representative cross sections (at the basal ganglia level and the corona radiata level), and the presence or absence of early ischemic changes is evaluated for each region, with positive areas scored using a demerit system. In ASPECTS, a lower score indicates a larger infarct area. The quantitative value derivation unit 24 can derive a score depending on whether the infarct region is included in the above 10 regions.
[0062] The quantitative value derivation unit 24 may also identify the control area of the occluded blood vessel based on the occlusion location of the major artery, and derive the overlap (volume) between the control area and the infarct area as a quantitative value. FIG. 9 is a diagram for explaining arteries and their control areas in the brain. FIG. 9 shows a slice image S1 on a certain cross section of the CT image G0. As shown in FIG. 9, the brain includes an anterior cerebral artery (ACA) 51, a middle cerebral artery (MCA) 52, and a posterior cerebral artery (PCA) 53. Although not shown, the brain also includes an internal carotid artery (ICA). The brain is divided into left and right anterior cerebral artery-fed regions 61L, 61R, middle cerebral artery-fed regions 62L, 62R, and posterior cerebral artery-fed regions 63L, 63R, each of which has blood flow controlled by an anterior cerebral artery 51, a middle cerebral artery 52, and a posterior cerebral artery 53. In Figure 9, the right side is the left hemisphere of the brain.
[0063] The control region can be specified by aligning the CT image G0 with a standard brain image prepared in advance in which the control region has been specified.
[0064] The quantitative value derivation unit 24 identifies the artery in which the occlusion of a major artery is located and identifies the area of the brain controlled by the identified artery. For example, if the occlusion of a major artery is located in the left anterior cerebral artery, the controlled area is identified as the anterior cerebral controlled area 61L. Here, the infarct area occurs downstream of the location of the thrombus in the artery. Therefore, the infarct area is located in the anterior cerebral controlled area 61L. Therefore, the quantitative value derivation unit 24 may derive the volume of the infarct area relative to the volume of the anterior cerebral controlled area 61L in the CT image G0 as a quantitative value.
[0065] The display control unit 25 displays the patient's CT image G0 and the quantitative values on the display 14. FIG. 10 is a diagram showing the display screen. As shown in FIG. 10, slice images included in the patient's CT image G0 are displayed on the display screen 70 in a switchable manner based on the operation of the input device 15. A mask 71 of the infarct region is superimposed on the CT image G0. An arrow-shaped mark 72 indicating the occlusion site of the major artery is also superimposed. A quantitative value 73 derived by the quantitative value derivation unit 24 is displayed on the right side of the CT image G0. Specifically, the volume of the infarct region (40 ml), the length of the occlusion site of the major artery (HAS length: 10 mm), and the volume of the occlusion site of the major artery (HAS volume: 0.1 ml) are displayed.
[0066] Next, the processing performed in the first embodiment will be described. FIG. 11 is a flowchart showing the learning processing performed in the first embodiment. It is assumed that the learning data is acquired from the image storage server 3 and stored in the storage 13. Here, the learning of the U-Net that constructs the second discriminant model 22B will be described. First, the learning unit 23 inputs input data 41 included in the learning data 40 to the U-Net (step ST1), and causes the U-Net to extract the occluded areas of the major arteries (step ST2). Then, the learning unit 23 derives a loss from the extracted occluded areas of the major arteries and the ground truth data 42 (step ST3), and determines whether the loss is equal to or less than a predetermined threshold (step ST4).
[0067] If step ST4 is negative, the process returns to step ST1, and the learning unit 23 repeats the processes of steps ST1 to ST4. If step ST4 is positive, the process ends. This results in the construction of the second discriminant model 22B. Note that the training of the U-Net that constructs the third discriminant model 22C may be performed in the same manner as the training of the U-Net that constructs the second discriminant model 22B.
[0068] 12 is a flowchart showing information processing performed in the first embodiment. It is assumed that the non-contrast CT image G0 to be processed is acquired from the image storage server 3 and stored in the storage 13. First, the information derivation unit 22 derives the infarct region in the CT image G0 using the first discriminant model 22A (step ST11). Furthermore, the information derivation unit 22 derives the occlusion location of the major artery in the CT image G0 using the second discriminant model 22B based on the CT image G0 and a mask image M0 representing the infarct region (step ST12).
[0069] Next, the information derivation unit 22 uses the third discriminant model 22C to derive an updated infarct region in the CT image G0 based on the CT image G0 and the mask image H0 representing the derived occlusion region of the major artery (infarct region update; step ST13).Furthermore, the information derivation unit 22 uses the second discriminant model 22B to derive an updated occlusion region of the major artery in the CT image G0 based on the CT image G0 and the mask image representing the updated infarct region (infarct region update; step ST14).
[0070] The information derivation unit 22 determines whether the termination condition is satisfied (step ST15). If step ST15 is negative, the process returns to step ST13 and repeats updating the infarct region and the occlusion location of the major artery. If step ST15 is positive, the quantitative value derivation unit 24 derives the quantitative value based on the information on the infarct region and the occlusion location of the major artery (step ST16). Then, the display control unit 25 displays the CT image G0 and the quantitative value (step ST17), and the process ends.
[0071] As described above, in the first embodiment, the occlusion location of the major artery in the CT image G0 is derived based on the non-contrast CT image G0 of the patient's head and the infarct region in the CT image G0. This allows the infarct region to be taken into consideration, thereby enabling the occlusion location of the major artery to be identified with high accuracy. Also, in the first embodiment, the occlusion location of the major artery in the CT image G0 is derived based on the non-contrast CT image G0 of the patient's head and the occlusion location of the major artery in the CT image G0. This allows the occlusion location of the major artery to be taken into consideration, thereby enabling the occlusion location of the major artery to be identified with high accuracy. Also, in the first embodiment, the infarct region and the occlusion location of the major artery are repeatedly updated until the termination condition is satisfied, thereby enabling the occlusion location of the major artery to be identified with high accuracy.
[0072] Brain diseases such as cerebral infarction rarely occur simultaneously in both the left and right hemispheres of the brain. Therefore, by using an inverted feature map F3A, which is created by inverting the feature map F3 with respect to the midline C0 of the brain, it is possible to identify the infarcted area and the occlusion of the major arteries while comparing the features of the left and right hemispheres. This allows for accurate identification of the infarcted area and the occlusion of the major arteries.
[0073] Furthermore, displaying quantitative values makes it easier for doctors to determine treatment strategies based on the quantitative values. For example, displaying the volume or length of the occluded area of a major artery makes it easier to determine the type or length of an instrument to be used when applying thrombectomy.
[0074] Next, a second embodiment of the present disclosure will be described. Note that the configuration of the information processing device in the second embodiment is the same as the configuration of the information processing device in the first embodiment, and only the processing performed is different, so detailed description of the device will be omitted here.
[0075] FIG. 13 is a schematic block diagram showing the configuration of the information derivation unit 22 according to the second embodiment. As shown in FIG. 13, the information derivation unit 82 according to the second embodiment includes a first discriminant model 82A, a second discriminant model 82B, and a third discriminant model 82C. The first discriminant model 82A according to the second embodiment is constructed by machine learning a CNN so as to extract a major artery occlusion site from a CT image G0 as a first disease region. The first discriminant model 82A can be constructed, for example, by the technique described in Patent Document 1. Specifically, the first discriminant model 82A can be constructed by machine learning a CNN using non-contrast CT images of the head and the major artery occlusion site in the non-contrast CT images as training data.
[0076] The second discriminant model 82B in the second embodiment, like the third discriminant model 22C in the first embodiment, is constructed by machine learning U-Net, a type of convolutional neural network, using a large amount of training data to extract an infarct area from the CT image G0 as a second disease area based on the CT image G0 and a mask image H0 representing the occlusion site of a major artery in the CT image G0.
[0077] The third discriminant model 82C in the second embodiment, like the second discriminant model 22B in the first embodiment, is constructed by machine learning U-Net, a type of convolutional neural network, using a large amount of training data to extract the occlusion site of the major artery from the CT image G0 as an updated first disease area based on the CT image G0 and a mask image M0 representing the infarction area in the CT image G0.
[0078] In the second embodiment, the information derivation unit 82 inputs the CT image G0 and the mask image H0 representing the occluded location of a major artery derived by the first discriminant model 82A to the second discriminant model 82B. Then, the information derivation unit 82 causes the second discriminant model 82B to extract the infarct region in the CT image G0 and output a mask image M0 representing the infarct region. The information derivation unit 82 also inputs the CT image G0 and the mask image M0 representing the infarct region to the third discriminant model 82C. Then, the information derivation unit 82 causes the third discriminant model 82C to extract the updated occluded location of a major artery in the CT image G0 and output a mask image H1 representing the updated occluded location of the major artery.
[0079] The information derivation unit 82 also inputs the CT image G0 and the mask image H1 representing the updated occlusion location of the major artery to the second discriminant model 82B. The information derivation unit 82 then updates the infarct region by having the second discriminant model 82B extract the updated infarct region from the CT image G0 and output a mask image M1 representing the updated infarct region. The information derivation unit 82 then repeats updating the infarct region and the occlusion location of the major artery until a predetermined termination condition is satisfied, and derives the infarct region and the occlusion location of the major artery when the predetermined termination condition is satisfied as the final infarct region and the final occlusion location of the major artery.
[0080] As in the first embodiment, the termination condition may be that the updating of the infarct region and the occlusion location of the major artery are repeated a predetermined number of times. Alternatively, the termination condition may be that at least one of the difference between the updated infarct region and the infarct region immediately before the update and the difference between the updated occlusion location of the major artery and the occlusion location of the major artery immediately before the update is equal to or less than a predetermined threshold. Here, the difference may be determined by using a correlation value between the updated infarct region and the infarct region immediately before the update on the CT image G0, and a correlation value between the updated occlusion location of the major artery and the occlusion location of the major artery immediately before the update.
[0081] Next, a description will be given of the processing performed in the second embodiment. Note that, since the training of the U-Net for constructing the second discriminant model 82B and the third discriminant model 82C of the information derivation unit 82 in the second embodiment is performed in the same manner as in the first embodiment, the training processing will be omitted here.
[0082] 14 is a flowchart showing information processing performed in the second embodiment. It is assumed that the non-contrast CT image G0 to be processed is acquired from the image storage server 3 and stored in the storage 13. First, the information derivation unit 82 derives the occlusion site of the major artery in the CT image G0 using the first discriminant model 82A (step ST21). The information derivation unit 82 also derives the infarct region in the CT image G0 using the second discriminant model 82B based on the CT image G0 and a mask image H0 representing the occlusion site of the major artery (step ST22).
[0083] Next, the information derivation unit 82 uses the third discriminant model 82C to derive an updated major artery occlusion location in the CT image G0 based on the CT image G0 and the mask image M0 representing the derived infarct region (updating the major artery occlusion location; step ST23).Furthermore, the information derivation unit 82 uses the second discriminant model 82B to derive an updated infarct region in the CT image G0 based on the CT image G0 and the updated mask image representing the major artery occlusion location (updating the infarct region; step ST24).
[0084] The information derivation unit 82 determines whether the termination condition is satisfied (step ST25). If step ST25 is negative, the process returns to step ST23 and repeats updating the occluded portion of the major artery and the infarcted region. If step ST25 is positive, the quantitative value derivation unit 24 derives the quantitative value based on the information on the infarcted region and the occluded portion of the major artery (step ST26). Then, the display control unit 25 displays the CT image G0 and the quantitative value (step ST27), and the process ends.
[0085] Next, a third embodiment of the present disclosure will be described. Note that the configuration of the information processing device in the third embodiment is the same as the configuration of the information processing device in the first embodiment, and only the processing performed is different, so detailed description of the device will be omitted here.
[0086] Fig. 15 is a schematic block diagram showing the configuration of an information derivation unit according to the third embodiment. As shown in Fig. 15, the information derivation unit 83 according to the second embodiment has a first discriminant model 83A, a second discriminant model 83B, and a third discriminant model 83C. The first discriminant model 83A in the third embodiment is constructed by machine learning a CNN so as to extract an infarct region as a first disease region from the CT image G0, similar to the first discriminant model 22A in the first embodiment.
[0087] The second discriminant model 83B in the third embodiment is constructed by machine learning a U-Net using a large amount of training data so as to extract a major artery occlusion site from the CT image G0 as a second disease area based on at least one of information representing an anatomical area of the brain and clinical information (hereinafter referred to as additional information A0) in addition to the CT image G0 and a mask image M0 representing an infarct area in the CT image G0. Note that the configuration of the U-Net is the same as that of the first embodiment, and therefore a detailed description thereof will be omitted here.
[0088] The third discriminant model 83C in the third embodiment is constructed by machine learning a U-Net using a large amount of training data so as to extract an infarct region from the CT image G0 as an updated first disease region based on the CT image G0, the mask image H0 representing the occlusion site of a major artery in the CT image G0, and additional information A0. Note that the configuration of the U-Net is the same as that of the first embodiment, and therefore a detailed description thereof will be omitted here.
[0089] 16 is a diagram showing training data for training a U-Net that constructs a second discriminant model 83B in the third embodiment. As shown in FIG. 16, training data 100 consists of input data 101 and supervised data 102. The input data 101 consists of a non-contrast CT image 103, a mask image 104 representing an infarct region in the non-contrast CT image 103, and at least one of information representing an anatomical region and clinical information (hereinafter referred to as additional information) 105. The supervised data 102 is a mask image representing the location of a major artery occlusion in the non-contrast CT image 103.
[0090] Here, as information representing the anatomical region, for example, a mask image of a vascular region where an infarct region exists in the non-contrast CT image 103 can be used. Also, a mask image of an ASPECTS region where an infarct region exists in the non-contrast CT image 103 can be used as information representing the anatomical region. As clinical information, the ASPECTS score for the non-contrast CT image 103 and the National Institutes of Health Stroke Scale (NIHSS) for the patient from whom the non-contrast CT image 103 was acquired can be used. The NIHSS is one of the most widely used evaluation methods worldwide as an evaluation scale for the neurological severity of stroke.
[0091] In the third embodiment, the learning unit 23 constructs a second discriminant model 83B by training a U-Net using a large amount of training data 100 shown in Fig. 16. As a result, when a CT image G0, a mask image M0 representing an infarct region, and additional information A0 are input, the second discriminant model 83B in the third embodiment extracts the occluded area of a major artery from the CT image G0 and outputs a mask image H0 representing the occluded area of a major artery.
[0092] 17 is a diagram showing training data for training a U-Net that constructs a third discriminant model 83C in the third embodiment. As shown in FIG. 17, training data 110 consists of input data 111 and supervised data 112. The input data 111 consists of a non-contrast CT image 113, a mask image 114 representing the occlusion site of a major artery in the non-contrast CT image 113, and at least one of information representing an anatomical region and clinical information (hereinafter referred to as additional information) 115. The supervised data 112 is a mask image representing an infarct region in the non-contrast CT image 113.
[0093] In the third embodiment, the learning unit 23 constructs a third discriminant model 83C by training a U-Net using a large amount of training data 110 shown in Fig. 17. As a result, when a CT image G0, a mask image H0 representing the occlusion site of a major artery, and additional information A0 are input, the third discriminant model 83C in the third embodiment extracts an infarct region from the CT image G0 and outputs a mask image M0 representing the infarct region.
[0094] The learning process in the third embodiment differs from the first embodiment only in that additional information A0 is used, and therefore a detailed description of the learning process will be omitted. Furthermore, the information processing in the third embodiment differs from the first embodiment only in that the information input to the second discriminant model 83B includes additional information A0 of the patient in addition to the CT image G0 and a mask image representing the infarct region. Furthermore, the information processing in the third embodiment differs from the first embodiment only in that the information input to the third discriminant model 83C includes additional information A0 of the patient in addition to the CT image G0 and a mask image representing the occlusion site of the major artery. Therefore, a detailed description of the information processing will be omitted.
[0095] In the third embodiment, the location of the occlusion of the major artery in the CT image G0 is derived based on additional information in addition to a non-contrast CT image G0 of the patient's head and the infarct region in the CT image G0. This makes it possible to identify the location of the occlusion of the major artery in the CT image G0 with greater accuracy. Also, in the third embodiment, the location of the occlusion of the major artery in the CT image G0 is derived based on additional information in addition to a non-contrast CT image G0 of the patient's head and the infarct region in the CT image G0. This makes it possible to identify the location of the occlusion of the major artery in the CT image G0 with greater accuracy.
[0096] In the second embodiment, the second discriminant model 82B and the third discriminant model 82C may be constructed using additional information, as in the third embodiment.
[0097] In the above embodiments, the second and third discriminant models derive the infarct region and the location of the occlusion of the major artery using information on the CT image G0 and the first and second diseased regions symmetrical about the midline of the brain, but this is not limiting. The second and third discriminant models may be constructed to derive the infarct region and the location of the occlusion of the major artery without using information on the CT image G0 and the first and second diseased regions symmetrical about the midline of the brain.
[0098] In addition, in each of the above embodiments, the second and third discriminant models are constructed using U-Net, but this is not limiting. The second discriminant model may be constructed using a convolutional neural network other than U-Net.
[0099] In each of the above embodiments, the first discriminant model 22A, 82A, 83A of the information derivation unit 22, 82, 83 derives the first disease area (i.e., the infarct area or the occlusion area of the major artery) from the CT image G0 using CNN, but this is not limited to this. The information derivation unit may acquire, as the first disease area, a mask image generated by a doctor identifying the infarct area or the occlusion area of the major artery by interpreting the CT image G0, without using the first discriminant model, and derive the second disease area.
[0100] In the above embodiments, the infarct region in the brain and the occlusion site of the major artery are derived from a non-contrast CT image of the brain, but the present invention is not limited to this. For example, the discriminant model may be constructed to derive the infarct region in the heart and the occlusion site of the coronary artery from a CT image of the heart.
[0101] In addition, although the above embodiments have been described with respect to non-contrast CT images, the present invention is not limited to this and any medical image, such as a radiological image, an MRI image, a contrast CT image, or a PET image, can be processed.
[0102] In the above embodiments, the information derivation units 22, 82, and 83 derive the infarct region and the occlusion site of the major artery, but this is not limiting. A bounding box surrounding the infarct region and the occlusion site of the major artery may be derived.
[0103] Furthermore, in the above embodiment, the following various processors can be used as the hardware structure of the processing units that perform various processes, such as the information acquisition unit 21, the information derivation unit 22, the learning unit 23, the quantitative value derivation unit 24, and the display control unit 25 in the information processing device 1. As described above, the various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as dedicated electrical circuits that are processors having a circuit configuration specifically designed to perform specific processes, such as a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and an ASIC (Application Specific Integrated Circuit).
[0104] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor. Examples of multiple processing units configured with a single processor include, first, a configuration in which one processor is configured with a combination of one or more CPUs and software, as typified by client and server computers, and this processor functions as multiple processing units. Second, a configuration in which a processor is used to realize the functions of an entire system including multiple processing units on a single IC (Integrated Circuit) chip, as typified by a System on Chip (SoC). In this way, the various processing units are configured with one or more of the above-mentioned various processors as a hardware structure.
[0105] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements. [Explanation of symbols]
[0106] 1. Information processing equipment 2. 3D imaging device 3. Image storage server 4 Network 11 CPU 12A Information Processing Program 12B Study Program 13. Storage 14 Display 15 Input Devices 16 memory 17 Network I / F 18 Bus 21 Information Acquisition Department 22,82,83 Information derivation part 22A, 82A, 83A First discriminant model 22B, 82B, 83B Second discriminant model 22C, 82C, 83C Third discriminant model 23 Learning Department 24 Representative value derivation section 25 Display control unit 31A,31B 1st layer 32 2nd layer 33 3rd layer 34 4th layer 35 5th layer 36 Layer 6 37 7th layer 38 8th layer 39 9th layer 40,45,90,100,110 Training data 41,46,91,101,111 Input data 42,47,92,102,112 Correct data 43,48,93,103,113 Non-contrast CT image 44,49,94,104,114 Mask images 51 Anterior cerebral artery 52 Middle cerebral artery 53 Posterior cerebral artery 61L,61R Anterior cerebral artery innervation area 62L, 62R Middle cerebral artery distribution area 63L,63R Posterior cerebral artery innervation area 70 display area 71 Mask 72 marks 105,115 Additional Information A0 Additional Information G0 CT image H0,H1,M0,M1 mask images
Claims
1. at least one processor; The processor: obtaining a medical image and a first disease region in the medical image; deriving a second disease region associated with the first disease region in the medical image based on the medical image and the first disease region; updating the first disease region based on the medical image and the second disease region; updating the second disease region based on the medical image and the updated first disease region; repeating the update of the first disease region and the update of the second disease region until a predetermined termination condition is satisfied; the first diseased region is either an infarct region or a vascular occlusion region in the medical image; The information processing device, wherein the second diseased region is the other of the infarcted region and the vascular occlusion site in the medical image.
2. The information processing device described in claim 1, wherein the processor updates the first disease area and derives and updates the second disease area using a first discriminant model trained to output the second disease area when the medical image and the first disease area are input, and a second discriminant model trained to output the first disease area when the medical image and the second disease area are input.
3. 3. The information processing device according to claim 1, wherein the processor further updates the first disease area and derives and updates the second disease area based on at least one of information representing an anatomical area of an organ including the first and second disease areas and clinical information.
4. The information processing apparatus according to claim 1 , wherein the processor acquires the first disease region by extracting the first disease region from the medical image.
5. the processor deriving quantitative information about at least one of the first disease area and the second disease area; The information processing device according to claim 1 , wherein the quantitative information is displayed.
6. the medical image is a non-contrast CT image of the patient's brain; the first diseased area is either an infarct area or a major artery occlusion area in the non-contrast CT image; The information processing device according to claim 1 , wherein the second diseased region is the other of the infarcted region and the occluded site of the major artery in the non-contrast CT image.
7. The information processing device of claim 6, wherein the processor derives and updates the second disease region further using first information of a region of interest with respect to the midline of the brain in at least the non-contrast CT image of the non-contrast CT image and the first disease region, and updates the first disease region further using second information of a region of interest with respect to the midline of the brain in at least the non-contrast CT image of the non-contrast CT image and the second disease region.
8. 8. The information processing device according to claim 7, wherein the first information is first inversion information obtained by inverting the non-contrast CT image and at least the non-contrast CT image of the first disease region based on the midline of the brain, and the second information is second inversion information obtained by inverting the non-contrast CT image and at least the non-contrast CT image of the second disease region based on the midline of the brain.
9. obtaining a medical image and a first disease region in the medical image; deriving a second disease region associated with the first disease region in the medical image based on the medical image and the first disease region; updating the first disease region based on the medical image and the second disease region; updating the second disease region based on the medical image and the updated first disease region; repeating the update of the first disease region and the update of the second disease region until a predetermined termination condition is satisfied; the first diseased region is either an infarct region or a vascular occlusion region in the medical image; An information processing method, wherein the second diseased area is the other of the infarcted area and the vascular occlusion area in the medical image.
10. acquiring a medical image and a first disease region in the medical image; deriving a second disease region associated with the first disease region in the medical image based on the medical image and the first disease region; updating the first disease region based on the medical image and the second disease region; updating the second disease region based on the medical image and the updated first disease region; and causing the computer to execute a procedure of repeating the update of the first disease region and the update of the second disease region until a predetermined termination condition is satisfied; the first diseased region is either an infarct region or a vascular occlusion region in the medical image; an information processing program, wherein the second diseased area is the other of the infarcted area and the vascular occlusion area in the medical image;
Citation Information
Patent Citations
Apparatus, method, and program for training discriminator discriminating disease region, discriminator discriminating disease region, disease region discrimination apparatus, and disease region discrimination program
JP2020054580A
Medical image processing apparatus, method and program
JP2021175454A
Information processing device, method, and program, learning device, method, and program, and determination model
WO2023171039A1