Medical image processing device, medical image processing system, and medical image processing method

Abstract

To provide a superimposition image high in diagnosability.SOLUTION: A medical image processing device includes an acquisition unit, a determination unit, and a generation unit. The acquisition unit acquires a first medical image showing a first analysis result and a second medical image showing a second analysis result different from the first analysis result. The determination unit determines whether or not the first medical image and the second medical image are to be superimposed on the basis of a superimposition affirmative condition, which is a condition that the first medical image and the second medical image are to be superimposed, and a superimposition negative condition, which a condition that the first medical image and the second medical image are not to be superimposed. The generation unit generates a superimposition image by superimposing the first medical image and the second medical image according to the result of the determination.SELECTED DRAWING: Figure 8

Description

[Technical field]

[0001] The embodiments disclosed in this specification and the drawings relate to a medical image processing apparatus, a medical image processing system, and a medical image processing method. [Background technology]

[0002] In general, medical image processing devices perform various analyses (e.g., physiological analysis, morphological analysis) on medical images. In particular, medical image processing devices may perform the same or different types of analyses on multiple medical images. In this case, the medical image processing device generates a superimposed image by superimposing multiple medical images showing multiple analysis results, and displays the generated superimposed image.

[0003] However, from the viewpoint of the diagnostic purpose and visibility of the superimposed image, the medical image processing device should not simply superimpose all medical images. For example, a superimposed image including a plurality of analysis results that are not relevant to a specific diagnostic purpose is not suitable for this diagnostic purpose. On the other hand, a superimposed image including more than necessary analysis results that are highly relevant to a specific diagnostic purpose impairs its own visibility. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-057695 A Summary of the Invention [Problem to be solved by the invention]

[0005] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to provide a superimposed image with high diagnostic capability. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0006] The medical image processing apparatus according to the embodiment includes an acquisition unit, a determination unit, and a generation unit. The acquisition unit acquires a first medical image showing a first analysis result and a second medical image showing a second analysis result different from the first analysis result. The determination unit determines whether the first medical image and the second medical image should be superimposed based on a superimposition positive condition that is a condition under which the first medical image and the second medical image should be superimposed and a superimposition negative condition that is a condition under which the first medical image and the second medical image should not be superimposed. The generation unit generates a superimposed image by superimposing the first medical image and the second medical image according to a result of the determination. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram showing an example of the arrangement of a medical image processing system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a block diagram showing an example of the arrangement of a medical image processing apparatus according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a block diagram showing an example of the configuration of an operation terminal according to the embodiment. [Figure 4] 4 is a flowchart showing an example of the operation of the medical image processing apparatus according to the present embodiment. [Diagram 5] 11A to 11C are diagrams showing examples of overlapping positive conditions according to the embodiment; [Figure 6] 11A and 11B are diagrams showing examples of negative overlap conditions according to the embodiment; [Figure 7] 5A to 5C are diagrams showing an example of generation of a superimposed image according to the embodiment. [Figure 8] 4A to 4C are diagrams showing display examples of medical images according to the present embodiment. [Figure 9] FIG. 4 is a diagram showing an example of a layout of a display screen according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, a medical image processing apparatus, a medical image processing system, and a medical image processing method according to the embodiments will be described with reference to the drawings. In the following embodiments, parts with the same reference numerals perform the same operations, and duplicated descriptions will be omitted as appropriate.

[0009] 1 is a block diagram showing an example of the configuration of a medical image processing system 100 according to this embodiment. The medical image processing system 100 is a system that processes medical images related to a subject. The medical image processing system 100 includes, as its components, a medical image processing device 1, multiple operation terminals 2, a medical image generating device 3, and a medical image storage device 4. Each component is connected to each other so as to be able to communicate with each other via a bus (BUS) which is a common signal communication path.

[0010] The medical image processing apparatus 1 is an apparatus that processes medical images related to a subject. The medical image processing apparatus 1 functions as a server in the medical image processing system 100. The medical image processing apparatus 1 may be a workstation capable of executing high-speed information processing.

[0011] The operation terminal 2 is a terminal operated by an operator such as a doctor. The operation terminal 2 functions as a client in the medical image processing system 100. The operation terminal 2 may be a desktop PC, a notebook PC, a smartphone, a tablet terminal, or a wearable terminal.

[0012] The medical image generating device 3 is a device that generates medical images of a subject. The medical image generating device 3 may be a medical image diagnostic device (e.g., an X-ray diagnostic device, an X-ray CT device, an MRI device, an ultrasonic diagnostic device, or a nuclear medicine examination device). The medical image generating device 3 transmits the generated medical images to the medical image storage device 4. The medical image generating device 3 is an example of an image generating unit.

[0013] The medical image storage device 4 is a device that stores medical images related to a subject. The medical image storage device 4 may be a storage medium (e.g., a magnetic storage medium, an electromagnetic storage medium, an optical storage medium, or a semiconductor memory) or a drive device that reads and writes information to and from the storage medium. In particular, the medical image storage device 4 may be a PACS (Picture Archiving and Communications System) server. The medical image storage device 4 stores medical images transmitted from the medical image generating device 3. The medical image storage device 4 is an example of an image storage unit.

[0014] 2 is a block diagram showing an example of the configuration of a medical image processing apparatus 1 according to this embodiment. The medical image processing apparatus 1 includes, as its components, a processing circuit 11, a memory 12, and a communication IF 13. Each component is communicatively connected to each other via a bus (BUS) which is a common signal communication path.

[0015] The processing circuit 11 is a circuit that controls the overall operation of the medical image processing device 1. The processing circuit 11 includes at least one processor. The processor refers to circuits such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)). When the processor is a CPU, the CPU realizes each function by reading and executing each program stored in the memory 12. When the processor is an ASIC, each function is directly incorporated as a logic circuit in the circuit of the ASIC. The processor may be configured as a single circuit, or may be configured by combining multiple independent circuits with each other. The processing circuit 11 realizes each function (an acquisition function 111, a decision function 112, a specification function 113, a judgment function 114, a generation function 115, a display control function 116, and a system control function 117).

[0016] The acquisition function 111 is a function that acquires various data or information. For example, the acquisition function 111 acquires a plurality of medical images from the medical image storage device 4. At this time, the acquisition function 111 may acquire a DICOM (Digital Imaging and Communications in Medicine) file that includes the medical images and supplementary information (e.g., patient information, imaging information). Furthermore, the acquisition function 111 may acquire a first medical image indicating a first analysis result and a second medical image indicating a second analysis result different from the first analysis result. The acquisition function 111 is an example of an acquisition unit.

[0017] The determination function 112 is a function that determines various data or information. For example, the determination function 112 determines a combination of two medical images (a first medical image and a second medical image) to be processed from a plurality of medical images acquired by the acquisition function 111. The determination function 112 is an example of a determination unit.

[0018] The identification function 113 is a function for identifying various data or information. For example, the identification function 113 identifies a superimposition positive condition and a superimposition negative condition that are matched by the combination of the first medical image and the second medical image determined by the determination function 112. The identification function 113 is an example of an identification unit.

[0019] The determination function 114 is a function that performs determination regarding various conditions. For example, the determination function 114 calculates a superimposition recommendation level at which the first medical image and the second medical image determined by the determination function 112 should be superimposed, based on the superimposition positive condition and the superimposition negative condition identified by the identification function 113. When the superimposition recommendation level is equal to or greater than a threshold, the determination function 114 determines that the first medical image and the second medical image should be superimposed. Conversely, when the superimposition recommendation level is less than the threshold, the determination function 114 determines that the first medical image and the second medical image should not be superimposed. The determination function 114 is an example of a determination unit.

[0020] The generating function 115 is a function that generates various data or information. For example, the generating function 115 generates a superimposed image by superimposing the first medical image and the second medical image determined by the determining function 112 according to the result of the determination by the determining function 114. Specifically, when the determining function 114 determines that the first medical image and the second medical image should be superimposed, the generating function 115 superimposes the first medical image and the second medical image. Conversely, when the determining function 114 determines that the first medical image and the second medical image should not be superimposed, the generating function 115 does not superimpose the first medical image and the second medical image. The generating function 115 is an example of a generating unit.

[0021] The display control function 116 is a function that controls various displays. For example, the display control function 116 displays the superimposed image generated by the generation function 115 on the operation terminal 2. Alternatively, the display control function 116 displays the first medical image and the second medical image determined by the determination function 112 in parallel on the operation terminal 2. The display control function 116 is an example of a display control unit.

[0022] The system control function 117 is a function that controls various operations performed by the processing circuit 11. For example, the system control function 117 provides an operating system (OS) for the processing circuit 11 to realize each function (acquisition function 111, decision function 112, identification function 113, judgment function 114, generation function 115, and display control function 116). The system control function 117 is an example of a system control unit.

[0023] The memory 12 is a device that stores various data or information. The memory 12 may be a processor-readable storage medium (e.g., a magnetic storage medium, an electromagnetic storage medium, an optical storage medium, or a semiconductor memory), or may be a drive device that reads and writes data or information from and to the storage medium. The memory 12 stores each program that causes the processing circuit 11 to realize each function (acquisition function 111, decision function 112, identification function 113, judgment function 114, generation function 115, display control function 116, and system control function 117). The memory 12 is an example of a storage unit.

[0024] The communication IF 13 is an interface that communicates various data or information. For example, the communication IF 13 communicates various data or information between the operation terminal 2, the medical image generating device 3, or the medical image storage device 4. The communication IF 13 may communicate a DICOM file by DICOM communication. The communication IF 13 is an example of a communication unit.

[0025] 3 is a block diagram showing a configuration example of the operation terminal 2 according to this embodiment. The operation terminal 2 includes, as its components, a processing circuit 21, a memory 22, an input IF 23, a display 24, and a communication IF 25. Each component is communicatively connected to each other via a bus (BUS) which is a common signal communication path.

[0026] The processing circuitry 21 is a circuit that controls the overall operation of the operation terminal 2. The processing circuitry 21 of the operation terminal 2 has a hardware configuration similar to that of the processing circuitry 11 of the medical image processing device 1. The processing circuitry 21 realizes each function (an acquisition function 211, a display control function 212, and a system control function 213).

[0027] The acquisition function 211 acquires various data or information. For example, the acquisition function 211 acquires various data or information transmitted from the medical image processing apparatus 1. The acquisition function 211 is an example of an acquisition unit.

[0028] The display control function 212 is a function that controls various displays. For example, the display control function 212 displays various data or information acquired by the acquisition function 211 on the display 24. The display control function 212 is an example of a display control unit.

[0029] The system control function 213 is a function that controls various operations performed by the processing circuitry 21. For example, the system control function 213 provides an operating system (OS) for the processing circuitry 21 to realize each function (acquisition function 211, display control function 212). The system control function 213 is an example of a system control unit.

[0030] The memory 22 is a device that stores various data or information. The memory 22 of the operation terminal 2 has a hardware configuration similar to that of the memory 12 of the medical image processing device 1. The memory 22 stores each program that causes the processing circuitry 21 to realize each function (acquisition function 211, display control function 212, system control function 213). The memory 22 is an example of a storage unit.

[0031] The input IF 23 is an interface that accepts various operations from an operator. The input IF 23 converts the various operations accepted from the operator into electrical signals and transmits the electrical signals to the processing circuit 21. The input IF 23 may be a mouse, a keyboard, a button, a panel switch, a slider switch, a trackball, an operation panel, or a touch panel. The input IF 23 is an example of an input unit.

[0032] The display 24 is a device that displays various data or information. The display 24 may be a liquid crystal display, a plasma display, an organic EL display, or an LED display. The display 24 may be a touch panel display that also functions as the input IF 23. The display 24 is an example of a display unit.

[0033] The communication IF 25 is an interface that communicates various data or information. For example, the communication IF 25 communicates various data or information with the medical image processing device 1. The communication IF 25 may communicate a DICOM file by DICOM communication. The communication IF 25 is an example of a communication unit.

[0034] 4 is a flowchart showing an example of the operation of the medical image processing apparatus 1 according to this embodiment. This example of the operation may be started in response to an instruction from an operator, or may be started in a situation where photographed or analyzed medical images of a subject are sequentially added to the medical image storage device 4.

[0035] (Step S1) First, the medical image processing device 1 acquires a plurality of medical images. Specifically, the medical image processing device 1 acquires a plurality of medical images from the medical image storage device 4 by the acquisition function 111. The medical image processing device 1 may perform various image analyses (e.g., classification, detection, segmentation) on the acquired plurality of medical images. As a result, the analysis results are associated with each of the plurality of medical images.

[0036] (Step S2) Next, the medical image processing apparatus 1 determines a combination of two medical images. Specifically, the medical image processing apparatus 1 determines a combination of two medical images (a first medical image, a second medical image) to be processed from among the multiple medical images acquired in step S1, by using the determination function 112. The determination function 112 determines a different combination each time step S2 is executed. The determination function 112 may determine a specific combination to be processed in response to an instruction from an operator.

[0037] (Step S3) Next, the medical image processing apparatus 1 identifies the superimposition positive condition that the combination matches. Specifically, the medical image processing apparatus 1 uses the identification function 113 to identify the superimposition positive condition that the combination determined in step S2 matches (see FIG. 5).

[0038] (Step S4) Next, the medical image processing apparatus 1 identifies the superimposition negation conditions that the combination matches. Specifically, the medical image processing apparatus 1 identifies the superimposition negation conditions that the combination determined in step S2 matches, using the identification function 113. Step S4 may be executed before step S3 (see FIG. 6).

[0039] (Step S5) Next, the medical image processing apparatus 1 calculates the superimposition recommendation level. Specifically, the medical image processing apparatus 1 calculates the superimposition recommendation level for superimposing the first medical image and the second medical image determined in step S2, based on the superimposition positive condition and the superimposition negative condition identified in steps S3 and S4, using the determination function 114. The determination function 114 calculates the superimposition recommendation level based on the score related to the superimposition positive condition and the score related to the superimposition negative condition.

[0040] For example, the determination function 114 calculates the superimposition recommendation level by adding the score related to the positive superimposition condition and the score related to the negative superimposition condition. The determination function 114 may multiply the former score and the latter score by different weights, respectively, and then add the former score and the latter score.

[0041] (Step S6) Here, the medical image processing device 1 judges whether the superimposition recommendation level is equal to or higher than a threshold. Specifically, the medical image processing device 1 judges, by the judgment function 114, whether the superimposition recommendation level calculated in step S5 is equal to or higher than a threshold. The threshold is set to an arbitrary value (e.g., a positive value) by the operator. If the superimposition recommendation level is equal to or higher than the threshold (step S6-YES), the process proceeds to step S7. If the superimposition recommendation level is less than the threshold (step S6-NO), the process proceeds to step S8B.

[0042] (Step S7) In this case, the medical image processing device 1 generates a superimposed image. Specifically, the medical image processing device 1 generates the superimposed image by superimposing the first medical image and the second medical image determined in step S2 using the generation function 115 (see FIG. 7).

[0043] (Step S8A) Next, the medical image processing device 1 displays the superimposed image. Specifically, the medical image processing device 1 displays the superimposed image generated in step S7 on the display 24 of the operation terminal 2 by the display control function 116. At this time, the display control function 116 transmits the generated superimposed image to the operation terminal 2. The operation terminal 2 acquires the transmitted superimposed image by the acquisition function 211. The operation terminal 2 displays the acquired superimposed image on the display 24 by the display control function 212. After step S8A, the process proceeds to step S9 (see FIGS. 8 and 9).

[0044] (Step S8B) In this case, the medical image processing device 1 displays two medical images in parallel. Specifically, the medical image processing device 1 uses the display control function 116 to display the two medical images (first medical image, second medical image) determined in step S2 in parallel on the display 24 of the operation terminal 2. At this time, the display control function 116 transmits the two medical images to the operation terminal 2. The operation terminal 2 acquires the two transmitted medical images using the acquisition function 211. The operation terminal 2 uses the display control function 212 to display the two acquired medical images in parallel on the display 24. After step S8B, the process proceeds to step S9 (see FIGS. 8 and 9).

[0045] (Step S9) Here, the medical image processing apparatus 1 judges whether or not to process another combination. Specifically, the medical image processing apparatus 1 judges by the judgment function 114 whether or not to process another combination of two medical images different from the two medical images processed from step S2 to S8A or S8B. If another combination is to be processed (step S9-YES), the processing returns to step S2. If another combination is not to be processed (step S9-NO), the medical image processing apparatus 1 ends the series of operations.

[0046] FIG. 5 is a diagram showing an example of a superimposition positive condition according to this embodiment. According to this example, a table 200 is stored in the memory 12 and stores a plurality of superimposition positive conditions. Each of the plurality of superimposition positive conditions is associated with a unique number (#) and a unique score. The number and score can be set to any value by the operator. The medical image processing apparatus 1 refers to the table 200 and identifies which superimposition positive condition a combination of two medical images matches.

[0047] The superimposition positive condition for the number "1-1" in the table 200 is the first medical image "CT image", the first analysis result "blood flow dynamics", the second medical image "CT image", and the second analysis result "abnormal blood flow region". In other words, this superimposition positive condition means that the first medical image is a "CT image" showing "blood flow dynamics", and the second medical image is a "CT image" showing "abnormal blood flow region". In this case, the first medical image may be a CT perfusion image that visualizes the blood flow dynamics of the subject's organ, and the second medical image may be a CT image that visualizes the lesion region of this organ (e.g., bleeding region, ischemic region, hematoma region). A score of "1.0" is associated with this superimposition positive condition.

[0048] The superimposition positive condition for the number "1-2" in the table 200 is the first medical image "MR image", the first analysis result "blood flow dynamics", the second medical image "MR image", and the second analysis result "abnormal blood flow region". In other words, this superimposition positive condition means that the first medical image is an "MR image" showing "blood flow dynamics", and the second medical image is an "MR image" showing "abnormal blood flow region". In this case, the first medical image may be an MR perfusion image that visualizes the blood flow dynamics of the subject's organ, and the second medical image may be an MR image that visualizes the diseased region of this organ. A score of "1.0" is associated with this superimposition positive condition.

[0049] The superposition positive conditions for numbers "1-1" and "1-2" are useful when an operator uses two medical images belonging to the same image type to diagnose the function of a subject's organ. In other words, the superimposed image in which these two medical images are superimposed meets the specific diagnostic purpose of "functional diagnosis of an organ."

[0050] The superimposition positive condition for the number "2-1" in the table 200 is the first medical image "CT image", the first analysis result "abnormal blood flow region A", the second medical image "CT image", and the second analysis result "abnormal blood flow region B". In other words, this superimposition positive condition means that the first medical image is a "CT image" showing the "abnormal blood flow region A", and the second medical image is a "CT image" showing the "abnormal blood flow region B". In this case, the first medical image may be a CT image of a first lesion region of an organ of a subject, and the second medical image may be a CT image of a second lesion region of the organ. A score of "1.0" is associated with this superimposition positive condition.

[0051] The superimposition positive condition for the number "2-2" in the table 200 is the first medical image "MR image", the first analysis result "abnormal blood flow region A", the second medical image "MR image", and the second analysis result "abnormal blood flow region B". In other words, this superimposition positive condition means that the first medical image is an "MR image" showing the "abnormal blood flow region A", and the second medical image is an "MR image" showing the "abnormal blood flow region B". In this case, the first medical image may be an MR image of a first lesion region of an organ of a subject, and the second medical image may be an MR image of a second lesion region of the organ. A score of "1.0" is associated with this superimposition positive condition.

[0052] The superposition positive conditions related to numbers "2-1" and "2-2" are useful when an operator diagnoses the positions of two lesion areas in a subject's organ using two medical images belonging to the same image type. In other words, the superimposed image in which these two medical images are superimposed meets the specific diagnostic purpose of "diagnosing the positions of multiple lesion areas."

[0053] The superimposition positive condition for the number "3-1" in the table 200 is the first medical image "CT image", the first analysis result "abnormal blood flow area", the second medical image "MR image", and the second analysis result "whole area". In other words, this superimposition positive condition means that the first medical image is a "CT image" showing the "abnormal blood flow area", and the second medical image is an "MR image" showing the "whole area". In this case, the first medical image may be a "CT image" that images the diseased area of ​​the subject's organ, and the second medical image may be an "MR image" that images the whole area of ​​this organ. A score of "1.0" is associated with this superimposition positive condition.

[0054] The superimposition positive condition for the number "3-2" in the table 200 is the first medical image "MR image", the first analysis result "abnormal blood flow area", the second medical image "CT image", and the second analysis result "whole area". In other words, this superimposition positive condition means that the first medical image is an "MR image" showing the "abnormal blood flow area", and the second medical image is a "CT image" showing the "whole area". In this case, the first medical image may be an "MR image" that images the diseased area of ​​the subject's organ, and the second medical image may be a "CT image" that images the whole area of ​​this organ. A score of "1.0" is associated with this superimposition positive condition.

[0055] The superposition positive conditions of numbers "3-1" and "3-2" are useful when an operator uses two medical images belonging to different image types to diagnose the position of a lesion area in the entire area of ​​a subject's organ. In other words, the superimposed image in which these two medical images are superimposed meets the specific diagnostic purpose of "diagnosing the position of a lesion area."

[0056] Note that multiple positive superimposition conditions similar to those described above may be stored in the table 200 for other types of images (e.g., plain X-ray images, ultrasound images, nuclear medicine images) other than CT images or MR images. Of course, a unique number and a unique score may be defined for each of the multiple positive superimposition conditions.

[0057] Furthermore, the superposition positive condition may include a case where the first medical image and the second medical image are images taken within a predetermined time range from the time when an adverse event occurred in the subject. For example, assume that an adverse event such as cerebral hemorrhage occurs in the subject. In this case, the first medical image and the second medical image may be contrast images taken within 4 hours from the time when the adverse event occurred. This superposition positive condition is suitable for a specific diagnostic purpose of "diagnosis of acute cerebral hemorrhage."

[0058] In addition, the superimposition positive condition may include a case where the first medical image and the second medical image are images belonging to the same contrast phase (e.g., pre-contrast, early phase, middle phase, late phase). This superimposition positive condition meets the specific diagnostic purpose of "diagnosis for the same contrast phase."

[0059] FIG. 6 is a diagram showing an example of a negative superimposition condition according to this embodiment. According to this example, a table 300 is stored in the memory 12 and stores a plurality of negative superimposition conditions. Each of the plurality of negative superimposition conditions is associated with a unique number (#) and a unique score. The number and score can be set to any value by the operator. The medical image processing apparatus 1 refers to the table 300 and identifies which negative superimposition condition a combination of two medical images matches.

[0060] The superimposition negation condition associated with number "1-1" in table 300 is the first medical image "CT image", the first incidental information "resolution A", the second medical image "CT image", and the second incidental information "resolution A". In other words, this superimposition negation condition means that the first medical image and the second medical image are "CT images" having "resolution A". The value of "resolution A" may be any value that is not suitable for medical diagnosis (i.e., a value that is not equal to or greater than a predetermined standard). A score of "-5.0" is associated with this superimposition negation condition.

[0061] The superimposition negation condition associated with number "1-2" in table 300 is the first medical image "MR image", the first incidental information "resolution A", the second medical image "MR image", and the second incidental information "resolution A". In other words, this superimposition negation condition means that the first medical image and the second medical image are "MR images" having "resolution A". The value of "resolution A" may be any value that is not suitable for medical diagnosis. A score of "-5.0" is associated with this superimposition negation condition.

[0062] The superimposition denial conditions related to the numbers "1-1" and "1-2" are useful when an operator wants to perform image diagnosis with high accuracy using two medical images belonging to the same image type. A superimposed image in which two low-resolution medical images are superimposed impairs the visibility of the image itself. Therefore, due to both superimposition denial conditions, the medical image processing device 1 is controlled not to generate a superimposed image when the resolution of the two medical images is equal to or lower than a predetermined resolution.

[0063] The superimposition negation condition for number "2-1" in table 300 is the first medical image "CT image", the first incidental information "analysis result A = image area F1; analysis result B = image area F1", the second medical image "CT image", and the second incidental information "analysis result C = image area F2". In other words, this superimposition negation condition means that the image area F1 in the first medical image contains multiple analysis results (analysis result A, analysis result B), and the image area F2 in the second medical image contains one analysis result (analysis result C). It is assumed that the image area F1 and the image area F2 correspond to each other. A score of "-5.0" is associated with this superimposition negation condition.

[0064] The superimposition negation condition for number "2-2" in table 300 is the first medical image "MR image", the first incidental information "analysis result A = image area F1; analysis result B = image area F1", the second medical image "MR image", and the second incidental information "analysis result C = image area F2". In other words, this superimposition negation condition means that the image area F1 in the first medical image contains multiple analysis results (analysis result A, analysis result B), and the image area F2 in the second medical image contains one analysis result (analysis result C). It is assumed that the image area F1 and the image area F2 correspond to each other. A score of "-5.0" is associated with this superimposition negation condition.

[0065] The superimposition denial conditions related to the numbers "2-1" and "2-2" are useful when an operator wants to perform image diagnosis with high accuracy using two medical images belonging to the same image type. A superimposed image that contains more analysis results than necessary in the same image area impairs its own visibility. Therefore, due to both superimposition denial conditions, the medical image processing device 1 is controlled not to generate a superimposed image when three or more analysis results are included in the same image area in the superimposed image.

[0066] Note that multiple overlap negation conditions similar to those described above may be stored in the table 300 for other image types (e.g., plain X-ray images, ultrasound images, nuclear medicine images) other than CT images or MR images. Of course, a unique number and a unique score may be defined for each of the multiple overlap negation conditions.

[0067] Here, it is assumed that two medical images match the positive superimposition condition "1-1" in the table 200 of FIG. 5 and the negative superimposition condition "1-1" in the table 300 of FIG. 6. In this case, the superimposition recommendation level for superimposing the two medical images is calculated as "1.0 + (-5.0) = -4.0". If the threshold for the superimposition recommendation level is a "positive value", this superimposition recommendation level is a "negative value", and does not satisfy the threshold. As a result, the two medical images are displayed side by side without being superimposed. Note that a list of the positive superimposition conditions and negative superimposition conditions that the two medical images match may be displayed.

[0068] 7 is a diagram showing an example of generation of a superimposed image 400 according to this embodiment. According to this example, the superimposed image 400 includes a first medical image 410 and a second medical image 420. The first medical image 410 is a CT image showing the running state of blood vessels in the brain region of a subject. The second medical image 420 is a CT image including a predetermined analysis result (not shown).

[0069] When the superimposition recommendation degree for the first medical image 410 and the second medical image 420 is equal to or greater than a threshold, the medical image processing device 1 generates a superimposed image 400 by superimposing the first medical image 410 and the second medical image 420. For example, the medical image processing device 1 changes the shape of the second medical image 420 in accordance with the shooting direction of the first medical image 410, and then generates the superimposed image 400. In this example, the second medical image 420 is rotated and superimposed on the first medical image 410.

[0070] The medical image processing device 1 may superimpose two two-dimensional images (2D-2D), may superimpose a two-dimensional image and a three-dimensional image (2D-3D), or may superimpose a two-dimensional image and a four-dimensional image (2D-4D). A known method may be applied to align the two medical images.

[0071] 8 is a diagram showing a display example of a medical image according to this embodiment. According to this example, an operation area 500 is arranged adjacent to a superimposed image 400. The operation area 500 includes a slider bar 510 and a slider 515 as widgets that can be operated by the operator.

[0072] The slider bar 510 is a bar that indicates the position (e.g., slice position) of each medical image included in a series of medical images (e.g., slice images). The slider bar 510 indicates the position of each medical image from the "0"th medical image to the "100"th medical image. A slider 515 arranged on the slider bar 510 indicates the position of the medical image currently being displayed. In this example, the slider 515 indicates that the superimposed image 400 is being displayed as the "80th" medical image. When the operator moves the slider 515 on the slider bar 510, the medical image at the position of the slider 515 after the movement is displayed in place of the superimposed image 400.

[0073] As shown in FIG. 8(A), a superimposed image 400 and an operation area 500 in an initial state are displayed. Here, it is assumed that a predetermined image analysis (first image analysis) is performed on the "20th" medical image to the "60th" medical image. In this case, the medical image processing device 1 acquires a plurality of medical images (first medical images) including an analysis result (first analysis result) by this image analysis. As shown in FIG. 8(B), a box 520 is displayed at a position of a slider bar 510 corresponding to the positions of the acquired plurality of medical images. In this example, the box 520 is disposed below the slider bar 510.

[0074] Here, it is assumed that a different image analysis (second image analysis) is performed on the "30th" medical image to the "40th" medical image. In this case, the medical image processing device 1 acquires a plurality of medical images (second medical images) including the analysis results (second analysis results) from this image analysis. The medical image processing device 1 determines whether or not the above-mentioned first medical image and second medical image acquired for each of the "30th" medical image to the "40th" medical image should be superimposed.

[0075] When it is determined that the first medical image and the second medical image should be superimposed, the medical image processing apparatus 1 generates a superimposed image by superimposing the first medical image and the second medical image. As shown in FIG. 8(C), a box 530 is displayed at a position of the slider bar 510 corresponding to the position of the generated superimposed image. In this example, the box 530 is disposed below the slider bar 510 and above the box 520. Note that when the operator moves the slider 515 to the position of the box 530, the superimposed image at the position of the slider 515 after the movement is displayed instead of the superimposed image 400.

[0076] On the other hand, if it is determined that the first medical image and the second medical image should not be superimposed, the medical image processing apparatus 1 does not superimpose the first medical image and the second medical image. Instead, as shown in FIG. 8(D), a box 540 indicating the position of the second medical image is displayed adjacent to the position of the slider bar 510 corresponding to the position of the first medical image. When the operator moves the slider 515 to a position on the slider bar 510 adjacent to the box 540, the first medical image and the second medical image at the position of the slider 515 after the movement are displayed side by side instead of the superimposed image 400.

[0077] Fig. 9 is a diagram showing an example of the layout of a display screen 600 according to this embodiment. As shown in Fig. 9(A), in an initial state, the display screen 600 includes a tab 611, a display area 620A, and a display area 620B. The display areas 620A and 620B are associated with the tab 611.

[0078] The medical image processing apparatus 1 may arrange a superimposed image obtained by superimposing the first medical image and the second medical image in the display area 620A or 620B. Alternatively, the medical image processing apparatus 1 may display the first medical image and the second medical image in parallel by arranging them in the display areas 620A and 620B, respectively.

[0079] Here, it is assumed that the medical image processing device 1 processes the first medical image and the second medical image related to another combination. In this case, the medical image processing device 1 determines whether or not the first medical image and the second medical image related to the other combination should be superimposed.

[0080] As shown in FIG. 9(B), when processing another combination, the medical image processing apparatus 1 generates a tab 612 adjacent to the tab 611. When the operator selects the tab 612, display areas 620C and 620D corresponding to the tab 612 are displayed. The medical image processing apparatus 1 may arrange a superimposed image obtained by superimposing the first medical image and the second medical image relating to the other combination in the display area 620C or 620D. Alternatively, the medical image processing apparatus 1 may display the first medical image and the second medical image relating to the other combination in parallel by arranging them in the display areas 620C and 620D, respectively.

[0081] Each time the medical image processing apparatus 1 processes another combination, a new tab is generated in sequence. A plurality of display areas are associated with the generated tab. The medical image processing apparatus 1 may display two medical images relating to another combination in a superimposed manner in one of the plurality of display areas, or may display them in parallel in the plurality of display areas.

[0082] The medical image processing system 100 and the medical image processing device 1 according to this embodiment have been described above. According to this embodiment, the medical image processing device 1 determines whether or not two medical images should be superimposed based on the superimposition affirmative condition and the superimposition negative condition. This allows the medical image processing device 1 to generate a superimposed image that is suitable for a specific diagnostic purpose and has high visibility. Meanwhile, the operator can easily recognize multiple analysis results in the superimposed image. Furthermore, since the operator does not need to check multiple analysis results individually, the interpretation time is shortened.

[0083] According to at least one of the embodiments described above, a superimposed image with high diagnostic capability can be provided.

[0084] Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0085] 1 Medical image processing device 2 Operation terminal 3 Medical image generation equipment 4 Medical image storage device 11,21 Processing circuit 12,22 Memory 13,25 Communication IF 23 Input IF 24 Display 100 Medical image processing system 111,211 Acquisition function 112 Decision function 113 Specific Functions 114 Judgment function 115 Generation function 116,212 Display control function 117,213 System Control Functions 200,300 tables 400 Overlaid Images 410 Medical Imaging No. 1 420 Secondary Medical Images 500 operation area 510 Slider Bar 515 Slider 520,530,540 Boxes 600 display screen 611,612 tabs 620A,620B,620C,620D display area

Claims

1. An acquisition unit that acquires a first medical image showing the first analysis result and a second medical image showing a second analysis result different from the first analysis result, A determination unit that determines whether the first medical image and the second medical image should be superimposed based on superposition affirmative conditions, which are suitable conditions for superimposing the first medical image and the second medical image, and superposition negative conditions, which are unsuitable conditions for superimposing the first medical image and the second medical image. A generation unit generates a superimposed image by superimposing the first medical image and the second medical image according to the result of the above determination, A medical image processing device equipped with the following features.

2. The determination unit makes the determination based on the first superimposition affirmative condition, which is one of the superimposition affirmative conditions, in which the combination of the first medical image and the second medical image matches, and the first superimposition negative condition, which is one of the superimposition negative conditions, in which the combination matches. The medical image processing apparatus according to claim 1.

3. The determination unit calculates a superposition recommendation score, which is the degree to which the first medical image and the second medical image should be superimposed, based on the score related to the first superposition affirmative condition and the score related to the first superposition negative condition. If the superposition recommendation score is equal to or greater than a threshold, the determination unit determines that the first medical image and the second medical image should be superimposed. The medical image processing apparatus according to claim 2.

4. The superposition affirmation condition includes the case where the first medical image is an image showing the dynamics of blood flow in an organ as a result of the first analysis, and the second medical image is an image showing an abnormal region of blood flow in the organ as a result of the second analysis. The medical image processing apparatus according to claim 1.

5. The superposition affirmation condition includes the case where the first medical image is an image showing a first abnormal region of blood flow in the organ as a result of the first analysis, and the second medical image is an image showing a second abnormal region of blood flow in the organ as a result of the second analysis. The medical image processing apparatus according to claim 1.

6. The superposition affirmation condition includes the case where the first medical image is an image belonging to a first image type that shows an abnormal region of an organ as a result of the first analysis, and the second medical image is an image belonging to a second image type that shows the entire region of the organ as a result of the second analysis. The medical image processing apparatus according to claim 1.

7. The superposition affirmation condition includes the case where the first medical image and the second medical image were taken within a predetermined time range from the time of occurrence of the adverse event in the subject. The medical image processing apparatus according to claim 1.

8. The superposition rejection condition includes the case where at least one of the resolutions of the first medical image and the second medical image is not equal to or greater than a predetermined standard. The medical image processing apparatus according to claim 1.

9. The superposition denial condition includes the case where a first image region in the first medical image contains multiple analysis results, and a second image region corresponding to the first image region in the second medical image contains at least one analysis result. The medical image processing apparatus according to claim 1.

10. The system further comprises a display control unit that displays the superimposed image on a display unit, The medical image processing apparatus according to claim 1.

11. If the display control unit determines that the first medical image and the second medical image should not be superimposed, it displays the first medical image and the second medical image side by side on the display unit. The medical image processing apparatus according to claim 10.

12. The display control unit displays a box indicating the position of the superimposed image relative to the position of the slider bar corresponding to the position of the superimposed image. The medical image processing apparatus according to claim 10.

13. If the display control unit determines that the first medical image and the second medical image should not be superimposed, it displays a box indicating the position of the second medical image adjacent to the position of the slider bar corresponding to the position of the first medical image. The medical image processing apparatus according to claim 10.

14. A medical image processing system comprising a medical image processing device and an operating terminal, The aforementioned medical image processing device is An acquisition unit that acquires a first medical image showing the first analysis result and a second medical image showing a second analysis result different from the first analysis result, A determination unit that determines whether the first medical image and the second medical image should be superimposed based on superposition affirmative conditions, which are suitable conditions for superimposing the first medical image and the second medical image, and superposition negative conditions, which are unsuitable conditions for superimposing the first medical image and the second medical image. A generation unit generates a superimposed image by superimposing the first medical image and the second medical image according to the result of the above determination, It is equipped with, The operating terminal displays the superimposed image generated by the medical image processing device. Medical image processing system.

15. The method involves obtaining a first medical image showing the first analysis result and a second medical image showing a second analysis result different from the first analysis result, Based on superposition affirmative conditions, which are suitable conditions for superimposing the first medical image and the second medical image, and superposition negative conditions, which are unsuitable conditions for superimposing the first medical image and the second medical image, a determination is made as to whether or not the first medical image and the second medical image should be superimposed. Depending on the result of the determination, a superimposed image is generated by superimposing the first medical image and the second medical image. A medical image processing method comprising the following:

Images