Medical information processing device, medical information processing method, and medical information processing program

Abstract

To reduce the complexity of following up on lesions in each specific area. [Solution] The medical information processing device according to this embodiment comprises an extraction unit, a setting unit, a generation unit, and a display control unit. The extraction unit extracts the hierarchical structure of an organ from a medical image representing the organ, each having a region. The setting unit sets index values ​​related to lesions in the organ according to the hierarchical structure. The generation unit generates a display image that displays the index values ​​related to lesions in each region, based on the hierarchical structure and the index values. The display control unit displays the display image on a display.

Description

Technical Field

[0001] The embodiments disclosed in this specification and the drawings relate to a medical information processing apparatus, a medical information processing method, and a medical information processing program.

Background Art

[0002] Generally, the radiography of the lungs is performed by dividing the lungs into a plurality of regions based on a medical image representing the lungs. For example, the radiography of the right lung is performed by dividing it into three regions: the upper lobe having regions S1 to S3, the middle lobe having regions S4 to S5, and the lower lobe having regions S6 to S10. Also, the radiography of the left lung is performed by dividing it into two regions: the upper lobe having regions S1 to S5 and the lower lobe having regions S6, S8 to S10. Also, the treatment for the lesions detected by the radiography of the lungs is also performed for each region. Each region of the lungs has a function (lung function) of performing gas exchange between oxygen and carbon dioxide.

[0003] However, since the number of lesions in the lungs is large, there is a disadvantage that follow-up such as tracking and / or observation of the lesions for each region is complicated. This is the same not only for the lungs but also for the liver including a plurality of regions having a plurality of regions. For example, the radiography of the liver is performed by dividing the liver into three regions based on a medical image representing the liver. For example, the radiography of the liver is performed by dividing it into three regions of the liver: the caudate lobe having region S1, the left lobe having regions S2 to S4, and the right lobe having regions S5 to S8. Also, the treatment for the lesions detected by the radiography of the liver is also performed for each region. Each region of the liver has a function (liver function) of performing metabolism, detoxification, bile production and secretion, etc. That is, organs having a plurality of regions with the same function, such as the lungs and the liver, have the same disadvantage.

[0004] Therefore, it is desirable to reduce the complexity of follow-up for the lesions for each region.

Prior Art Documents

Patent Documents

[0005] [Patent Document 1] Patent No. 4931027 [Overview of the project] [Problems that the invention aims to solve]

[0006] One of the problems that the embodiments disclosed herein and in the drawings aim to solve is to reduce the complexity of following up on lesions in each region. However, the problems that the embodiments disclosed herein and in the drawings aim to solve are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0007] The medical information processing device according to this embodiment comprises an extraction unit, a setting unit, a generation unit, and a display control unit. The extraction unit extracts the hierarchical structure of an organ from a medical image representing the organ, each having its own region. The setting unit sets index values ​​related to lesions in the organ according to the hierarchical structure. The generation unit generates a display image that displays the index values ​​related to lesions in each region, based on the hierarchical structure and the index values. The display control unit displays the display image on a display. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a block diagram showing a medical information processing system equipped with a medical information processing device according to the first embodiment. [Figure 2] Figure 2 is a block diagram showing the details of the medical information processing device shown in Figure 1. [Figure 3] Figure 3 is a flowchart illustrating an example of operation in the first embodiment. [Figure 4] Figure 4 is a schematic diagram of the lungs to illustrate the operation in the first embodiment. [Figure 5] Figure 5 is a schematic diagram of the hierarchical structure of the lung shown in Figure 4. [Figure 6]Figure 6 is a schematic diagram illustrating the operation in the first embodiment. [Figure 7] Figure 7 is a schematic diagram illustrating the operation in the first embodiment. [Figure 8] Figure 8 is a schematic diagram illustrating the operation in the first embodiment. [Figure 9] Figure 9 is a schematic diagram illustrating the operation in the first embodiment. [Figure 10] Figure 10 is a schematic diagram of a medical image illustrating a first modified example of the first embodiment. [Figure 11] Figure 11 is a schematic diagram of a medical image illustrating a first modified example of the first embodiment. [Figure 12] Figure 12 is a schematic diagram of a medical image illustrating a first modified example of the first embodiment. [Figure 13] Figure 13 is a schematic diagram of a medical image illustrating a first modified example of the first embodiment. [Figure 14] Figure 14 is a schematic diagram of a display screen illustrating a second modified example of the first embodiment. [Figure 15] Figure 15 is a schematic diagram of a display screen illustrating the second embodiment. [Figure 16] Figure 16 is a schematic diagram of a display screen illustrating the third embodiment. [Figure 17] Figure 17 is a schematic diagram of a display screen illustrating a first modified example of the third embodiment. [Figure 18] Figure 18 is a schematic diagram of a display screen illustrating a second modified example of the third embodiment. [Figure 19] Figure 19 is a schematic diagram of the display screen illustrating the fourth embodiment. [Figure 20] Figure 20 is a schematic diagram of a display screen illustrating the first modified example of the fourth embodiment. [Figure 21] Figure 21 is a schematic diagram of a display screen illustrating a second modified example of the fourth embodiment. [Modes for carrying out the invention]

[0009] Hereinafter, a medical information processing apparatus, a medical information processing method, and a medical information processing program according to each embodiment will be described while referring to the drawings. In the following embodiments, portions denoted by the same reference numerals perform the same operations, and duplicate descriptions will be omitted as appropriate.

[0010] <First Embodiment> FIG. 1 is a block diagram showing a medical information processing system including a medical information processing apparatus according to the first embodiment. The medical information processing system includes a medical information processing apparatus 1, an image server 2, an electronic medical record system 3, a medical information management application 4, and a report creation apparatus 5. The medical information processing apparatus 1, the image server 2, the electronic medical record system 3, the medical information management application 4, and the report creation apparatus 5 are connected via a network.

[0011] The medical information processing apparatus 1 receives an input of findings information from a user who is a medical staff such as a radiologist, and generates information for input to a report such as a radiology report. Details of the medical information processing apparatus 1 will be described later with reference to FIG. 2.

[0012] The image server 2 is, for example, a PACS (Picture Archiving and Communication System), and is a system that stores medical image data and manages the stored medical image data. The image server 2 stores and manages medical image data converted in accordance with, for example, the DICOM (Digital Imaging and Communication Medicine) standard.

[0013] Electronic medical record system 3 is a system that stores and manages electronic medical record data, including patient identification information and medical information linked to patient identification information. Medical information includes information related to electronic medical records, such as findings, disease name information, vital signs information, examination stage information, clinical pathways, and treatment details. Patient identification information includes, for example, patient ID, patient name, gender, and age. Clinical pathways represent standard treatment plans in chronological order.

[0014] Medical information management application 4 is an application that can integrate and manage medical information such as treatment information and test information related to patients over time, and can share medical information among multiple doctors, or among users represented by healthcare professionals such as doctors, technicians, and nurses.

[0015] The report generation device 5 is a device for creating a radiology interpretation report by a radiologist. In this embodiment, the radiology interpretation report is generated using information transferred from the medical information processing device 1.

[0016] The network is, for example, a hospital network. The network can be wired or wireless. Furthermore, the connection is not limited to the hospital network, as long as security is ensured. For example, it is acceptable to connect to public communication lines such as the internet via a VPN (Virtual Private Network).

[0017] In this embodiment, the medical information processing device 1 is assumed to be installed as a viewer on a diagnostic PC or workstation, but it is not limited to this and may also be installed on a report creation device 5.

[0018] Next, the details of the medical information processing device 1 will be explained with reference to the block diagram in Figure 2.

[0019] The medical information processing device 1 shown in Figure 2 includes a processing circuit 10, a memory 11, an input interface 12, a communication interface 13, and a display 14. The processing circuit 10, the memory 11, the input interface 12, the communication interface 13, and the display 14 are connected to each other in a way that allows them to communicate with one another, for example, via a bus.

[0020] The processing circuit 10 is a processor that functions as the central part of the medical information processing device 1. The processing circuit 10 is a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The processing circuit 10 includes an acquisition function 101, an extraction function 102, a setting function 103, a generation function 104, and a display control function 105.

[0021] The acquisition function 101 acquires medical images representing organs with their respective regions. Medical images of the subject's organs include, for example, X-ray images, CT images, MR images, ultrasound images, PET (Positron Emission Tomography) images, SPECT (Single Photon Emission Computed Tomography) images, or combinations thereof, and are generally assumed to be images that can be acquired by the medical information processing device 1. Note that the medical images in this embodiment are three-dimensional medical images. The acquisition function 101 is an example of an acquisition unit.

[0022] The extraction function 102 extracts the hierarchical structure of organs from medical images representing organs with distinct regions. The extraction function 102 is an example of an extraction unit.

[0023] The setting function 103 sets index values ​​for organ lesions according to the hierarchical structure. For example, the setting function 103 may set index values ​​for higher levels of the hierarchy based on index values ​​set for lower levels that are relatively lower in the hierarchical structure. Specifically, for example, the setting function 103 may accumulate the index values ​​of the lower levels and set the resulting accumulated value as the index value for the higher level. As index values ​​for lesions, numerical values ​​such as the number of lesions, probability, and severity, or strings representing lesion names, findings names, etc., can be used as appropriate. Probabilities are normalized and may include future lesion risk, such as the probability of developing cancer. Probabilities may also include the normal percentage of lungs that function normally or the lesion percentage that does not function normally, such as the ratio of current lung capacity to lung capacity when healthy. Severity may include guideline-based values, such as the degree of invasion. The numerical values ​​of the index values ​​may be accumulated values ​​obtained by accumulating the index values ​​of the lower levels for each branch, or they may be ratios representing the normal percentage or lesion percentage for each branch. Furthermore, the setting function 103 may calculate and set the index value using the processing circuit 10, or it may set the index value entered by the user. For example, if a lesion is detected by CAD (computer-aided diagnosis), the setting function 103 calculates and sets the index value. Also, for example, if a lesion is interpreted by a radiologist, the setting function 103 sets the index value entered by the radiologist. Note that both cases of lesion detection by CAD and lesion interpretation by a radiologist may be mixed. The setting function 103 is an example of a setting unit.

[0024] The generation function 104 generates a display image that shows the index values ​​for lesions in each region based on the hierarchical structure and the index values. For example, the generation function 104 may generate a display image by arranging text indicating each level of the hierarchical structure according to the relationship between lower and upper levels, and associating the index values ​​of each level with the arranged text. The display image only needs to represent at least two levels of the hierarchical structure, such as the right lung and the upper lobe, and does not necessarily need to represent three or more levels. The generation function 104 is an example of a generation unit.

[0025] The display control function 105 causes the display image to be displayed on the display 14. The display control function 105 is an example of a display control unit.

[0026] Memory 11 is a storage device such as ROM (Read Only Memory), RAM (Random Access Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), and integrated circuit storage device that stores various types of information. Memory 11 may also be a drive device that reads and writes various types of information to and from portable storage media such as CD-ROM drives, DVD drives, and flash memory. Note that memory 11 does not necessarily have to be implemented by a single storage device. For example, memory 11 may be implemented by multiple storage devices. Furthermore, memory 11 may be located in another computer connected to the medical information processing device 1 via a network.

[0027] Memory 11 stores medical images of the subject, a medical information processing program according to this embodiment, and the like. This medical information processing program may, for example, be pre-stored in memory 11. Alternatively, it may be stored and distributed on a non-transient, computer-readable storage medium, and then read from the non-transient storage medium and installed in memory 11. The medical information processing program is executed by the processing circuit 10 and causes the computer to implement an acquisition function 101, an extraction function 102, a setting function 103, a generation function 104, and a display control function 105. However, the medical information processing program does not necessarily need to include the acquisition function 101 or the display control function 105. For example, the acquisition function 101 and the display control function 105 may be implemented by other programs.

[0028] The input interface 12 receives various input operations from the user, converts the received input operations into electrical signals, and outputs them to the processing circuit 10. In this embodiment, the input interface 12 is connected to input devices such as a mouse, keyboard, trackball, switch, button, joystick, touchpad, and touch panel, where instructions are input by touching the operating surface. Alternatively, the input device connected to the input interface 12 may be an input device provided on another computer connected via a network or the like.

[0029] The communication interface 13 communicates data with the image server 2, the electronic medical record system 3, the medical information management application 4, the report creation device 5, and other systems not shown, such as the hospital information system and the radiology department information system. The communication interface 13 communicates data in accordance with, for example, a pre-configured known standard. Communication between the medical information processing device 1 and the hospital information system, the electronic medical record system 3, the medical information management application 4, and the radiology department information system is, for example, conducted in accordance with HL7 (Health Level 7). Communication between the medical information processing device 1 and the image server 2 and the medical information management application 4 is, for example, conducted in accordance with DICOM (Digital Imaging and Communications in Medicine).

[0030] The display 14 displays a GUI (Graphical User Interface) for accepting various operations from the user, medical images acquired by the acquisition function 101, display images generated by the generation function 104, etc. Any display can be used as appropriate, such as an LCD display, an organic EL display, an LED display, a plasma display, or a touch display capable of touch input. In addition to the display, the GUI may also be displayed via a projector or the like.

[0031] Next, the operation of the medical information processing device 1 according to the first embodiment will be described with reference to the flowchart in Figure 3 and the schematic diagrams in Figures 4 to 9. The following description will use the case where the organ represented by the medical image is the lung and the hierarchical structure is the bronchial structure of the lung as an example, but will not be limited to this. For example, the hierarchical structure may be the regional structure of the lung (upper lobe, middle lobe, lower lobe, segment). Alternatively, the organ represented by the medical image may be the liver and the hierarchical structure may be the bile duct structure of the liver. Alternatively, the hierarchical structure may be the regional structure of the liver (caudate lobe, left lobe, right lobe, segment). Alternatively, the organ represented by the medical image may be the lung or liver and the hierarchical structure may be the vascular structure. Or, the organ represented by the medical image may be the brain and the hierarchical structure may be the vascular structure. In other words, this embodiment is applicable to any organ in which multiple regions have the same function, such as the lung and the liver. This is also true for each of the following embodiments.

[0032] (Step ST10) The processing circuit 10 of the medical information processing device 1 acquires a medical image of the subject using the acquisition function 101. This medical image represents the lungs, which are organs with distinct regions.

[0033] Here, the lungs are classified into the right lung 200 and the left lung 300, as shown in Figures 4 and 5. In Figure 5, the names indicating the lung classifications are written within the boxes, and the names indicating the bronchial 400 classifications are written in parentheses within the boxes. However, the names of lower-level classifications may be referred to by the names of higher-level classifications. For example, the segmental bronchi B1-B3 of the right lung 200 may be called the upper lobe bronchi, and the upper lobe bronchi of the right lung 200 may be called the right main bronchus. The right main bronchus may also be called bronchus 400. Furthermore, the names may be referred to by the highest-level classification, not just the most immediate higher level. For example, the segmental bronchi B1-B3 of the right lung 200 may be called bronchus 400. In the following explanation, unless it causes confusion, names such as right main bronchus, upper lobe bronchi, segmental bronchi, and subsegmental bronchi will not be distinguished and will be referred to as bronchus 400. Furthermore, in Figure 5, only the upper lobe 201 of the right lung 200 is classified individually into segments S1, S2, S3 and segmental bronchi B1, B2, B3, and subsegmental bronchi B1a, B1b, B2a, B2b, B3a, B3b, but other regions are similarly classified individually.

[0034] The right lung 200 has three regions: the upper lobe 201 containing segments S1-S3, the middle lobe 202 containing segments S4-S5, and the lower lobe 203 containing segments S6-S10. The left lung 300 has two regions: the upper lobe 301 containing segments S1-S5, and the lower lobe 302 containing segments S6, S8-S10. Meanwhile, the bronchi 400, which branch off from the trachea, extend into the right lung 200 and the left lung 300, branching further within each region to reach the alveoli (not shown). Each segment within a region has the function of gas exchange between oxygen and carbon dioxide (lung function) through the alveoli at the end of the bronchus. In other words, the lung is an organ in which multiple segments have the same function. In such a lung, it is possible to perform image interpretation and treatment for lesions discovered through image interpretation for each region that has multiple segments.

[0035] (Step ST20) After step ST10, the processing circuit 10 uses the extraction function 102 to extract the hierarchical structure of the lung from the medical image representing the lung, which has its own distinct region. For example, as partially shown in Figure 6, the processing circuit 10 extracts bronchial structures (hierarchical structures) that are branched structures, such as bronchus 401A extending to region S2 of the upper lobe 201 of the right lung 200, and bronchus 403D extending to region S3 of the upper lobe 201 of the right lung 200. The hierarchical structure is an anatomical concept that includes both regional structure and branched structure, and the branched structure is an anatomical concept that includes bronchial structure. Furthermore, the extraction of the hierarchical structure of the lung may be performed by known methods, such as bronchial segmentation. Bronchial segmentation means separating the bronchial region from the surrounding tissue of the bronchus, i.e., the lung parenchyma region. For example, the processing circuit 10 may segment the bronchi using the region growing method. Alternatively, for example, the processing circuit 10 may segment the bronchi using a pre-trained machine learning model.

[0036] (Step ST30) After step ST20, the processing circuit 10 uses the setting function 103 to set index values ​​for lung lesions according to the hierarchical structure. For example, the processing circuit 10 sets index values ​​for higher-level hierarchies that are located above lower-level hierarchies based on index values ​​set for lower-level hierarchies that are located relatively lower within the hierarchical structure. Specifically, for example, as partially shown in Figure 7, the processing circuit 10 accumulates the index values ​​of lower-level hierarchies and sets the resulting accumulated value as the index value for higher-level hierarchies. For example, if the index value is the number of diseased variables, the processing circuit 10 accumulates the number of diseased variables (3) and (1) of the lower-level bronchus 401A and sets the resulting accumulated value (4) as the number of diseased variables (4) of the higher-level hierarchies. Similarly, the processing circuit 10 accumulates the number of diseased variables (4) and (1) of the lower-level bronchus 401A and sets the resulting accumulated value (5) as the number of diseased variables (5) of the higher-level hierarchies. Similarly, the processing circuit 10 accumulates the lower-level disease variables (2)(5) of bronchus 401A and sets the resulting accumulated value (7) as the higher-level disease variable (7). Also, for example, if the index value is a lesion name or finding name, the processing circuit 10 accumulates the number of lesion names or finding names in that lower level, similar to the disease variables, and sets the resulting accumulated value as the higher-level index value.

[0037] (Step ST40) After step ST30, the processing circuit 10 uses the generation function 104 to generate a display image that shows the index values ​​for the lesion in each region based on the hierarchical structure and the index values. For example, the processing circuit 10 generates a display image by arranging texts indicating each level of the hierarchical structure according to the relationship between lower and upper levels, and associating the index values ​​of each level with the arranged texts. Specifically, for example, in Figure 8, the first level of the hierarchical structure of bronchus 401A is shown with the text "bronchus 401A", the branch of the first level is shown with the text "-", and the second level branched from the first level is shown with the texts "AA" and "AB". Similarly, the branch from the branch "AB" of the second level is shown with the text "-", and the third level branched from the branch "AB" is shown with the texts "ABA" and "ABB". The third-level texts "ABA" and "ABB" are created by adding the branch "-" and the third-level branch "A" and "B," respectively, to the end of the second-level branch "AB." The same applies to the fourth level and beyond. In this way, the processing circuit 10 arranges the texts representing each level of the hierarchical structure according to the relationship between lower and higher levels. The processing circuit 10 also generates a display image that associates the text of each level with the number of lesions in each level by describing the number of lesions in each level in parentheses at the end of the arranged texts. This display of a hierarchical structure by arranging texts may be called a collapsible display or a folded display. Furthermore, the hierarchical structure by arranging texts may display all levels from the main bronchi to the alveoli, or it may display several levels from a higher level to a predetermined lower level, depending on the user's operation.

[0038] (Step ST50) After step ST40, the processing circuit 10, using the display control function 105, displays the display image g1 on the display 14 as shown in Figure 9. This display image g1 shows the number of lesions associated with each level of the hierarchical structure of the bronchus 401A extending to segment S2 of the upper lobe 201 of the right lung 200. By using this display image g1, the user can follow the number of lesions at each level of the hierarchical structure of the bronchus 401A, thereby reducing the complexity of following lesions in each region.

[0039] For example, if the index value represents the number of diseased cells, then by comparing the "ABBA" and "ABBB" branches within the third level based on the displayed image g1, it is possible to track only the branch with the higher number of diseased cells, thus reducing the complexity of follow-up.

[0040] For example, based on the displayed image g1, instead of describing the individual findings of the fourth-level fine branches "ABBBA," "ABBBB," and "ABBBC" in the report, it becomes possible to comprehensively describe the lesion findings at the higher-level third-level branch "ABBB" or even higher-level second-level branch "ABB." If individual findings for fine branches are described, the number of branches to track becomes enormous, making follow-up complicated. In contrast, by describing comprehensive findings at the higher-level branches of the fine branches, the complexity of following up on the lesion can be reduced. Similarly, when creating a report and wanting to describe multiple findings together, it becomes possible to group multiple findings from lower levels into higher levels, further reducing the complexity of follow-up.

[0041] For example, when comparing the branches "ABBA" and "ABBB" within the third tier based on the displayed image g1, if the number of lesions represented by the index values ​​are equivalent, the user may be prompted to display other index values ​​related to the degree of influence, such as probability or severity. For example, if the number of lesions is equivalent when comparing the branches "ABBA" and "ABBB" within the third tier, the index value representing the number of disease variables associated with each branch (not shown) can be switched to index values ​​(1) and (3) representing the degree of influence on the entire third tier, thereby functionally allowing the user to determine that treatment of branch "ABBB(3)" should be prioritized over branch "ABBA(1)". Note that if there are multiple regions or lesions, judgment becomes difficult, so weights may be used as index values ​​instead of the number of disease variables. For example, by using the sum of the severity of each lesion as the weight, a higher weight can be assigned to a single severe lesion than to a case with multiple minor lesions, making it possible to effectively present treatment priorities.

[0042] Furthermore, as shown in Figure 9, the processing circuit 10 may display a GUI such as a checkbox 12c on the display 14 when creating an image interpretation report. That is, the processing circuit 10 may allow the user to select whether or not to display the difference between branches, or whether or not to display the difference between the branch and the past, using a GUI such as a checkbox 12c. The former displays the current state, and the latter displays the state over time. In Figure 9, the checkbox 12c is selected by the operator to display the difference between branch A and branch B.

[0043] As described above, according to the first embodiment, the processing circuit 10 of the medical information processing device 1 extracts the hierarchical structure of organs from medical images representing organs with different regions. The processing circuit 10 sets index values ​​for lesions in organs according to the hierarchical structure. Based on the hierarchical structure and index values, the processing circuit 10 generates a display image g1 that displays the index values ​​for lesions in each region. The processing circuit 10 displays the display image g1 on the display 14. This reduces the complexity of following up on lesions in each region. In addition, by using the display image g1 in which the lesion regions are classified, it becomes possible to perform more systematic image interpretation and tracking of lesions, so even when there are many lesions, the complexity of tracking and / or monitoring of lesions can be reduced. In addition, by using a display image that represents the hierarchical structure and index values ​​of regions and affected areas from an anatomical and clinical treatment perspective, systematic follow-up is possible, thus reducing the complexity of follow-up.

[0044] Furthermore, according to the first embodiment, the processing circuit 10 sets the index value of the upper-level hierarchy, which is located above the lower-level hierarchy, based on the index value set in the lower-level hierarchy, which is located relatively lower within the hierarchical structure. In this case, in the displayed image g1, the index value for the lesion in the lower-level hierarchy is reflected in the index value of the upper-level hierarchy, making it easy to track lesions between the upper-level and lower-level hierarchy within each region. In addition, it is possible to identify the lung lobe (upper lobe, middle lobe, lower lobe) or the segment within the lung lobe that corresponds to the area and range of influence of the lesion, making it possible to support the consideration of treatment strategies such as lobectomy or segmentectomy for the lesion. Moreover, even when there are many lesions, the system displays not only the index value for individual lesions in the lower-level hierarchy, but also the index value of the upper-level hierarchy that reflects the index value of the lower-level hierarchy. This allows for the expression and comparison of overall index values ​​in the upper level, not just the expression and comparison of individual index values ​​in the lower level. Furthermore, by using index values ​​related to the degree of influence of the lesion, such as the probability or severity of the lesion, it is possible to express and compare the overall degree of influence in the upper level, not just the individual degree of influence in the lower level.

[0045] Furthermore, according to the first embodiment, the processing circuit 10 accumulates the index values ​​of the lower levels and sets the obtained accumulated value as the index value of the higher level. In this case, the accumulated value of lesions between the higher and lower levels within each region can be easily tracked in the display image g1. In addition, not only the index values ​​of individual lesions in the discrete lower levels, but also the index values ​​of the higher levels related to each lesion can be expressed as the accumulated value of the index values ​​of each lesion. Furthermore, as described above, it becomes possible to support the consideration of treatment strategies such as lobectomy and segmentectomy corresponding to the area and extent of influence of the lesion.

[0046] Furthermore, according to the first embodiment, the processing circuit 10 generates a display image g1 by arranging text representing each level of the hierarchical structure according to the relationship between lower and upper levels, and associating the index values ​​of each level with the arranged text. In this case, for example, compared to arranging index values ​​for each branch representing the shape of the bronchi shown in the medical image, it is possible to generate a display image g1 in which a large number of levels are arranged in a relatively small area.

[0047] Furthermore, according to the first embodiment, the organ represented by the medical image is the lung, and the hierarchical structure is the bronchial structure of the lung. In this case, lung lesions can be followed up along the bronchial structure of the lung.

[0048] Furthermore, according to the first embodiment, the organ represented by the medical image may be the liver, and the hierarchical structure may be the bile duct structure of the liver. In this case, liver lesions can be followed up along the bile duct structure of the liver.

[0049] (Modified example of the first embodiment) In the first embodiment, a display image g1 showing indicator values ​​for lesions in each region of an organ was displayed on the display 14. In contrast, the first modification of the first embodiment filters and displays (selects and displays) the medical image that is the source of the display image g1. The medical image may be either a two-dimensional or three-dimensional medical image; a two-dimensional medical image is displayed in two dimensions, and a three-dimensional medical image is displayed in three dimensions.

[0050] Accordingly, in addition to the functions described above, the display control function 105 of the processing circuit 10 performs filtered display of the medical image based on the selected hierarchy when a hierarchy is selected within the displayed image g1. For example, the display control function 105 performs filtered display of the medical image so that, among the branches in the branch structure represented by the medical image, it leaves the area that goes from the branch corresponding to the hierarchy selected in the displayed image g1 to the higher-level branch, and erases or hides the other areas. When other areas are hidden, the display control function 105 can switch between displaying and hiding those other areas according to the user's operation.

[0051] The other configurations are the same as in the first embodiment.

[0052] With the above configuration, after step ST50, the hierarchy corresponding to the lesion is selected in the displayed image g1. For example, while the displayed image g1 is being displayed, the hierarchy corresponding to the lesion is selected by operating the GUI, such as the checkbox 12c shown in Figure 9. On the other hand, as shown in Figure 10, the medical image g11 contains a bronchus with lesion 500 that corresponds to the hierarchy selected in the displayed image g1, among the bronchi within the bronchial structure represented by the medical image g11. Note that, in reality, the bronchial structure represented by the medical image g11 is displayed with the bronchi overlapping, so it may be difficult to see each bronchus from the lower lesion 500 to the upper bronchus 401A.

[0053] At this time, the processing circuit 10 performs filtering and display of medical images g12 to g14, for example, as shown in Figures 11 to 13, to display a portion of the upper lobe 201 that traces from the bronchus with lesion 500 to each upper bronchi and up to the upper bronchus 401A, while hiding other areas.

[0054] Accordingly, according to the first modification of the first embodiment, as shown in Figure 13, by displaying only the region from the bronchus with lesion 500 to the upper bronchus 401A, in addition to the effects of the first embodiment, a medical image g14 can be displayed that reduces the overlap of each bronchus in the medical image g11 of the lung. In other words, according to the first modification, the overlap of each branch on the 2D or 3D display of the medical image g11 of the entire organ can be reduced. Furthermore, by displaying only the region from the bronchus with lesion 500 to the upper bronchus 401A, each branch related to lesion 500 can be displayed. Furthermore, by displaying only the region containing each branch related to lesion 500, the affected area of ​​lesion 500 can be displayed. In addition, by displaying only the region including each branch related to lesion 500, the affected area of ​​lesion 500 can be displayed. Furthermore, by reducing the overlap and displaying the affected area, it becomes easier to see where lesion 500 belongs, so compared to marking only lesion 500, it is possible to support decisions on how much to resect, such as segmentectomy or lobectomy.

[0055] (Second modified example of the first embodiment) The first modification performed filtered display of medical images based on the selection of a hierarchy within the displayed image g1. In contrast, the second modification filters and displays past or recent medical images related to lesion 500 based on the selection of the difference from the past within the displayed image g1.

[0056] Accordingly, in addition to the functions described above, the display control function 105 of the processing circuit 10 displays past lesion images and the latest lesion images at the selected hierarchy when "hierarchy" and "difference from the past" are selected within the displayed image g1. When either a past lesion image or the latest lesion image is selected, the display control function 105 performs the filtering display described above on the medical image g11 representing the lesion 500 corresponding to the selected lesion image. For example, if the index value for the lesion is a numerical value, the display control function 105 may display a list of items representing options such as "equal to value x," "greater than value x," or "less than value x," or items representing the corresponding value. In this case, the display control function 105 performs the filtering process described above so as to leave the hierarchy corresponding to the selection and erase or hide other hierarchies, depending on the user's operation of selecting the corresponding item in the list. Furthermore, if the index value for the lesion is a string, the display control function 105 may perform a convoluted display, for example, displaying a list of the findings names within the displayed image g1. In this case, the display control function 105 performs the filtering process described above in response to the user's operation of selecting the corresponding finding name in the list, so as to leave the hierarchy corresponding to the selection and delete or hide the other hierarchies.

[0057] Other configurations are the same as in the first embodiment and the first modification.

[0058] With the above configuration, after step ST50, the "hierarchy" and "difference from the past" corresponding to the lesion are selected within the displayed image g1. For example, while displaying image g1, the "hierarchy" and "difference from the past" corresponding to the lesion are selected by operating the GUI, such as the checkbox 12c shown in Figure 9.

[0059] As a result, the processing circuit 10 displays past and latest lesion images in the selected hierarchy on the display 14. In the example shown in Figure 14, a table screen T1 containing past and latest lesion images in segments S1-S3 of the upper lobe 201 of the right lung, including the selected hierarchy, is displayed on the display 14. Table screen T1 displays past findings and lesion images in association with the latest findings and lesion images for each lung segment. For example, for each of the multiple lesions in segment S3 of the right lung, table screen T1 displays the difference from the past, showing the lesion image and size from the past (2023 / 12 / 01) and the lesion image and size from the latest (2024 / 4 / 1). Also, within table screen T1, a frame F1 is displayed for selecting past or latest lesion images to perform filtering.

[0060] The processing circuit 10, in response to user input, moves frame F1 as appropriate and selects a lesion image enclosed within frame F1. Then, it performs filtering and display of medical image g15 on medical image g11, which represents lesion 500 corresponding to the selected lesion image, as described above. Alternatively, instead of selecting a lesion image, the user may select text representing findings or a hyperlink that is not shown.

[0061] Accordingly, according to the second modification of the first embodiment, past lesion images and the latest lesion images in a selected hierarchy from the displayed image g1 can be displayed, and a filtering display is performed for lesions 500 corresponding to the selected past or latest lesion image. In addition to the effects of the first embodiment and the first modification, the complexity of monitoring the progression of lesions can be reduced.

[0062] <Second Embodiment> The second embodiment is a modification of the display image in the first embodiment, and displays an image on the display 14 that associates index values ​​with the branching of the bronchial structure of the lung.

[0063] Accordingly, the generation function 104 of the processing circuit 10 generates a display image by associating index values ​​with each branch of the hierarchical structure in accordance with the relationship between lower and upper levels, in addition to the functions described above. The display image may be a two-dimensional medical image representing the bronchial structure of the lungs to which the index values ​​are associated, or a two-dimensional image converted from a three-dimensional medical image representing the bronchial structure of the lungs by volume rendering processing to which the index values ​​are associated. Alternatively, the display image may be a schematic diagram representing the shape of the bronchial structure of the lungs to which the index values ​​are associated.

[0064] The display control function 105 of the processing circuit 10 displays the generated display image on the display 14. For example, as shown in Figure 15, the display control function 105 displays a display image g2 on the display 14 that associates the number of lesions with each branch of the hierarchical structure relating to bronchi 401A and 403D, according to the relationship between lower and upper levels.

[0065] The other configurations are the same as in the first embodiment.

[0066] With the above configuration, in step ST40, the processing circuit 10 generates the display image g2 by associating the number of lesions with each level of branching in the bronchial structure of the lung according to the relationship between lower and upper levels using the generation function 104.

[0067] After step ST40, in step ST50, the processing circuit 10 displays the generated display image g2 on the display 14, as shown in Figure 15.

[0068] As described above, according to the second embodiment, the processing circuit 10 generates a display image g2 by associating the number of lesions with each branch of the hierarchical structure relating to bronchi 401A and 403D in accordance with the relationship between lower and upper levels. Therefore, a display image g2 can be displayed in which the number of lesions is placed in each branch that constitutes the shape of bronchi 401A and 403D. In addition to the effects of the first embodiment, the number of lesions in each branch can be presented along with the shape of the bronchial structure represented by the medical image.

[0069] Furthermore, the second embodiment may be combined with each of the modifications of the first embodiment. In this case, the effects of the second embodiment can be obtained along with the effects of each of the modifications of the first embodiment. Furthermore, the fact that it may be combined with each of the modifications of the first embodiment, and that the effects of each of the modifications can be obtained when such a combination is made, also applies to the following embodiments and their modifications.

[0070] <Third Embodiment> The third embodiment is a modification of the display image in the first embodiment, in which each region of the lung and a display image associated with an index value for each region are displayed on the display 14.

[0071] Accordingly, the generation function 104 of the processing circuit 10 generates a display image by associating each region of an organ with the corresponding higher-level index value, in addition to the functions described above. The display image may be one in which the index values ​​are associated with each region of the organ represented by a medical image, or one in which the index values ​​are associated with each region of the organ represented by a schematic diagram.

[0072] The display control function 105 of the processing circuit 10 displays the generated display image on the display 14. For example, as shown in Figure 16, the display control function 105 displays a display image g3 on the display 14 that associates each region of the right lung 200 (upper lobe 201, middle lobe 202, and lower lobe 203) with the corresponding higher-level index value (ratio of normal volume) for each of those regions.

[0073] The other configurations are the same as in the first embodiment.

[0074] With the above configuration, in step ST30, the processing circuit 10 uses the setting function 103 to accumulate the index values ​​(ratio of normal volume) set for the lower hierarchy that is relatively lower within the bronchial structure, and sets the resulting accumulated value as the index value (ratio of normal volume) for the higher hierarchy.

[0075] In step ST40 described above, the processing circuit 10 generates a display image by associating the upper lobe 201, middle lobe 202, and lower lobe 203 of the right lung 200 with the higher-level index values ​​(ratio of normal volume) corresponding to each of the upper lobe 201, middle lobe 202, and lower lobe 203, using the generation function 104.

[0076] After step ST40, in step ST50, the processing circuit 10 displays the generated display image g3 on the display 14, as shown in Figure 16. The display image g3 includes the index values ​​"36% / 40%" for the upper lobe 201, "20% / 30%" for the middle lobe 202, and "20% / 30%" for the lower lobe 203 of the right lung 200. Of the index values ​​"V% / W%", the V% on the left indicates the ratio of the normal volume of each region (upper lobe, middle lobe, lower lobe) to the total volume of the right lung 200. The W% on the right indicates the ratio of the regional volume of each region to the total volume of the right lung 200. For example, of the index value "36% / 40%" for the upper lobe 201, the 36% on the left indicates the ratio of the normal volume or past volume of the upper lobe 201 to the total volume of the right lung 200. Normal volume refers to the volume of the relevant region obtained from the most recent examination image in a state judged as normal by the physician or analysis application. Past volume refers to the volume of the relevant region obtained from past examination images. The 40% on the right side indicates the ratio of the region volume of the upper lobe 201 to the total volume of the right lung 200. The total volume of the right lung 200 may be the number of voxels representing the entire right lung 200 in the 3D medical image, and the region volume of the upper lobe 201 may be the number of voxels representing the upper lobe 201 in the 3D medical image. The normal volume of the upper lobe 201 may be the value obtained by subtracting the number of voxels affected by the lesion within the upper lobe 201 (lesion volume) from the number of voxels representing the region volume of the upper lobe 201 (normal volume = region volume - lesion volume). When using 2D medical images, the above "volume" should be read as "area" and "voxel" as "pixel". Furthermore, the ratio of normal volume may also be called the ratio of normal function, and the ratio of total volume or regional volume may also be called the ratio of total function or regional function. Normal function, for example, means that the measured vital capacity is usable, and total function or regional function, for example, means that the target vital capacity is usable. Also, the difference of bilateral index values ​​"4%" (=40-36[%]) represents the ratio of the lesion volume of upper lobe 201 to the total volume of right lung 200. To clarify, the regional volume of upper lobe 201 is the sum of the normal volume of upper lobe 201 and the lesion volume of upper lobe 201 (regional volume = normal volume + lesion volume).Furthermore, the sum of the three indicator values, "76% / 100%", represents the following: the 76% on the left side indicates the sum of the ratios of the normal volumes of the upper lobe 201, middle lobe 202, and lower lobe 203 to the total volume of the right lung 200 (76% = 36% + 20% + 20%). The 100% on the right side indicates the sum of the ratios of the regional volumes of the upper lobe 201, middle lobe 202, and lower lobe 203 to the total volume of the right lung 200 (100% = 40% + 30% + 30%). Note that the ratio of lesion volume may also be called the ratio of lesion function, and may be displayed instead of the ratio of normal function. In this case, for example, the indicator value for the upper lobe 201 would be displayed as "4% / 40%" instead of "36% / 40%".

[0077] Furthermore, the processing circuit 10 may display a GUI such as a pull-down menu 12d on the display 14 that allows switching between a display image g3 of an index value based on the total volume and a display image (not shown) of an index value based on the volume of a region unit, which will be described later.

[0078] As described above, according to the third embodiment, the processing circuit 10 generates a display image by associating each region of the organ with the corresponding higher-level index value. Therefore, since a display image g3 is displayed that associates each region of the organ with the index value of each region, in addition to the effects of the first embodiment, the index values ​​of each region of the organ can be presented without using a branched structure. Furthermore, according to the third embodiment, it is possible to compare and represent lesions and branches not only on a region-by-region basis, but also on a region-by-region basis. In addition, the index values ​​(such as influence and effect) of lesions in regions such as the upper lobe 201, middle lobe 202, and lower lobe 203 can be expressed in comparison with the entire right lung 200, which includes each region. For example, if the index value of a region is "V%" and the index value of that region in relation to the whole is "W%", the index value of the region relative to the whole can be displayed as "V% / W%".

[0079] (First modified example of the third embodiment) The third embodiment displayed an image g3 that associated each of the upper lobe 201, middle lobe 202, and lower lobe 203 of the right lung 200 with an index value "V% / W%" relating to the ratio of the volumes corresponding to each of the upper lobe 201, middle lobe 202, and lower lobe 203. In contrast, the first modification of the third embodiment arranges the index values ​​used in the third embodiment on the hierarchical structure used in the first embodiment.

[0080] In other words, the display control function 105 of the processing circuit 10 generates a display image by arranging text indicating each level of the hierarchical structure according to the relationship between lower and upper levels, and associating the index values ​​of each level with the arranged text. Specifically, for example, as shown in Figure 17, a display image g31 is generated that associates the index values ​​"36% / 40%" (V% / W%) and "10%" and "26%" (v1%, v2%) with each level of the hierarchical structure of the bronchus 401A. Note that the index value V% of the upper level is the sum of the index values ​​v1% and v2% of the lower levels (V%=v1%+v2%). For example, in Figure 17, the index value "36%" of the first level is the sum of the index values ​​"10%" and "26%" of the second level (36%=10%+26%).

[0081] With the configuration described above, in addition to the effects of the third embodiment, the display image g31, which associates index values ​​with each level of the hierarchical structure, allows the index values ​​"V% / W%" of the higher level of each domain to be expanded and displayed as index values ​​of the lower level.

[0082] (Second modified example of the third embodiment) The first modification of the third embodiment displays a display image g31 associated with the index values ​​"36% / 40%", "10%", "26%", etc., for each level of the hierarchical structure, by arranging the index values ​​used in the third embodiment with the hierarchical structure used in the first embodiment. In contrast, the second modification of the third embodiment arranges the index values ​​of each level used in the first modification of the third embodiment with each branch of the hierarchical structure used in the second embodiment.

[0083] With the above configuration, as shown in Figure 17, for each branch of the hierarchical structure relating to bronchi 401A and 403D, display images g32 are shown on the display 14, associating volume-related index values ​​"36% / 40%", "10%", "26%", ... according to the relationship between lower and upper levels. Therefore, the second modified example provides the effects of the second embodiment in addition to the effects of the first modified example of the third embodiment.

[0084] <Fourth Embodiment> The fourth embodiment is a modification of the index values ​​in the third embodiment, in which the index values ​​of lower levels are not accumulated, and the index values ​​for lesions in lower levels are set as the index values ​​for higher levels.

[0085] Specifically, for example, the setting function 103 of the processing circuit 10, in addition to the functions described above, sets the indicator values ​​related to lesions from the lower-level indicator values ​​as the higher-level indicator values ​​for each region of the organ.

[0086] The display control function 105 of the processing circuit 10 displays the generated display image on the display 14. For example, as shown in Figure 19, the display control function 105 displays a display image g4 on the display 14 that represents the index values ​​related to lesions among the lower-level index values ​​as higher-level index values ​​for each region of the right lung 200 (upper lobe 201, middle lobe 202, and lower lobe 203).

[0087] The other configurations are the same as in the third embodiment.

[0088] With the above configuration, in step ST30, the processing circuit 10, using the setting function 103, sets the index value related to lesions (ratio of normal volume) among the index values ​​set in the lower hierarchy within the bronchial structure for the upper lobe 201, middle lobe 202, and lower lobe 203 units of the right lung 200 as the index value of the higher hierarchy located above the said lower hierarchy (ratio of normal volume). Note that the index value related to lesions may use the ratio of lesion volume instead of the ratio of normal volume.

[0089] In step ST40 described above, the processing circuit 10 generates a display image by associating the upper lobe 201, middle lobe 202, and lower lobe 203 with the higher-level index values ​​(ratio of normal volume) corresponding to each of the upper lobe 201, middle lobe 202, and lower lobe 203 using the generation function 104. The display image may associate the index values ​​with each region of the organ represented by the medical image, or it may associate the index values ​​with each region of the organ represented by the schematic diagram.

[0090] After step ST40, in step ST50, the processing circuit 10 displays the generated display image g4 on the display 14, as shown in Figure 19. The display image g4 includes the index value of "80%" for the upper lobe 201, the index value of "100%" for the middle lobe 202, and the index value of "100%" for the lower lobe 203 in the right lung 200. The index value of "80%" for the upper lobe 201 indicates the ratio of the normal volume of the upper lobe 201 to the total regional volume of the upper lobe 201. Similarly, the index value of "100%" for the middle lobe 202 indicates the ratio of the normal volume of the middle lobe 202 to the total regional volume of the middle lobe 202. The index value of "100%" for the lower lobe 203 indicates the ratio of the normal volume of the lower lobe 203 to the total regional volume of the lower lobe 203. This allows the user to determine that 80% of the upper leaves 201 are functioning correctly, and 20% are not. The user can also determine that 100% of the middle leaves 202 and lower leaves 203 are functioning correctly.

[0091] The processing circuit 10 may also display a GUI on the display 14, such as a pull-down menu 12d, which allows switching between an image g4 of an index value based on the volume of a region (region volume) and an image g3 of an index value based on the overall volume as described above.

[0092] As described above, according to the fourth embodiment, the processing circuit 10 sets the index values ​​related to lesions from the lower-level index values ​​as the higher-level index values ​​for each region of the organ. Therefore, in addition to the effects of the third embodiment, the index values ​​for each region of the organ can be presented for each region of the organ. Furthermore, according to the fourth embodiment, it is possible to compare and express lesions and branches at the region level, not just at the individual lesion and branch comparison and expression in the first and second embodiments. In addition, the index values ​​of lesions (such as influence and effect) at the region level, such as upper lobe 201, can be expressed using the entire upper lobe 201 as the standard. For example, the index value at the upper lobe 201 region level, when the entire upper lobe 201 is set as the standard at 100%, can be displayed as "r%".

[0093] (First modification of the fourth embodiment) The fourth embodiment displayed an image g4 representing index values ​​for lesions corresponding to the upper lobe 201, middle lobe 202, and lower lobe 203 of the right lung 200. In contrast, the first modification of the fourth embodiment arranges the index values ​​used in the fourth embodiment on the hierarchical structure used in the first embodiment.

[0094] In other words, the display control function 105 of the processing circuit 10 generates a display image by arranging text representing each level of the hierarchical structure according to the relationship between lower and upper levels, and associating the index value of each level with the arranged text. Specifically, for example, as shown in Figure 20, a display image g41 is generated that associates the index value "80% / 100%" (r% / R%) with each level of the hierarchical structure of bronchus 401A. Of the index values ​​"r% / R%" for each level, the r% on the left represents the ratio of the normal volume to the total volume of each branch in each level. The R% on the right represents the ratio of the total volume of each branch in each level. For example, of the index value "80% / 100%" for branch "AB" of bronchus 401A, the 80% on the left represents the ratio of the normal volume of branch "AB" to the total volume of branch "AB". The 100% on the right represents the ratio of the total volume of branch "AB" to the total volume of branch "AB". The terms "total volume" and "normal volume" are used as described above. From this, the user can determine that 80% of branch "AB" is functioning normally and 20% of branch "AB" is not functioning.

[0095] Furthermore, in Figure 20, there are two sub-branches, "ABA" and "ABB," under the sub-branch "AB." The first branch, "ABA," has an index value of "99.9% / 100%," and the second branch, "ABB," has an index value of "80% / 100%." ​​From this, the user can determine that the first branch, "ABA," is functioning almost normally, while 20% of the second branch, "ABB," is not functioning. In other words, the user can determine which sub-branch is related to a lesion by tracing the index values ​​of the branches from higher to lower levels, focusing on the branch with the index value related to the lesion (e.g., the lower index value). In the example shown in Figure 20, the user can determine that the branches "ABBBB" and "ABBBC" in the fifth sub-branch are related to a lesion based on their low respective index values.

[0096] In Figure 20, the indicator values ​​"80% / 100%" for each branch in each hierarchical level propagate from lower to higher levels, but the indicator values ​​"10% / 100%" and "40% / 100%" for each branch in the fifth hierarchical level do not propagate from lower to higher levels. This is because even if the branches in the fifth hierarchical level at the terminal end, which have undergone repeated branching, are not functioning well, it has little effect on the overall hierarchical structure of bronchus 401A.

[0097] With the configuration described above, in addition to the effects of the fourth embodiment, the display image g41, which associates index values ​​with each level of the hierarchical structure, allows the index value "r% / R%" of the higher level of the region unit to be expanded and displayed as an index value of the lower level.

[0098] (Second modified example of the fourth embodiment) The first modification of the fourth embodiment displays a display image g41 associated with the index values ​​"80% / 100%", ... for each level of the hierarchical structure, by arranging the index values ​​used in the third embodiment with the hierarchical structure used in the first embodiment. In contrast, the second modification of the fourth embodiment arranges the index values ​​for each level used in the first modification of the fourth embodiment with each branch of the hierarchical structure used in the second embodiment.

[0099] With the above configuration, as shown in Figure 21, for each branch of the hierarchical structure relating to bronchi 401A and 403D, display images g42 are shown on the display 14, associating volume-related index values ​​"80% / 100%", "99.8% / 100%", etc., according to the relationship between lower and upper levels. Therefore, according to the second modified example, in addition to the effects of the first modified example of the fourth embodiment, the effects of the second embodiment can be obtained.

[0100] In the above description, the term "processor" refers to circuits such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), or a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). When the processor is a CPU, for example, it performs its functions by reading and executing a program stored in a memory circuit. On the other hand, when the processor is an ASIC, for example, instead of the program being stored in a memory circuit, the function is directly incorporated as a logic circuit within the processor's circuit. In this embodiment, each processor is not limited to being configured as a single circuit; multiple independent circuits may be combined to form a single processor and perform its functions. Furthermore, multiple components shown in the figure may be integrated into a single processor to perform its functions.

[0101] In addition, each function according to the embodiment can also be realized by installing a program that executes the processing on a computer such as a workstation and loading it into memory. In this case, the program that enables the computer to implement each function can also be stored and distributed on a storage medium such as a magnetic disk (hard disk, etc.), optical disk (CD-ROM, DVD, etc.), or semiconductor memory.

[0102] According to at least one embodiment described above, the complexity of following up on lesions in each region can be reduced.

[0103] While several embodiments have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These embodiments can be implemented in a variety of other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of Symbols]

[0104] 1. Medical Information Processing Device 2 Image Server 3. Electronic medical record system 4. Medical Information Management Application 5. Report generation device 10 Processing Circuit 11 memory 12 Input Interfaces 12c checkbox 12d pull-down menu 13 Communication Interface 14 displays 101 Acquisition function 102 Extraction function 103 Settings Function 104 Generation function 105 Display control function 200 right lung 201,301 Upper leaves 202 Nakaha 203,302 Lower leaves 400, 401A, 403D bronchi 500 lesions g1~g4,g31,g32,g41,g42 Displayed Images g11~g15 Medical images S2,S3 area F1 Frame T1 Table Screen

Claims

1. An extraction unit that extracts the hierarchical structure of an organ from medical images representing the organs, each having its own region, A setting unit that sets index values ​​for lesions of the organs according to the hierarchical structure, A generation unit generates a display image that displays the index values ​​for the lesions in each of the regions based on the hierarchical structure and the index values, A display control unit that displays the aforementioned display image on a display, A medical information processing device equipped with [a specific feature / feature].

2. The setting unit sets the index value of the higher-level hierarchy located above the lower-level hierarchy, based on the index value set in the lower-level hierarchy located relatively lower within the hierarchical structure. The medical information processing device according to claim 1.

3. The medical information processing device according to claim 2, wherein the setting unit accumulates the index values ​​of the lower hierarchy and sets the obtained accumulated value as the index value of the higher hierarchy.

4. The medical information processing apparatus according to claim 2, wherein the setting unit sets the index value relating to the lesion among the lower-level index values ​​as the index value of the higher level for each of the above-mentioned domain units.

5. The generation unit generates the display image by arranging text representing each level of the hierarchical structure according to the relationship between the lower and upper levels, and associating the index values ​​of each level with the arranged text. A medical information processing device according to any one of claims 2 to 4.

6. The generation unit generates the display image by associating the index values ​​with each branch of the hierarchy in the hierarchical structure in accordance with the relationship between the lower and upper levels. A medical information processing device according to any one of claims 2 to 4.

7. The generation unit generates the display image by associating each of the regions with the corresponding higher-level index values. The medical information processing device according to claim 2 or 3.

8. The organ mentioned is the lungs. The medical information processing device according to any one of claims 1 to 4, wherein the hierarchical structure is the bronchial structure of the lung.

9. The aforementioned organ is the liver. The medical information processing device according to any one of claims 1 to 4, wherein the hierarchical structure is the bile duct structure of the liver.

10. The extraction unit extracts the hierarchical structure of an organ from a medical image representing that organ, each having its own region. The setting unit sets index values ​​for lesions of the organs according to the hierarchical structure, The generation unit generates a display image that shows the index values ​​for the lesions in each of the regions based on the hierarchical structure and the index values, The display control unit causes the display image to be displayed on the display, A medical information processing method equipped with [a specific feature].

11. An extraction function that extracts the hierarchical structure of an organ from medical images representing the organs, each having its own region, A setting function for setting index values ​​related to lesions of the organs according to the hierarchical structure, A generation function that generates a display image showing the index values ​​for the lesions in each of the aforementioned regions, based on the aforementioned hierarchical structure and the aforementioned index values, A display control function that displays the aforementioned display image on a display, A medical information processing program that enables computers to perform this task.

Images