Medical image display system, medical image display method, and program

Abstract

To help medical novices grasp an organ three-dimensionally from a plane organ image.SOLUTION: A medical image display system 1 comprises: organ image acquisition means 10 that displays a plane organ image photographing an organ, and a 3D simulation image serving as a 3D model simulating the organ three-dimensionally and being an image of a simulation organ made of a plurality of portions, and acquires the organ image; simulation organ acquisition means 30 that acquires the simulation organ; display control means 50 that displays, on display means, the organ image and the 3D simulation image based on the simulation organ; and photographing position information reception means 40 that receives photographing position information indicative of a photographing position of the organ in the organ image. The display control means 50 is configured to change a direction of the simulation image in the 3D simulation image displayed on the display means on the basis of the photographing position information received by the photographing position information reception means 40.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a medical image display system, a medical image display method, and a program.

Background Art

[0002] For example, in Patent Document 1, as a method for imaging a coronary artery of interest of a patient, computer tomography (CT) imaging data depicting a coronary artery branch is obtained, a single angiographic projection of the coronary artery of interest is obtained, and a method of aligning the single angiographic projection with the CT imaging data is proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Here, an organ image obtained by imaging an organ (for example, an angiographic projection or the like) is planar, and in order to grasp the organ three-dimensionally from this planar organ image, a lot of experience and knowledge of medical professionals such as doctors are required. For this reason, beginners such as interns with little experience and knowledge have difficulty grasping the organ three-dimensionally from a planar organ image.

[0005] However, in order to implement the method of Patent Document 1, in addition to a contrast device for obtaining a contrast projection, a medical CT (Computed Tomography) device for performing tomography and three-dimensional display is required. Generally, a CT device is expensive and the number of installed units in a medical institution is limited, and beginners such as interns cannot use it for learning and practice to grasp an organ three-dimensionally.

[0006] This invention was made to solve these problems and aims to provide a medical image display system, a medical image display method, and a program that can help medical beginners understand organs three-dimensionally from two-dimensional organ images. [Means for solving the problem]

[0007] (1) A medical image display system that displays a two-dimensional organ image obtained by photographing an organ, and a 3D simulated image which is a 3D model that mimics an organ in three dimensions and is an image of a simulated organ consisting of multiple parts, The organ image acquisition means for acquiring the aforementioned organ image, The means for acquiring the simulated organs, A display control means for displaying the aforementioned organ image and the 3D simulated image based on the simulated organ on a display means, A means for receiving imaging location information that receives imaging location information indicating the imaging location of an organ in the aforementioned organ image, Equipped with, A medical image display system characterized in that the display control means changes the orientation of the simulated organ in the 3D simulated image displayed on the display means based on the shooting position information received by the shooting position information receiving means.

[0008] According to the invention of (1), a medical image display system that displays a planar organ image (such as an X-ray image or an image taken with an endoscope) and a 3D simulated image which is an image of a simulated organ consisting of multiple parts that three-dimensionally simulates an organ (for example, a 3D model obtained by 3D scanning a pre-existing model, or a 3D model obtained by three-dimensionally modeling an organ) comprises an organ image acquisition means, a simulated organ acquisition means, a display control means, and an imaging position information receiving means. The organ image acquisition means acquires organ images. The means of obtaining simulated organs is to obtain simulated organs. The display control means displays organ images and 3D simulated images based on simulated organs on the display means. The imaging location information receiving means receives imaging location information indicating the imaging location of an organ in an organ image. The display control means then changes the orientation of the simulated organs in the 3D simulated image displayed on the display means based on the shooting position information received by the shooting position information receiving means.

[0009] This makes it possible to display both a two-dimensional organ image, which is a photograph of an organ, and a 3D simulated organ image, which is a three-dimensional representation of the organ. Furthermore, in the 3D simulated image, the simulated organ can be displayed with an orientation corresponding to the position of the organ in the photograph.

[0010] Here, 3D simulated images are images of simulated organs that three-dimensionally model the organs, and are not data obtained by photographing actual human organs. Therefore, they can be created in advance based on existing models or materials, stored in a memory device, and retrieved (read out) from the memory device when needed for use. For this reason, it is possible to easily obtain a three-dimensional representation of organs compared to conventional techniques that use a CT scanner to take tomographic images of actual humans and display them three-dimensionally.

[0011] Therefore, without requiring expensive equipment such as a CT scanner, organs can be displayed three-dimensionally at any time. This can be displayed alongside two-dimensional organ images, and their orientation can be changed in conjunction, making it easy for medical beginners to use for learning and practice. Therefore, we can provide a medical image display system that can help medical beginners understand organs in three dimensions from two-dimensional images of those organs.

[0012] Furthermore, conventionally, experienced and knowledgeable medical professionals, such as doctors, would mentally convert two-dimensional images of organs into three-dimensional representations before performing surgeries and other procedures. According to the present invention, even for such experienced and knowledgeable doctors, it becomes possible to visualize organs three-dimensionally without using expensive equipment such as CT scanners, thereby improving the accuracy of procedures and judgments.

[0013] Furthermore, by using simulated organs, which are 3D models that mimic organs in three dimensions, it is not necessary to irradiate actual patients with X-rays or other radiation and acquire actual patient data in advance. This reduces the invasiveness to patients, such as radiation exposure and drug administration, before surgery.

[0014] (2) The medical image display system according to (1), characterized in that the display control means displays the 3D simulated image of the simulated organ, in which a plurality of parts are colored differently from each other, on the display means.

[0015] In this case, if the organ images are X-ray images, they are displayed in grayscale, making it difficult to understand the spatial relationships between the different parts of the organ. According to invention (2), in the 3D simulated image, multiple parts are colored differently from each other, making it easy for even beginners to understand the structure of organs and the individual parts of organs.

[0016] (3) The display control means is Identification information that identifies each of the multiple aforementioned parts is associated with each of the multiple aforementioned parts of the simulated organ, and the 3D simulated image is displayed on the display means. The medical image display system according to (1) or (2), characterized in that when the orientation of the simulated organ in the 3D simulated image is changed based on the aforementioned shooting position information, the position of the identification information is also changed.

[0017] According to invention (3), in a 3D simulated image, identification information that identifies each part can be associated with each part of a simulated organ, and the 3D simulated image can be displayed accordingly. This makes it easy for even beginners to recognize each part of an organ. Furthermore, when changing the orientation of a simulated organ in a 3D simulated image based on the imaging position information indicating the organ's position in the organ image, the position of the identification information is also changed. This prevents the recognition of organ identification information from becoming difficult due to a change in orientation, as the identification information in the 3D simulated image also moves accordingly when the imaging position of an organ in the organ image is changed.

[0018] (4) The display control means displays the 3D simulation image showing a part of the simulated organ on the display means, and the medical image display system according to any one of (1) to (3).

[0019] Here, many organs have a complex structure. Therefore, when a simulated organ of the entire organ is displayed, the 3D simulation image becomes complicated, and it may be difficult for beginners to recognize the parts of the organ. According to the invention of (4), since only a part of the simulated organ can be displayed, it is possible to display the simulated organ of an organ having a complex structure in an easy-to-understand manner.

[0020] (5) The display control means switches between the 3D simulation image showing a part of the simulated organ and the 3D simulation image showing the whole of the simulated organ and displays them on the display means, and the medical image display system according to (4).

[0021] Here, when a simulated organ of an organ having a complex structure is displayed, the 三维模拟图像 becomes complicated. On the other hand, when only a part of the simulated organ is displayed, there is a problem that it becomes impossible to recognize which part of the whole simulated organ this part is. According to the invention of (5), since it is possible to switch between and display a 3D simulation image showing a part of the simulated organ and a 3D simulation image showing the whole of the simulated organ, it is possible to display only a part of the simulated organ, deepen the understanding of the part, switch to the display of the whole, and deepen the understanding of the organ while confirming the position of the part in the whole organ.

[0022] (6) A method executed by a medical image display system that displays a planar organ image obtained by photographing an organ and a 3D simulation image that is a 3D model that three-dimensionally simulates the organ and is an image of a simulated organ composed of a plurality of parts, a step of acquiring the organ image, a step of acquiring the simulated organ, a step of displaying the organ image and the 3D simulation image based on the simulated organ on a display means, The steps include receiving imaging position information indicating the imaging position of the organ in the aforementioned organ image, Includes, A medical image display method characterized by changing the orientation of the simulated organ in the 3D simulated image displayed on the display means based on the received shooting position information.

[0023] (7) A medical image display system that displays two-dimensional organ images taken of organs and 3D simulated images, which are 3D models that mimic organs in three dimensions and consist of multiple parts. organ image acquisition means for acquiring the aforementioned organ image, Means for acquiring the simulated organs, Display control means for displaying the organ image and the 3D simulated image based on the simulated organ on a display means. A means for receiving imaging location information that receives imaging location information indicating the imaging location of an organ in the aforementioned organ image, To make it function as, The display control means is a program characterized by changing the orientation of the simulated organs in the 3D simulated image displayed on the display means based on the shooting position information received by the shooting position information receiving means.

[0024] The inventions of (6) and (7) described herein provide the same effects and advantages as the medical image display system described in (1). [Effects of the Invention]

[0025] According to the present invention, it is possible to assist medical beginners in understanding an organ in three dimensions from a two-dimensional image of that organ. [Brief explanation of the drawing]

[0026] [Figure 1] This figure illustrates an overview of a medical image display system according to an embodiment of the present invention. [Figure 2] This block diagram shows the functional configuration of a medical image display system according to an embodiment of the present invention. [Figure 3]This figure shows an example of a 3D simulated image in a medical image display system according to an embodiment of the present invention. [Figure 4] This figure shows an example of a 3D simulated image in a medical image display system according to an embodiment of the present invention. [Figure 5] This figure illustrates an example of switching 3D simulated images in a medical image display system according to an embodiment of the present invention. [Figure 6] This is a flowchart showing the medical image display process performed in the medical image display system according to an embodiment of the present invention. [Figure 7] This figure illustrates the operation and effects of a medical image display system according to an embodiment of the present invention. [Figure 8] This figure illustrates the operation and effects of a medical image display system according to an embodiment of the present invention. [Figure 9] This figure illustrates another example of a 3D simulated image in a medical image display system according to an embodiment of the present invention. [Modes for carrying out the invention]

[0027] Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the attached drawings.

[0028] [Overview of the Medical Image Display System] Figure 1 is a diagram illustrating an overview of a medical image display system according to an embodiment of the present invention. The overview of the medical image display system 1 will be described below. The medical image display system 1 displays planar organ images, which are images of organs that have been photographed, and 3D simulated organ images, which are images of simulated organs that are three-dimensional replicas of organs and consist of multiple parts, on a display means 300 (for example, a display, etc.).

[0029] Medical image display system 1 is used, for example, in angiography, but is not limited to this; it can be used in examinations using radiation, surgeries, and other procedures that require the display of images of organs. Furthermore, medical image display system 1 can also be used as a learning device (for example, a smartphone or tablet running an application that implements the functions of medical image display system 1) that enables novice physicians, such as trainees, who have little experience or knowledge of understanding organs in three dimensions, to learn and practice understanding organs in three dimensions.

[0030] In the example shown in Figure 1, the organ image is an image captured by an image acquisition medical device 100 (for example, a contrast device). In this embodiment, the coronary artery is used as an example of an organ, but the present invention can display not only blood vessels such as coronary arteries, but also other organs such as bones, nerves, lungs, and livers.

[0031] A simulated organ is, for example, a 3D model generated by scanning a three-dimensional model of an organ with a 3D scanner. Alternatively, a simulated organ may be generated from coordinate plots such as point cloud data of a three-dimensional model of an organ, or it may be a 3D model created by referencing an organ without using a physical model. A 3D simulated image displays a simulated organ viewed from any direction (for example, the direction from which the organ was photographed in an organ image).

[0032] The medical image display system 1 acquires, for example, an organ image (e.g., a contrast-enhanced image) of an organ captured by the image acquisition medical device 100. The medical image display system 1 also acquires, for example, a simulated organ of the organ from a storage means. The medical image display system 1 then displays the acquired organ image and the acquired 3D simulated image of the simulated organ on the display means 300.

[0033] Furthermore, the medical image display system 1 receives imaging position information indicating the imaging location of the organ in the organ image.

[0034] In this embodiment, the image acquisition medical device 100, for example, if it is a contrast device (X-ray device), can change the direction in which it photographs an organ based on the operation of the operator operating the image acquisition medical device 100. In this embodiment, the shooting position information is information indicating the direction in which the organ was photographed. When the direction in which the organ was photographed changes based on the operator's operation, the orientation of the organ displayed in the organ image naturally changes.

[0035] The medical image display system 1 then changes the orientation of the simulated organ in the 3D simulated image based on the shooting position information. In other words, if the direction in which the organ was photographed in the organ image changes, the medical image display system 1 changes the orientation of the simulated organ in the 3D simulated image in conjunction with this change.

[0036] This medical image display system 1 allows for the three-dimensional display of organs at any time without requiring expensive equipment such as a CT scanner. It also allows for the simultaneous display of this three-dimensional image alongside a two-dimensional organ image, and the rotation of these images can be changed in conjunction with each other. Therefore, it can be easily used by medical beginners for learning and practice. Therefore, it becomes possible to help medical beginners understand organs in three dimensions from two-dimensional images of those organs.

[0037] Furthermore, by using simulated organs, which are 3D models that mimic organs in three dimensions, it is not necessary to irradiate actual patients with X-rays or other radiation and acquire actual patient data in advance. This reduces the invasiveness to patients, such as radiation exposure and drug administration, before surgery.

[0038] [System Functional Configuration] Next, we will explain the system's functional configuration. Figure 2 is a block diagram showing the functional configuration of a medical image display system according to an embodiment of the present invention.

[0039] The medical image display system 1 comprises an organ image acquisition means 10, a simulated organ generation means 20, a simulated organ acquisition means 30, a shooting position information receiving means 40, and a display control means 50. It is possible to connect an image acquisition medical device 100, a storage means 200, a display means 300, etc. The display means 300 displays a planar organ image obtained by photographing an organ, and a 3D simulated image which is a three-dimensional model of an organ consisting of multiple parts.

[0040] The medical image display system 1 may function within the image acquisition medical device 100, or it may be a separate device from the image acquisition medical device 100. Furthermore, the medical image display system 1 may include devices having functions equivalent to storage and display means, or, as shown in Figure 2, the storage means 200 and display means 300 may be provided as separate devices and connected.

[0041] The organ image acquisition means 10 acquires organ images. The organ image acquisition means 10 may acquire images of organs captured by the connected medical image acquisition device 100 in real time as organ images, or it may acquire organ images that have been captured in advance by the medical image acquisition device 100 and stored in an external storage means 200 or an internal storage means by reading them from these storage means.

[0042] Furthermore, the organ image acquisition means 10 associates the organ image acquired from the image acquisition medical device 100 with shooting position information indicating the shooting position of the organ in the organ image (the direction in which the organ was photographed) and stores it in the storage means. The shooting position information is acquired from the image acquisition medical device 100 by the shooting position information receiving means 40, which will be described later.

[0043] The simulated organ generation means 20 generates a 3D model of the simulated organ from data read by a 3D scanner and stores it in a storage means. The simulated organ generation means 20 also sets a reference position for the simulated organ. The reference position is the orientation of the simulated organ in its initial state (the state in which the orientation of the simulated organ has not been changed) in the 3D simulated image (an image of the simulated organ viewed from a predetermined direction) displayed by the display control means 50, which will be described later. For example, in the case of a simulated organ of a human coronary artery, the reference position is the direction from which a person is viewed from the front.

[0044] Figure 3 shows an example of a 3D simulated image in a medical image display system according to an embodiment of the present invention. In the example shown in Figure 3, the image acquisition medical device 100 is used as a 3D scanner to 3D scan a model that three-dimensionally simulates the coronary arteries, and the resulting 3D model of the simulated organ is shown as a 3D simulated image viewed from any direction. In this initial state, all parts of the 3D model are assigned the same color (for example, the default color).

[0045] The simulated organ generation means 20 classifies the simulated organ into multiple parts (for example, parts of organs classified in medicine) and assigns different colors to these parts.

[0046] Furthermore, the simulated organ generation means 20 associates identification information, which identifies multiple body parts, with each body part of the simulated organ.

[0047] The simulated organ generation means 20 may, for example, analyze the generated simulated organs using AI (artificial intelligence) and assign color or identification information to each part, or it may assign color or identification information to each part based on user operation.

[0048] Figure 4 shows an example of a 3D simulated image in a medical image display system according to an embodiment of the present invention. In the example shown in Figure 4, each part of the simulated organ in the 3D simulated image shown in Figure 3 is assigned a different color, and each part is associated with identification information (for example, "1", "2", "13", "4PO", etc.).

[0049] In the example shown in Figure 4, the identification information is linked to each part of the simulated organ by connecting them with auxiliary lines. This prevents the simulated organ and the identification information from overlapping in the 3D simulated image, making recognition difficult. Alternatively, the identification information could be placed at the respective positions of each part of the simulated organ, omitting the auxiliary lines.

[0050] In this embodiment, each part of the simulated organ is classified according to the AHA classification (American Heart Association Committee Report) of the coronary arteries, and the codes specified in this AHA classification are used as identification information. However, the classification of each part of the simulated organ is not limited to this, and it can be classified at any position, and any identification information can be attached to each part.

[0051] Returning to Figure 2, the simulated organ acquisition means 30 acquires a simulated organ. The simulated organ acquisition means 30 reads the simulated organ from the storage means.

[0052] The imaging location information receiving means 40 receives imaging location information indicating the imaging location of an organ in an organ image. When acquiring organ images in real time from the image acquisition medical device 100, the imaging location information receiving means 40 receives imaging location information indicating the imaging location of an organ in an organ image acquired by the organ image acquisition means 10 from the image acquisition medical device 100. When reading an organ image from the storage means, the imaging location information receiving means 40 reads the imaging location information associated with the organ image in the storage means.

[0053] The display control means 50 displays the organ image and the 3D simulated image side by side on the display means (for example, the display means 300). Specifically, the display control means 50 displays the organ image acquired by the organ image acquisition means 10 on the display means. The display control means 50 also displays a 3D simulated image on the display means showing the simulated organ acquired by the simulated organ acquisition means 30 as viewed from a predetermined direction.

[0054] In its initial state, the medical image display system 1 acquires organ images using the organ image acquisition means 10, which are images of organs taken from a frontal view of a person (a person lying supine on a bed and photographed from above). The display control means 50 then displays a medical image on the display means, which combines these organ images with the initial 3D simulated images of simulated organs acquired by the simulated organ acquisition means 30 (see Figure 1).

[0055] Furthermore, the display control means 50 changes the orientation of the simulated organ in the 3D simulated image based on the shooting position information received by the shooting position information receiving means 40. Specifically, for example, in the image acquisition medical device 100, if the camera position is changed from the initial state, the orientation of the organ displayed in the organ image is changed, and the organ image acquisition means 10 acquires the changed organ image. The shooting position information receiving means 40 also receives shooting position information indicating the shooting position of the changed organ. The display control means 50 then displays the changed organ image and the 3D simulated image of the simulated organ viewed from the direction indicated by the changed shooting position information on the display means. The display control means 50 may also display the shooting position information (for example, the rotation angle from the initial state (initial position (for example, 0 degrees))) on the display means.

[0056] Furthermore, if the simulated organ generation means 20 has assigned different colors to multiple parts of the simulated organ, the display control means 50 will display a 3D simulated image of the simulated organ with different colors assigned to multiple parts on the display means 300.

[0057] Furthermore, if the simulated organ generation means 20 has assigned identification information to multiple parts of the simulated organ, the display control means 50 displays a 3D simulated image on the display means 300 in which the identification information is associated with each of the multiple parts of the simulated organ. In this case, if the display control means 50 changes the orientation of the simulated organ in the 3D simulated image based on the shooting position information received by the shooting position information receiving means 40, it also changes the position of the identification information.

[0058] Furthermore, the display control means 50 may change the display mode of the simulated organs in the 3D simulated image based on the user's operation. For example, the display control means 50 may switch the display of the simulated organs to one of the following states based on the user's operation: the initial state shown in Figure 3, the state with color and identification information shown in Figure 4, the state with only color, or the state with only identification information. This makes it possible to display the simulated organs in a manner appropriate to the beginner's level of proficiency, thereby promoting the beginner's learning.

[0059] Furthermore, the display control means 50 displays a 3D simulated image showing a part of the simulated organ on the display means 300. The display control means 50 also switches between displaying a 3D simulated image showing a part of the simulated organ and a 3D simulated image showing the entire simulated organ on the display means 300.

[0060] Figure 5 illustrates an example of switching 3D simulated images in a medical image display system according to an embodiment of the present invention. In the example shown in Figure 5, the simulated organ displayed in the 3D simulated image is the coronary artery. The display control means 50 switches the simulated organ of the coronary artery displayed in the 3D simulated image to the whole, a part (e.g., the left coronary artery), or another part (e.g., the right coronary artery), according to the user's operation, and displays it on the display means 300.

[0061] The display control means 50, for example, when only a part of a simulated organ is displayed in the 3D simulated image, changes the orientation of the part of the simulated organ displayed in the 3D simulated image if the shooting position information received by the shooting position information receiving means 40 is changed (i.e., the orientation of the organ displayed in the organ image is changed). Then, if the simulated organ displayed in the 3D simulated image is switched from this part to the whole or another part, the display control means 50 also displays the switched simulated organ (whole or other part) in the changed orientation.

[0062] Furthermore, the display control means 50 is not limited to this configuration and may display 3D simulated images of the entire and a part of the simulated organ viewed from different directions (for example, the entire organ remaining in its initial state, while the part is oriented according to the shooting position information). The display control means 50 may also display the entire and a part of the simulated organ at different magnifications. In addition, the display control means 50 may display the entire and a part side by side without switching between them.

[0063] The functional configuration of this system described above is merely an example, and a single functional block (database and functional processing unit) may be divided, or multiple functional blocks may be combined into a single functional block. Each functional processing unit is realized by a computer program (for example, core software or an application that causes the CPU to execute the various processes described above) stored in a storage device (storage means) such as ROM (Read Only Memory), flash memory, SSD (Solid State Drive), or hard disk, which is read by the CPU (Central Processing Unit) built into the device or terminal, and executed by the computer program. In other words, each functional processing unit is realized by this computer program reading and writing necessary data such as tables from a database (DB) stored in the storage device or from a storage area in memory, and, if necessary, controlling related hardware (for example, input / output devices, display devices, communication interface devices). Furthermore, the database (DB) in the embodiments of the present invention may be a commercial database, but it also means a mere collection of tables and files, and the internal structure of the database itself is not specified.

[0064] [Medical image display processing] Next, we will explain the medical image display processing performed by this system. In the following processing flow chart, the processing order of each step may be changed as long as the relationship between the input and output of each step is not compromised. Figure 6 is a flowchart showing the medical image display process performed in a medical image display system according to an embodiment of the present invention.

[0065] In step S1, the organ image acquisition means 10 acquires organ images, which are images of organs taken by the image acquisition medical device 100, from the image acquisition medical device 100 or the storage means.

[0066] In step S2, the simulated organ acquisition means 30 reads a simulated organ from the memory means.

[0067] In step S3, the display control means 50 displays a medical image on the display means which is a combination of the organ image acquired by the organ image acquisition means 10 in step S1 and the 3D simulated image of the simulated organ in its initial state acquired by the simulated organ acquisition means 30 in step S2.

[0068] If organ images are being acquired in real time, in step S4, if the camera position of the image acquisition medical device 100 is changed (the orientation of the organ displayed in the organ image is changed), the organ image acquisition means 10 acquires the changed organ image from the image acquisition medical device 100. At this time, the shooting position information receiving means 40 receives shooting position information from the image acquisition medical device 100 indicating the shooting position of the organ in the changed organ image acquired by the organ image acquisition means 10.

[0069] Furthermore, if organ images that have been stored in advance have been acquired from the storage means, in step S4, the organ image acquisition means 10 acquires an organ image in which the orientation of the organ is different from the organ image currently being displayed, based on the user's operation. At this time, the shooting position information receiving means 40 reads out the shooting position information associated with the organ image in the storage means.

[0070] In step S5, the display control means 50 updates the medical image displayed in step S3 based on the shooting position change process in step S4. Specifically, the display control means 50 changes the organ image acquired by the organ image acquisition means 10 in step S1 to the organ image acquired in step S4, and changes the 3D simulated image displayed in step S3 to a 3D simulated image in which the orientation of the simulated organ has been changed based on the shooting position information received by the shooting position information receiving means 40 in step S4.

[0071] Figure 7 is a diagram illustrating the operation and effects of a medical image display system according to an embodiment of the present invention. In Figure 7, explanations (arrows, "right coronary artery inlet, from back to front of the screen," "distal part of the third coronary artery, from front to back of the screen," and symbols attached to the organ image) are added to the medical image displayed by the medical image display system 1 to facilitate understanding, corresponding to the parts of the organs displayed in the organ image and the simulated organs displayed in the 3D simulated image.

[0072] As shown in Figure 7, for example, if the medical imaging device 100 is a contrast-enhanced device (X-ray machine), the organ image will be displayed flatly using shades of grayscale. Furthermore, such an image of the organ will only be displayed while the contrast agent administered to the person being imaged is still effective, and even then, the shades will fluctuate and the display will not be stable. For this reason, it is extremely difficult for medical beginners to grasp the structure of an organ from such an unclear, flat image.

[0073] In contrast, 3D simulated images are images of simulated organs that three-dimensionally model the organs, allowing for a clear and three-dimensional display of the simulated organs (for example, they can be displayed in a form that approximates the shape described in textbooks). Therefore, beginners can grasp the structure of organs from 3D simulated images. However, simply looking at 3D simulated images alone will not enable one to grasp the structure of organs from actual organ images. By correlating the knowledge gained from the textbook-like simulated organs displayed in 3D simulated images with the actual organs displayed in organ images, it becomes ultimately possible to grasp the structure of organs from organ images alone.

[0074] Furthermore, since the image acquisition medical device 100 displays a 3D simulated image of a simulated organ in an orientation corresponding to the angle the camera is pointing, it becomes possible to observe the 3D simulated image in a continuous manner when the angle is changed, making it easier to grasp the three-dimensional aspect of a planar image. Specifically, for example, it becomes easier to grasp a three-dimensional image from the movement of blood vessels as they intersect front, back, left, and right.

[0075] Furthermore, by displaying 3D simulated images of the organs before imaging, it becomes possible to know the imaging direction of the organs before taking the images. This makes it possible to understand the three-dimensional orientation of the coronary arteries that will be imaged next in advance.

[0076] Figure 8 illustrates the operation and effects of a medical image display system according to an embodiment of the present invention. Figure 8 shows an example of a medical image displayed by the medical image display system 1 when a catheter is placed in a coronary artery.

[0077] In this case, when placing a catheter in the coronary artery, the catheter is used to locate the entrance to the coronary artery and selectively advance through the branches, relying on fluoroscopic images (pulsed video images like those on a television) that project only the outlines of the bones and heart without the use of contrast agents. However, in the past, it was difficult for beginners to grasp the direction of the entrance using only fluoroscopic images (organ images) that showed only the outlines of the bones and heart.

[0078] As shown in Figure 8, the medical image display system 1 makes it possible to learn catheter manipulation by knowing the target direction from a 3D simulated image of a modeled organ. Furthermore, by displaying the angle indicating the direction from which the simulated organ is viewed, corresponding to the angle indicating the direction of shooting of the organ in the organ image (camera rotation angle), beginners can learn the approximate direction from fluoroscopic images where only the outlines of bones and hearts are projected, and receive technical explanations from, for example, experienced physicians or other instructors. In addition, instructors can provide real-time explanations of procedures using 3D simulated images of modeled organs. Thus, the medical image display system 1 makes it easier for learners to understand and easier for instructors to provide guidance.

[0079] Furthermore, according to the medical image display system 1, for example, organ images already taken during surgery can be read from the storage means, and a medical image displaying the read-out organ image and the 3D simulated image together can be shown, making it possible to manually reproduce and preview angles corresponding to the series taken during past surgeries. In this case, with the medical image display system 1, just as during surgery, when the orientation of the camera of the image acquisition medical device 100 is changed, the simulated organ in the 3D simulated image automatically follows and changes its orientation. With this configuration, in situations where technical guidance was previously given in an adjacent room through a glass partition or using only models, it becomes possible to provide technical guidance while comparing organ images and 3D simulated images, thereby improving the understanding of beginners.

[0080] Figure 9 illustrates another example of a 3D simulated image in a medical image display system according to an embodiment of the present invention. In the above description of the embodiment, an example was shown in which the background of the main simulated organ (e.g., coronary artery) in the 3D simulated image is filled with a single color (e.g., black). However, the background of the 3D simulated image may be other simulated organs (e.g., exemplary simulated organs for alignment (spine skeleton)). That is, the medical image display system 1 may arrange multiple types of simulated organs (first simulated organ, second simulated organ in the example shown in Figure 9) in exemplary positional relationships in the 3D simulated image.

[0081] Furthermore, if the camera position of the image acquisition medical device 100 is changed based on the user's operation (the orientation of the organs displayed in the organ images is changed), the orientation (rotation angle) of multiple types of simulated organs in the 3D simulated image may be changed accordingly.

[0082] This makes it possible to overlay and understand the main simulated organ (e.g., coronary artery) with the surrounding organs (e.g., alignment), thereby improving beginners' understanding of the relative positions of multiple types of organs.

[0083] According to the medical image display system 1, it is possible to display both a two-dimensional organ image, which is a photograph of an organ, and a 3D simulated organ image, which is a three-dimensional representation of the organ. Furthermore, in the 3D simulated image, the simulated organ can be displayed in an orientation corresponding to the position of the organ in the photograph. This makes it possible to help beginners understand the organ in three dimensions from a two-dimensional organ image.

[0084] Furthermore, 3D simulated images are images of simulated organs that are three-dimensional representations of organs, and are not data obtained by photographing actual human organs. Therefore, they can be created in advance based on existing models and materials, stored in a memory device, and retrieved (read out) from the memory device when needed for use. For this reason, it is possible to easily obtain a three-dimensional representation of organs compared to tomographic imaging of an actual human being using a CT scanner and displaying it in three dimensions.

[0085] Here, when a CT scanner is used to take cross-sectional images of an actual human being, the shape of the organs differs from person to person. According to the medical image display system 1, by using simulated organs that are three-dimensional replicas of organs, the same exemplary defect can be continuously reproduced in all examinations. This makes it possible for beginners to learn the exemplary shape and alignment.

[0086] Therefore, without requiring expensive equipment like a CT scanner, organs can be displayed three-dimensionally at any time. This can be displayed alongside a two-dimensional organ image, and the orientation of these images can be changed in conjunction, making it easy for medical beginners to use for learning and practice. Therefore, we can provide a medical image display system that can help medical beginners understand organs in three dimensions from two-dimensional images of those organs.

[0087] Furthermore, according to the medical image display system 1, even experienced doctors and other medical professionals can visualize organs in three dimensions without using expensive equipment such as CT scanners, thereby improving the accuracy of procedures and diagnoses.

[0088] Furthermore, according to the medical image display system 1, by using simulated organs, which are 3D models that mimic organs in three dimensions, it is not necessary to irradiate actual patients with X-rays or other radiation and acquire actual patient data in advance. Therefore, it is possible to reduce invasiveness to patients such as radiation exposure and drug administration before surgery.

[0089] Furthermore, when organ images are X-ray images, they are displayed in achromatic colors, making it difficult to grasp the spatial relationships between different parts of the organ. However, with the medical image display system 1, multiple parts are colored differently in the 3D simulated image, making it easy for even beginners to understand the structure of the organ and its various parts.

[0090] Furthermore, according to the medical image display system 1, in 3D simulated images, identification information that identifies each part can be associated with each part of a simulated organ, and the 3D simulated image can be displayed accordingly. This makes it easy for even beginners to recognize each part of an organ. Furthermore, when changing the orientation of a simulated organ in a 3D simulated image based on the imaging position information indicating the organ's position in the organ image, the position of the identification information is also changed. This prevents the recognition of organ identification information from becoming difficult due to a change in orientation, as the identification information in the 3D simulated image also moves accordingly when the imaging position of an organ in the organ image is changed.

[0091] Furthermore, many organs have complex structures. Therefore, when a simulated organ of the entire organ is displayed, the 3D image can become cluttered, making it difficult for beginners to recognize the organ's location. However, with the medical image display system 1, it is possible to display only a portion of the simulated organ, making it possible to display simulated organs with complex structures in an easily understandable way.

[0092] Furthermore, when displaying simulated organs with complex structures, the 3D simulated image becomes cluttered. On the other hand, when only a part of a simulated organ is displayed, it becomes impossible to recognize which part of the entire simulated organ that part belongs to. According to the medical image display system 1, it is possible to switch between displaying a 3D simulated image showing a part of a simulated organ and a 3D simulated image showing the entire simulated organ. This allows users to deepen their understanding of the organ by displaying only a part of it, and then switch to displaying the entire organ to confirm its position within the whole organ.

[0093] Although embodiments of the present invention have been described above, it goes without saying that the technical scope of the present invention is not limited to the contents of the above embodiments. It will be obvious to those skilled in the art that various modifications or improvements can be made to the above embodiments. Furthermore, it is clear from the claims that such modified or improved forms are also included in the technical scope of the present invention. [Explanation of symbols]

[0094] 1. Medical Image Display System 10. Organ image acquisition method 20. Means for generating simulated organs 30. Means of obtaining simulated organs 40. Means for receiving shooting location information 50 Display control means 100 Medical imaging devices 200 Memory means 300 Display means

Claims

1. A medical image display system that displays two-dimensional organ images taken from photographs of organs, and 3D simulated images, which are three-dimensional models of organs and are images of simulated organs consisting of multiple parts. The organ image acquisition means for acquiring the aforementioned organ image, A simulated organ acquisition means that acquires data not by photographing actual human organs, but by reading from a storage means the simulated organs that have been created in advance as 3D models and stored in a storage means, A display control means that displays the organ image and the 3D simulated image based on the simulated organ on a display means, A means for receiving imaging location information that receives imaging location information indicating the imaging location of an organ in the aforementioned organ image, Equipped with, A medical image display system characterized in that the display control means changes the orientation of the simulated organ in the 3D simulated image displayed on the display means based on the shooting position information received by the shooting position information receiving means.

2. The medical image display system according to claim 1, characterized in that the display control means displays the 3D simulated image of the simulated organ, in which multiple parts are colored differently from each other, on the display means.

3. The display control means is Identification information that identifies each of the multiple aforementioned parts is associated with each of the multiple aforementioned parts of the simulated organ, and the 3D simulated image is displayed on the display means. The medical image display system according to claim 1 or 2, characterized in that when the orientation of the simulated organ in the 3D simulated image is changed based on the aforementioned shooting position information, the position of the identification information is also changed.

4. The medical image display system according to either claim 1 or 2, characterized in that the display control means displays the 3D simulated image showing a part of the simulated organ on the display means.

5. The medical image display system according to claim 4, characterized in that the display control means switches between the 3D simulated image showing a part of the simulated organ and the 3D simulated image showing the whole of the simulated organ and displays them on the display means.

6. A method performed by a medical image display system that displays a two-dimensional organ image obtained by photographing an organ, and a 3D simulated image which is a 3D model that mimics an organ in three dimensions and is an image of a simulated organ consisting of multiple parts, The steps include acquiring the aforementioned organ images, The step of acquiring data not by photographing actual human organs, but by reading from the storage means the simulated organs that have been created in advance as 3D models and stored in the storage means, The steps include displaying the organ image and the 3D simulated image based on the simulated organ on a display means, The steps include receiving imaging position information indicating the imaging position of the organ in the aforementioned organ image, Includes, A medical image display method characterized by changing the orientation of the simulated organ in the 3D simulated image displayed on the display means based on the received shooting position information.

7. A medical image display system that displays two-dimensional organ images taken from photographs of organs, and 3D simulated images, which are three-dimensional models of organs and are images of simulated organs consisting of multiple parts. organ image acquisition means for acquiring the aforementioned organ image, A simulated organ acquisition means that acquires data not by photographing actual human organs, but by reading from a storage means the simulated organs that have been created in advance as 3D models and stored in a storage means. Display control means for displaying the aforementioned organ image and the 3D simulated image based on the simulated organ on a display means. A means for receiving imaging location information that receives imaging location information indicating the imaging location of an organ in the aforementioned organ image, To make it function as, The display control means is a program that changes the orientation of the simulated organs in the 3D simulated image displayed on the display means based on the shooting position information received by the shooting position information receiving means.

Images