Medical image display device, medical image display method, and program

Abstract

To robustly acquire the position of a subject when projecting a medical image on the subject, while suppressing complication of an inspection procedure.SOLUTION: A medical image display device according to embodiment comprises an acquisition unit, a mapping unit, a generation unit, and a display control unit. The acquisition unit acquires a medical image of a subject. The mapping unit maps the position of the bed of a medical image diagnostic device with the position of the medical image. The generation unit generates a content to superimpose on the subject, based on the medical image in which an anatomical portion is detected. The display control unit controls a display unit such that the content may be superimposed and displayed on the subject, based on the position of the bed and that of the anatomical portion mapped with each other.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The embodiments disclosed in the present specification and drawings relate to a medical image display device, a medical image display method, and a program. [Background technology]

[0002] There is a demand for a display method that allows doctors and other users to intuitively observe medical images by overlaying medical images such as computed tomography (CT) images and magnetic resonance (MR) images onto a subject using image projection such as projection mapping or mixed reality. Conventional techniques include measuring the subject's position using an infrared sensor to overlay a medical image on the subject, or attaching optical markers to the subject and capturing the optical markers with a camera to measure the subject's position. However, because these conventional techniques use infrared sensors and cameras, it can be difficult to robustly acquire the subject's position due to lighting conditions and positional relationships. Furthermore, attaching optical markers to the subject before an examination is undesirable because it complicates the examination procedure. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-110444 Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the embodiments disclosed in this specification and the drawings is to robustly acquire the position of a subject when projecting a medical image onto the subject while suppressing the complexity of the examination procedure. However, the problem to be solved by the embodiments disclosed in this specification and the drawings is not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems. [Means for solving the problem]

[0005] A medical image display device according to an embodiment includes an acquisition unit, a correlation unit, a generation unit, and a display control unit. The acquisition unit acquires medical images of a subject. The correlation unit is installed in a medical image diagnostic device that scans the subject and generates the medical images, and correlates the position of a bed on which the subject rests during scanning with the position of the medical images. The generation unit generates content to be superimposed on the subject based on the medical images. The display control unit controls the display unit so that the content is superimposed on the subject based on the correlated positions of the bed and the medical images. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a diagram showing an example of the configuration of a medical image display system 1 according to a first embodiment. [Figure 2] FIG. 1 is a diagram showing an example of a usage scene of the medical image display system 1 according to the first embodiment. [Figure 3] 1 is a diagram showing an example of the arrangement of an X-ray CT apparatus 100 according to a first embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of the configuration of AR goggles 200 according to the first embodiment. [Figure 5] 4 is a flowchart showing an example of the flow of a series of processes in the medical image display system 1 according to the first embodiment. [Figure 6] FIG. 10 is a diagram showing an example of content CONT superimposed and displayed on a subject P2. [Figure 7] FIG. 10 is a diagram showing another example of the content CONT superimposed and displayed on the subject P2. [Figure 8] FIG. 10 is a diagram illustrating an example of the configuration of AR goggles 200 according to a second embodiment. [Figure 9] 10 is a flowchart showing an example of the flow of a series of processes in the medical image display system 1 according to the second embodiment. [Figure 10] 11 is a flowchart showing an example of the flow of a series of processes in the medical image display system 1 according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] Hereinafter, a medical image display device, a medical image display method, and a program according to an embodiment will be described with reference to the drawings.

[0008] (First embodiment) [Configuration of medical image display system] 1 is a diagram illustrating an example of the configuration of a medical image display system 1 according to the first embodiment. The medical image display system 1 according to the first embodiment includes, for example, a medical image diagnostic apparatus 100, a projection apparatus 200, and a camera 300. The medical image diagnostic apparatus 100, the projection apparatus 200, and the camera 300 are communicably connected via a communication network NW.

[0009] The term "communication network NW" refers to any information and communication network that utilizes telecommunications technology. It includes wireless / wired LANs such as hospital backbone LANs (Local Area Networks) and the Internet, as well as telephone communication networks, optical fiber communication networks, cable communication networks, and satellite communication networks.

[0010] The medical image diagnostic apparatus 100 is an apparatus that generates a medical image by scanning a subject P2 and diagnoses the subject P2 based on the medical image. The medical image diagnostic apparatus 100 is, for example, an X-ray CT apparatus, but may also be an MRI apparatus, a general X-ray imaging apparatus, an ultrasound imaging apparatus, a nuclear medicine diagnostic apparatus, etc. In the following, as an example, the medical image diagnostic apparatus 100 will be described as an X-ray CT apparatus.

[0011] The projection device 200 is a device that projects a medical image of the subject P2 generated by the medical image diagnostic device 100, allowing a medical professional P1 to visually recognize the inside of the body of the subject P2. The medical professional P1 is, for example, a doctor or a medical professional such as a technician or nurse. The projection device 200 may be a device that uses technology such as AR (Augmented Reality), VR (Virtual Reality), MR (Mixed Reality), or projection mapping. In the following, the projection device 200 will be described as a wearable AR goggle that applies AR technology, as an example. The medical professional P1 is an example of a "user."

[0012] The camera 300 is attached to, for example, the ceiling or wall of an examination room (hereinafter referred to as a CT room) in which the X-ray CT apparatus 100 is installed. The camera 300, for example, captures an image of a subject P2 who enters the CT room, and transmits the image of the inside of the CT room to the AR goggles 200 via a communication network NW, or transmits the image to the X-ray CT apparatus 100. The image of the camera 300 may be a still image or a moving image. The camera 300 may transmit the captured image directly to the AR goggles 200, or may transmit the image indirectly to the AR goggles 200 via the X-ray CT apparatus 100.

[0013] [Scenes where medical image display systems are used] FIG. 2 is a diagram illustrating an example of a usage scenario of the medical image display system 1 according to the first embodiment. When a medical professional P1 wears the AR goggles 200, a CT image of a subject P2 placed on a bed device 130 of the X-ray CT device 100 is projected onto the AR goggles 200. A CT image is a medical image obtained by X-ray imaging (scanning) using the X-ray CT device 100. The CT image may be a single tomographic image (i.e., a two-dimensional image) or a three-dimensional image composed of multiple tomographic images. Furthermore, the CT image may be an image of multiple time phases or a captured image.

[0014] When the medical professional P1 views the subject P2 through the AR goggles 200, it is desirable that the CT image be accurately superimposed on the body of the subject P2. In other words, alignment of the CT image with the subject P2 is important. Therefore, in the medical image display system 1, the three-dimensional position of the X-ray CT apparatus 100 relative to the CT room is measured before the subject P2 is examined. For example, an optical marker MK1 is attached to the gantry 110 of the X-ray CT apparatus 100, and images of the optical marker MK1 are captured using the cameras 300a and 300b. This allows the three-dimensional position of the gantry 110 relative to the CT room to be calculated. The optical marker MK1 may be detached from the gantry 110 at the time the subject P2 is examined or thereafter. If the cameras 300a and 300b have built-in strobe lights that emit infrared light, the optical marker MK1 may be a reflector capable of reflecting infrared light. Furthermore, if the cameras 300a and 300b do not have built-in strobe lights that emit infrared rays, the optical marker MK1 may be an emitter that spontaneously emits infrared rays.

[0015] Next, in the medical image display system 1, the three-dimensional position of the AR goggles 200 worn by the medical personnel P1 relative to the CT room is measured at the timing of examining the subject P2. For example, an optical marker MK2 is attached to the AR goggles 200, and images of the optical marker MK2 are captured using the cameras 300a and 300b. This allows the three-dimensional position of the AR goggles 200 relative to the CT room to be calculated. Like the optical marker MK1, the optical marker MK2 may be a reflector capable of reflecting infrared rays, or may be an emitter that spontaneously emits infrared rays.

[0016] Next, in the medical image display system 1, the positions of each part on the CT image, such as the heart and lungs (i.e., two-dimensional or three-dimensional positions in the image space), are converted into three-dimensional positions relative to the CT room based on the three-dimensional position of the X-ray CT device 100 relative to the CT room. Next, in the medical image display system 1, the CT image and the subject P2 are aligned based on the three-dimensional position of the AR goggles 200 relative to the CT room and the three-dimensional position of each part on the CT image relative to the CT room. As a result, when the medical personnel P1 looks at the subject P2 through the AR goggles 200, the tomographic images of each part are displayed superimposed on the subject P2, as if the inside of the subject P2 can be seen through the AR goggles 200. The alignment of the CT image and the subject P2 will be described in detail later.

[0017] [X-ray CT system configuration] FIG. 3 is a diagram illustrating an example of the configuration of an X-ray CT apparatus 100 according to the first embodiment. The X-ray CT apparatus 100 includes, for example, a gantry 110, a bed 130, and a console 140. For convenience of explanation, FIG. 3 illustrates the gantry 110 viewed from both the Z-axis direction and the X-axis direction, but in reality, there is only one gantry 110. In this embodiment, the rotation axis of the rotating frame 117 in a non-tilted state or the longitudinal direction of the tabletop 133 of the bed 130 is defined as the Z-axis direction, the axis perpendicular to the Z-axis direction and horizontal to the floor surface is defined as the X-axis direction, and the direction perpendicular to the Z-axis direction and perpendicular to the floor surface is defined as the Y-axis direction.

[0018] The gantry device 110 includes, for example, an X-ray tube 111, a wedge 112, a collimator 113, an X-ray high voltage device 114, an X-ray detector 115, a data acquisition system (hereinafter referred to as DAS: Data Acquisition System) 116, a rotating frame 117, and a control device 118.

[0019] The X-ray tube 111 generates X-rays by irradiating thermoelectrons from a cathode (filament) to an anode (target) when a high voltage is applied from the X-ray high voltage device 114. The X-ray tube 111 includes a vacuum tube. For example, the X-ray tube 111 is a rotating anode type X-ray tube that generates X-rays by irradiating a rotating anode with thermoelectrons.

[0020] The wedge 112 is a filter for adjusting the amount of X-rays irradiated from the X-ray tube 111 to the subject P2. The wedge 112 attenuates the X-rays that pass through it so that the distribution of the X-ray dose irradiated from the X-ray tube 111 to the subject P2 becomes a predetermined distribution. The wedge 112 is also called a wedge filter or a bow-tie filter. The wedge 112 is made by processing aluminum to have a predetermined target angle and a predetermined thickness, for example.

[0021] The collimator 113 is a mechanism for narrowing down the irradiation range of the X-rays that have passed through the wedge 112. The collimator 113 narrows down the irradiation range of the X-rays, for example, by forming a slit by combining multiple lead plates. The collimator 113 is also called an X-ray aperture.

[0022] The X-ray high voltage device 114 includes, for example, a high voltage generator and an X-ray control device. The high voltage generator has an electric circuit including a transformer, a rectifier, etc., and generates a high voltage to be applied to the X-ray tube 111. The X-ray control device controls the output voltage of the high voltage generator according to the X-ray dose to be generated in the X-ray tube 111. The high voltage generator may be one that performs voltage boosting using the above-mentioned transformer, or one that performs voltage boosting using an inverter. The X-ray high voltage device 114 may be provided on the rotating frame 117, or may be provided on the side of the fixed frame (not shown) of the gantry device 110.

[0023] The X-ray detector 115 detects the intensity of X-rays generated by the X-ray tube 111 and incident upon the subject P2. The X-ray detector 115 outputs an electrical signal (which may be an optical signal, etc.) corresponding to the intensity of the detected X-rays to the DAS 116. The X-ray detector 115 has, for example, multiple X-ray detection element rows. Each of the multiple X-ray detection element rows has multiple X-ray detection elements arranged in the channel direction along an arc centered on the focal point of the X-ray tube 111. The multiple X-ray detection element rows are arranged in the slice direction (column direction, row direction).

[0024] The X-ray detector 115 is an indirect detector having, for example, a grid, a scintillator array, and a photosensor array. The scintillator array has multiple scintillators. Each scintillator has scintillator crystals. The scintillator crystals emit light with an amount of light corresponding to the intensity of the incident X-rays. The grid is arranged on the surface of the scintillator array on which the X-rays are incident and has an X-ray shielding plate that has the function of absorbing scattered X-rays. The grid is sometimes called a collimator (one-dimensional collimator or two-dimensional collimator). The photosensor array has, for example, a photosensor such as a photomultiplier tube (PMT). The photosensor array outputs an electrical signal corresponding to the amount of light emitted by the scintillator. The X-ray detector 115 may also be a direct conversion detector having a semiconductor element that converts incident X-rays into an electrical signal.

[0025] The DAS 116 includes, for example, an amplifier, an integrator, and an A / D converter. The amplifier amplifies the electrical signal output by each X-ray detection element of the X-ray detector 115. The integrator integrates the amplified electrical signal over a view period (described below). The A / D converter converts the electrical signal indicating the integration result into a digital signal. The DAS 116 outputs detection data based on the digital signal to the console device 140. The detection data is a digital value of X-ray intensity identified by the channel number and column number of the X-ray detection element that generated the data, and a view number indicating the acquired view. The view number is a number that changes according to the rotation of the rotating frame 117, and is, for example, a number that is incremented according to the rotation of the rotating frame 117. Therefore, the view number is information that indicates the rotation angle of the X-ray tube 111. The view period is the period from the rotation angle corresponding to a certain view number to the rotation angle corresponding to the next view number. The DAS 116 may detect the view switching by a timing signal input from the control device 118, by an internal timer, or by a signal acquired from a sensor (not shown). When a full scan is performed and X-rays are continuously emitted by the X-ray tube 111, the DAS 116 collects a group of detection data for the entire circumference (360 degrees). When a half scan is performed and X-rays are continuously emitted by the X-ray tube 111, the DAS 116 collects detection data for half the circumference (180 degrees).

[0026] The rotating frame 117 is an annular rotating member that rotates the X-ray tube 111, wedge 112, collimator 113, and X-ray detector 115 while holding them facing each other. The rotating frame 117 is supported by a fixed frame so as to be rotatable around the subject P2 introduced inside. The rotating frame 117 also supports the DAS 116. Detection data output by the DAS 116 is transmitted by optical communication from a transmitter having a light-emitting diode (LED) provided on the rotating frame 117 to a receiver having a photodiode provided on a non-rotating portion of the gantry device 110 (e.g., the fixed frame), and then transferred by the receiver to the console device 140. Note that the method of transmitting the detection data from the rotating frame 117 to the non-rotating portion is not limited to the above-mentioned method using optical communication, and any non-contact transmission method may be adopted. The rotating frame 117 is not limited to an annular member, and may be an arm-like member as long as it can support and rotate the X-ray tube 111 and the like.

[0027] The control device 118 includes, for example, a processing circuit having a processor such as a CPU (Central Processing Unit), and a drive mechanism including a motor, an actuator, etc. The control device 118 receives input signals from an input interface 143 attached to the console device 140 or the gantry device 110, and controls the operations of the gantry device 110 and the bed device 130.

[0028] The control device 118, for example, rotates the rotating frame 117, tilts the gantry 110, or moves the tabletop 133 of the bed device 130. When tilting the gantry 110, the control device 118 rotates the rotating frame 117 around an axis parallel to the Z-axis direction based on the inclination angle (tilt angle) input to the input interface 143. The control device 118 grasps the rotation angle of the rotating frame 117 from the output of a sensor (not shown), etc. The control device 118 also provides the rotation angle of the rotating frame 117 to the processing circuit 150 as needed. The control device 118 may be provided in the gantry 110 or in the console device 140.

[0029] The bed device 130 is a device on which the subject P2 to be scanned is placed and introduced into the rotating frame 117 of the gantry device 110. The bed device 130 has, for example, a base 131, a bed driving device 132, a top plate 133, and a support frame 134. The base 131 includes a housing that supports the support frame 134 so that the support frame 134 can move in the vertical direction (Y-axis direction). The bed driving device 132 includes a motor and an actuator. The bed driving device 132 moves the top plate 133, on which the subject P2 is placed, along the support frame 134 in the longitudinal direction of the top plate 133 (Z-axis direction). The top plate 133 is a plate-shaped member on which the subject P2 is placed.

[0030] The console device 140 includes, for example, a memory 141, a display 142, an input interface 143, a communication interface 144, and a processing circuit 150. In this embodiment, the console device 140 is described as being separate from the gantry device 110, but the gantry device 110 may include some or all of the components of the console device 140.

[0031] The memory 141 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, or the like. The memory 141 stores, for example, detection data, projection data, a reconstructed image, a CT image, or the like. These data may be stored in an external memory with which the X-ray CT apparatus 100 can communicate, instead of (or in addition to) the memory 141. The external memory is controlled by, for example, a cloud server that manages the external memory, by the cloud server accepting a read / write request. The memory 141 may include a non-transitory storage medium such as a ROM (Read Only Memory) or a register.

[0032] The display 142 displays various types of information. For example, the display 142 displays a CT image generated by the processing circuitry 150, a GUI (Graphical User Interface) that accepts various operations by an operator (e.g., the subject P2), etc. The display 142 is, for example, a liquid crystal display (LCD), a cathode ray tube (CRT) display, an organic electroluminescence (EL) display, etc. The display 142 may be provided on the gantry device 110. The display 142 may be a desktop type, or may be a display device (e.g., a tablet terminal) that can communicate wirelessly with the main body of the console device 140.

[0033] The input interface 143 accepts various input operations by an operator (e.g., the subject P2) and outputs an electrical signal indicating the content of the accepted input operation to the processing circuitry 150. For example, the input interface 143 accepts input operations such as acquisition conditions for acquiring detection data or projection data (described later), reconstruction conditions for reconstructing CT images, and image processing conditions for generating post-processed images from CT images. For example, the input interface 143 is realized by a mouse, keyboard, touch panel, drag ball, switch, button, joystick, foot pedal, camera, infrared sensor, microphone, etc. The input interface 143 may be provided in the gantry device 110. The input interface 143 may also be realized by a display device (e.g., a tablet terminal) capable of wireless communication with the main body of the console device 140. Note that, in this specification, the input interface 143 is not limited to one having physical operation components such as a mouse and keyboard. For example, an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs the electrical signal to a control circuit is also included as an example of the input interface 143.

[0034] The communication interface 144 includes, for example, a network interface card (NIC), a wireless communication module, etc. The communication interface 144 communicates with external devices such as the AR goggles 200 and the camera 300 via the communication network NW.

[0035] The processing circuitry 150 controls the overall operation of the X-ray CT apparatus 100. The processing circuitry 150 executes, for example, a system control function 151, a preprocessing function 152, a reconstruction processing function 153, an image processing function 154, a scan control function 155, and an output control function 156. The processing circuitry 150 realizes these functions by, for example, causing a hardware processor to execute various programs stored in the memory 141.

[0036] The hardware processor refers to a circuit such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD) or a complex programmable logic device (CPLD), or a field programmable gate array (FPGA)). Instead of storing a program in the memory 141, the program may be directly embedded in the circuit of the hardware processor. In this case, the hardware processor realizes its function by reading and executing the program embedded in the circuit. The program may be stored in the memory 141 in advance, or may be stored in a non-transitory storage medium such as a DVD or CD-ROM, and installed into the memory 141 from the non-transitory storage medium when the non-transitory storage medium is inserted into a drive device (not shown) of the console device 140. The hardware processor is not limited to being configured as a single circuit, but may be configured as a single hardware processor by combining multiple independent circuits to realize each function, or multiple components may be integrated into a single hardware processor to realize each function.

[0037] Each component of the console device 140 or the processing circuitry 150 may be distributed and realized by multiple pieces of hardware. The processing circuitry 150 may not be a component of the console device 140, but may be realized by a processing device capable of communicating with the console device 140. The processing device is, for example, a workstation connected to one X-ray CT device, or a device (for example, a cloud server) connected to multiple X-ray CT devices and collectively executing processing equivalent to that of the processing circuitry 150.

[0038] The system control function 151 controls various functions of the processing circuit 150 based on input operations received by the input interface 143 .

[0039] The pre-processing function 152 performs pre-processing such as logarithmic conversion processing, offset correction processing, inter-channel sensitivity correction processing, and beam hardening correction on the detection data output by the DAS 116 to generate projection data, and stores the generated projection data in the memory 141.

[0040] The reconstruction processing function 153 performs reconstruction processing using a filtered back projection method, an iterative reconstruction method, or the like on the projection data generated by the preprocessing function 152 to generate a CT image, and stores the generated CT image in the memory 141.

[0041] The image processing function 154 converts the CT image into a three-dimensional image or cross-sectional image data of an arbitrary cross section by a known method based on the input operation received by the input interface 143. The conversion into a three-dimensional image may be performed by the pre-processing function 152.

[0042] The scan control function 155 controls the collection process of detection data in the gantry device 110 by issuing instructions to the X-ray high voltage device 114, the DAS 116, the control device 118, and the bed driving device 132. The scan control function 155 controls the operation of each part during actual imaging and scanography.

[0043] For example, when scanography is performed, the scan control function 155 controls the control device 118 to fix the position of the X-ray tube 111 at a predetermined rotation angle and irradiate X-rays from the X-ray tube 111 to the subject P2 while moving the top plate 133 of the bed device 130 in the Z-axis direction. A two-dimensional scanogram of the subject P2 is generated from the detection data acquired under the control of scanography through pre-processing and reconstruction processing. Furthermore, when helical scanography is performed, the scan control function 155 may control the control device 118 to collect detection data from the entire circumference of the subject P2. Here, the scan control function 155 scans a wide range of the subject P2, such as the entire chest, entire abdomen, entire upper body, or entire body, at a lower dose than in the main scan. A three-dimensional scanogram (volume data) of the subject P2 is generated from the detection data from the entire circumference of the subject P2 acquired under the control of helical scanography through pre-processing and reconstruction processing.

[0044] The output control function 156 displays, on the display 142, CT images generated through reconstruction processing by the reconstruction processing function 153 and images (e.g., three-dimensional images, cross-sectional images, and high-resolution images) generated from the CT images by the image processing function 154. The output control function 156 also transmits these images to the AR goggles 200 via the communication interface 144.

[0045] [AR goggles configuration] 4 is a diagram illustrating an example of the configuration of the AR goggles 200 according to the first embodiment. The AR goggles 200 include, for example, a communication interface 211, an input interface 212, an AR display 213, a memory 214, and a processing circuit 220.

[0046] The communication interface 211 communicates with external devices such as the X-ray CT apparatus 100 and the camera 300 via the communication network NW. The communication interface 211 includes, for example, a NIC.

[0047] The input interface 212 accepts various input operations from an operator (e.g., medical personnel P1), converts the accepted input operations into electrical signals, and outputs the electrical signals to the processing circuitry 220. For example, the input interface 212 includes a mouse, keyboard, trackball, switch, button, joystick, touch panel, etc. The input interface 212 may be, for example, a user interface that accepts audio input from a microphone, etc.

[0048] In this specification, the input interface 212 is not limited to an interface having physical operation parts such as a mouse, keyboard, etc. For example, an example of the input interface 212 also includes an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs this electrical signal to a control circuit.

[0049] The AR display 213 is a display that allows the medical professional P1 wearing the AR goggles 200 to view virtual content CONT. The content CONT is typically a CT image obtained during actual imaging, but is not limited to this. It may also be a coronal or sagittal cross-sectional image obtained by multi-planar reconstruction (MPR). The content CONT may also be some numerical values, graphs, or figures representing vital signs of the subject P2, such as heart rate or blood pressure, or other medical information. The CT image superimposed on the subject P2 as the content CONT may be a CT image of the subject P2 currently being examined, or a CT image obtained when the subject P2 underwent a previous examination. The CT image superimposed on the subject P2 as the content CONT may be a CT image of a third party other than the subject P2 currently being examined, or an average CT image of an unspecified number of subjects. The AR display 213 is an example of a "display unit."

[0050] The memory 214 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, or an optical disk. These non-transitory storage media may also be realized by other storage devices connected via a communication network NW, such as a NAS (Network Attached Storage) or an external storage server device. The memory 214 may also include other non-transitory storage media such as a ROM (Read Only Memory) or a register.

[0051] The processing circuit 220 includes, for example, an acquisition function 221, an association function 223, a generation function 224, and a display control function 225. The acquisition function 221 is an example of an "acquisition unit," the association function 223 is an example of an "association unit," the generation function 224 is an example of a "generation unit," and the display control function 225 is an example of a "display control unit."

[0052] The processing circuitry 220 realizes these functions by, for example, a hardware processor (computer) executing a program stored in the memory 214 (storage circuitry).

[0053] The hardware processor refers to a circuit such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD) or a complex programmable logic device (CPLD), or a field programmable gate array (FPGA)). Instead of storing a program in memory 214, the program may be directly embedded in the circuit of the hardware processor. In this case, the hardware processor realizes its functions by reading and executing the program embedded in the circuit. The program may be stored in memory 214 in advance, or may be stored in a non-transitory storage medium such as a DVD or CD-ROM, and installed from the non-transitory storage medium into memory 214 when the non-transitory storage medium is attached to the connection terminal of the AR goggles. The hardware processor is not limited to being configured as a single circuit, and may be configured as a single hardware processor by combining multiple independent circuits to realize each function. Furthermore, multiple components may be integrated into one hardware processor to realize each function.

[0054] The acquisition function 221 acquires images in the CT room from the cameras 300a and / or 300b via the communication interface 211, and acquires control information and CT images from the X-ray CT device 100 via the communication interface 211. The control information is various information for controlling the X-ray CT device 100 to scan the subject P2, and specifically includes the amount of rotation and rotation angle of the rotating frame 117, the tilt angle of the gantry device 110, the amount of movement of the top plate 133 of the bed device 130, etc.

[0055] The association function 223 associates the three-dimensional position of the bed device 130 relative to the CT room with the position of the part of the subject P2 on the CT image (position in two-dimensional or three-dimensional image space).

[0056] The generating function 224 generates content CONT to be displayed in a superimposed manner on the subject P2 based on the CT image acquired by the acquiring function 221.

[0057] The display control function 225 displays the content CONT generated by the generation function 224 on the AR display 213 based on the three-dimensional position of the bed device 130 and the position of the body part of the subject P2 on the CT image, which have been associated with each other by the association function 223, so that when a medical professional P1 wearing the AR goggles 200 looks at the subject P2, the content CONT appears to be superimposed on the subject P2.

[0058] [Overall flow of medical image display system] The processing flow of the medical image display system 1 in the first embodiment will be described below. Fig. 5 is a flowchart showing an example of a series of processing flows of the medical image display system 1 in the first embodiment. This flowchart is executed, for example, during actual imaging or scanography, and it is assumed that at the timing when this flowchart is executed, at least the three-dimensional position of the X-ray CT apparatus 100 (gantry device 110) relative to the CT room has been measured.

[0059] First, the acquisition function 221 of the AR goggles 200 waits until the AR goggles 200 are put on by the medical professional P1 (step S100). For example, if the medical professional P1 inputs an operation to the input interface 212 to declare that he or she has put on the AR goggles 200, the acquisition function 221 may determine that the AR goggles 200 have been put on by the medical professional P1, and if the operation is not input, the acquisition function 221 may determine that the AR goggles 200 have not been put on by the medical professional P1. Furthermore, the acquisition function 221 may use a gyro sensor or other sensor to determine whether the AR goggles 200 have been put on.

[0060] When the AR goggles 200 are worn by medical personnel P1, the acquisition function 221 acquires images of the CT room from the cameras 300a and / or 300b via the communication interface 211, and calculates the three-dimensional position of the AR goggles 200 relative to the CT room based on the acquired images (step S102).

[0061] For example, the acquisition function 221 may use an object tracking method called a lighthouse method to track optical markers MK2 of the AR goggles 200 on the images of the cameras 300a and 300b, which serve as base stations, and calculate the three-dimensional position of the AR goggles 200. While the AR goggles 200 are worn by the medical person P1, the three-dimensional position of the AR goggles 200 is repeatedly calculated.

[0062] Meanwhile, the scan control function 155 of the X-ray CT device 100 waits until the subject P2 is placed on the top plate 133 of the bed device 130 (step S104), and when the subject P2 is placed on the top plate 133, moves the top plate 133 along the Z-axis direction toward the gantry device 110, and further measures the amount of movement of the top plate 133 (step S106).

[0063] Next, the scan control function 155 controls the control device 118 to perform scanography on the subject P2 placed on the top board 133 (step S108). A CT image of the subject P2 is generated from the detection data obtained by scanography through pre-processing and reconstruction processing.

[0064] Next, the acquisition function 221 of the AR goggles 200 acquires the CT image generated by scanogram imaging and the control information used when the scanogram imaging was performed from the X-ray CT device 100 via the communication interface 211. The control information includes the initial position of the tabletop 133 before movement and the amount of movement of the tabletop 133 measured in S0106. The initial position of the tabletop 133 is determined from the three-dimensional position of the gantry device 110 relative to the CT room, which has been measured in advance.

[0065] Next, the association function 223 calculates the three-dimensional position of the top 133 after movement relative to the CT room based on the initial position of the top 133 before movement and the amount of movement of the top 133 (step S112). For example, if the three-dimensional position is expressed by the X, Y, and Z coordinates described in FIG. 3, only the Z axis becomes a coordinate that has changed before and after the movement of the top 133.

[0066] Next, the association function 223 associates the calculated three-dimensional position of the tabletop 133 relative to the CT room with the position of the CT image (the position of the part of the subject P2 on the CT image) (step S114). "Associating" means converting the position of the CT image (the position of the part of the subject P2 on the CT image) into a three-dimensional position in the CT room based on the three-dimensional position of the tabletop 133 relative to the CT room.

[0067] Next, the generating function 224 generates content CONT to be superimposed on the subject P2 based on the CT image acquired by the acquiring function 221. As described above, the content CONT may typically be a CT image generated by actual imaging, but is not limited to this and may be any medical information.

[0068] Next, the display control function 225 displays the content CONT generated by the generation function 224 on the AR display 213 based on the position of the CT image (the position of the part of the subject P2 on the CT image) associated with the three-dimensional position of the tabletop 133 by the association function 223 and the three-dimensional position of the AR goggles 200 so that the content CONT appears superimposed on the subject P2 when the medical professional P1 wearing the AR goggles 200 looks at the subject P2 (step S116). The content CONT may be superimposed and displayed when the scanogram imaging or the actual imaging is completed. Furthermore, if the CT image is updated sequentially during the scanogram imaging or the actual imaging, the content CONT may also be generated sequentially in accordance with the update of the CT image. The sequentially generated content CONT may then be superimposed and displayed on the subject P2 in real time. This series of processes completes the processing of this flowchart.

[0069] 6 is a diagram showing an example of the content CONT superimposed on the subject P2. As shown in FIG. 6, the content CONT may be a three-dimensional CT image (volume data) obtained by scanning the abdomen of the subject P2. Such content CONT is associated with the three-dimensional position where the abdomen of the subject P2 is likely to be located in the three-dimensional space of the CT room, based on the three-dimensional position of the tabletop 133. Therefore, the medical personnel P1 can visually recognize the content CONT superimposed on the abdomen of the subject P2 through the AR goggles 200.

[0070] 7 is a diagram showing another example of the content CONT superimposed on the subject P2. As shown in FIG. 7, the CT image superimposed as the content CONT may be a two-dimensional image of a cross-section of the abdomen of the subject P2. For example, when a medical professional P1 wearing the AR goggles 200 operates the input interface 212 of the AR goggles 200 to select a cross-section to be displayed from three-dimensional CT images (volume data), a two-dimensional CT image corresponding to the selected cross-section may be superimposed as the content CONT. In this way, the content CONT may be a two-dimensional CT image or a three-dimensional CT image.

[0071] Assuming a more specific usage scenario, for example, it is conceivable to use the superimposed display of the content CONT in an examination called "puncture," in which a puncture needle is inserted into the body of a subject P2 to collect blood, body fluids, cells, etc. In this case, a CT image of the affected area is superimposed on the area where the puncture needle is inserted, allowing the medical personnel P1 to perform the puncture while looking inside the body of the subject P2 as if they were doing so.

[0072] According to the first embodiment described above, the processing circuitry 220 of the AR goggles 200 acquires a medical image of the subject P2 (an example of a "subject"). The processing circuitry 220 associates the three-dimensional position of the bed 130 relative to the CT room with the position of the medical image (the position of the region of the subject P2 on the medical image). The processing circuitry 220 generates the content CONT to be superimposed on the subject P2 based on the medical image. The processing circuitry 220 displays the content CONT on the AR display 213 so that the content CONT is superimposed on the subject P2 based on the associated positions of the bed 130 and the medical image (the position of the region of the subject P2 on the medical image). In this way, since the three-dimensional position of the bed 130 relative to the CT room is associated with the position of the region of the subject P2 on the medical image, the position of the subject P2 can be robustly acquired when the medical image is projected onto the subject P2. Furthermore, since no optical markers are attached to the subject P2 before the examination, the medical image can be projected onto the subject P2 while preventing the examination procedure from becoming complicated.

[0073] (Modification of the first embodiment) A modified example of the first embodiment will be described below. In the above-described first embodiment, the processing circuitry 220 of the AR goggles 200 is described as performing a series of processes: (i) associating the three-dimensional position of the bed device 130 with the position of the medical image relative to the CT room; (ii) generating the content CONT to be superimposed on the subject P2 based on the medical image; and (iii) displaying the content CONT on the AR display 213 so that the content CONT is superimposed on the subject P2 based on the associated positions of the bed device 130 and the medical image. However, this is not limited to this. For example, the console device 140 or the control device 118 of the X-ray CT apparatus 100 may perform part or all of (i) and (ii). In other words, the processing circuitry 150 or the control device 118 of the X-ray CT apparatus 100 may have part or all of the functions of the processing circuitry 220 of the AR goggles 200.

[0074] 1 to 3, the X-ray CT apparatus 100 is described as scanning a subject P2 in a recumbent position by moving the bed apparatus 130 relative to the fixed gantry apparatus 110. However, the present invention is not limited to this. For example, the X-ray CT apparatus 100 may be configured to scan a subject P2 in an upright position by moving the gantry apparatus 110 relative to the fixed gantry apparatus 130. In this case, the amount of movement of the gantry apparatus 110 may be measured in the process of S106 in the flowchart described above, and the three-dimensional position of the gantry apparatus 110 after movement relative to the CT room may be calculated in the process of S112 based on the initial position of the gantry apparatus 110 before movement and the measured amount of movement of the gantry apparatus 110.

[0075] In the first embodiment described above, the medical image diagnostic apparatus 100 is described as an X-ray CT apparatus, but is not limited to this. As described above, the medical image diagnostic apparatus 100 may be an MRI apparatus or the like, as long as it is capable of measuring the amount of movement of the bed on which the subject P2 is placed and further capable of calculating the three-dimensional position of the bed after the movement.

[0076] (Second embodiment) The second embodiment will be described below. In the first embodiment described above, (i) the three-dimensional position of the bed device 130 relative to the CT room is associated with the position of the medical image, (ii) the content CONT to be superimposed on the subject P2 is generated based on the medical image, and (iii) the content CONT is displayed on the AR display 213 so as to be superimposed on the subject P2 based on the associated position of the bed device 130 and the position of the medical image.

[0077] In contrast, the second embodiment differs from the first embodiment in that (i) anatomical regions are detected on a medical image, (ii) the three-dimensional position of the bed apparatus 130 relative to the CT room is associated with the positions of the anatomical regions on the medical image, (iii) content CONT to be superimposed on the subject P2 is generated based on the medical image in which the anatomical regions have been detected, and (iv) the content CONT is displayed on the AR display 213 so that the content CONT is superimposed on the subject P2 based on the associated positions of the bed apparatus 130 and the anatomical regions. The following description will focus on differences from the first embodiment, and a description of commonalities with the first embodiment will be omitted. In the description of the second embodiment, the same parts as those in the first embodiment will be denoted by the same reference numerals.

[0078] 8 is a diagram illustrating an example of the configuration of the AR goggles 200 according to the second embodiment. The processing circuit 220 of the AR goggles 200 according to the second embodiment further includes a detection function 222 in addition to the acquisition function 221, association function 223, generation function 224, and display control function 225 described above. The detection function 222 is an example of a "detection unit."

[0079] The detection function 222 detects anatomical landmarks on the CT image by analyzing the CT image (for example, a scanogram obtained by scanogram photography or helical scanogram photography) acquired from the X-ray CT device 100 by the acquisition function 221, and detects anatomical parts (organs, etc.) based on the anatomical landmarks. For example, the detection function 222 detects one or more anatomical landmarks on the CT image by performing an ALD (Adaptive Layer Distribution) analysis, and further detects areas on the CT image where the anatomical landmarks are scattered as anatomical parts (organs, etc.).

[0080] The association function 223 in the second embodiment associates the three-dimensional position of the bed device 130 relative to the CT room with the position of the anatomical part on the CT image (position on the two-dimensional or three-dimensional image space).

[0081] The generation function 224 in the second embodiment generates content CONT to be superimposed and displayed on the subject P2 based on the CT image in which the anatomical site is detected.

[0082] The display control function 225 in the second embodiment displays the content CONT generated by the generation function 224 on the AR display 213 based on the three-dimensional position of the bed device 130 and the position of the anatomical part on the CT image, which are associated with each other by the association function 223, so that when a medical professional P1 wearing the AR goggles 200 looks at the subject P2, the content CONT appears to be superimposed on the subject P2.

[0083] 9 is a flowchart showing an example of a series of processing steps in the medical image display system 1 in the second embodiment. This flowchart is executed, for example, during actual imaging or scanography, and it is assumed that at least the three-dimensional position of the X-ray CT apparatus 100 (the gantry apparatus 110) relative to the CT room has been measured at the timing when this flowchart is executed.

[0084] First, the acquisition function 221 of the AR goggles 200 waits until the AR goggles 200 are put on by the medical personnel P1 (step S200).

[0085] When the AR goggles 200 are worn by medical personnel P1, the acquisition function 221 acquires images of the CT room from the cameras 300a and / or 300b via the communication interface 211, and calculates the three-dimensional position of the AR goggles 200 relative to the CT room based on the acquired images (step S202).

[0086] Meanwhile, the scan control function 155 of the X-ray CT device 100 waits until the subject P2 is placed on the top plate 133 of the bed device 130 (step S204), and when the subject P2 is placed on the top plate 133, moves the top plate 133 along the Z-axis direction toward the gantry device 110, and further measures the amount of movement of the top plate 133 (step S206).

[0087] Next, the scan control function 155 controls the control device 118 to scan the subject P2 placed on the top board 133 as scanography (step S208). A CT image of the subject P2 is generated from the detection data obtained by scanography through pre-processing and reconstruction processing.

[0088] Next, the acquisition function 221 of the AR goggles 200 acquires the CT image generated by scanogram imaging and the control information used when the scanogram imaging was performed from the X-ray CT device 100 via the communication interface 211. The control information includes the initial position of the tabletop 133 before movement and the amount of movement of the tabletop 133 measured in S0106. The initial position of the tabletop 133 is determined from the three-dimensional position of the gantry device 110 relative to the CT room, which has been measured in advance.

[0089] Next, the detection function 222 performs ALD analysis on the CT image acquired by the acquisition function 221 to detect one or more anatomical landmarks on the CT image, and detects anatomical parts based on the detected one or more anatomical landmarks (step S210).

[0090] Next, the association function 223 calculates the three-dimensional position of the top 133 after movement relative to the CT room based on the initial position of the top 133 before movement and the amount of movement of the top 133 (step S212).

[0091] Next, the association function 223 associates the calculated three-dimensional position of the tabletop 133 relative to the CT room with the position of the anatomical part on the CT image (step S214). "Associating" here means converting the position of the anatomical part on the CT image into a three-dimensional position in the CT room based on the three-dimensional position of the tabletop 133 relative to the CT room.

[0092] Next, the generation function 224 generates content CONT to be superimposed on the subject P2 based on the CT image in which the anatomical parts have been detected. As described above, the content CONT may typically be a CT image generated by actual imaging, but is not limited to this and may be any medical information.

[0093] Next, the display control function 225 displays the content CONT generated by the generation function 224 on the AR display 213 based on the positions of the anatomical parts associated with the three-dimensional positions of the tabletop 133 by the association function 223 and the three-dimensional position of the AR goggles 200 so that the content CONT appears to be superimposed on the subject P2 when the medical professional P1 wearing the AR goggles 200 looks at the subject P2 (step S216). With this series of processes, the processing of this flowchart is completed.

[0094] According to the second embodiment described above, the processing circuitry 220 of the AR goggles 200 acquires a medical image of the subject P2 (an example of a "subject") and detects anatomical regions on the medical image. The processing circuitry 220 associates the three-dimensional position of the bed 130 relative to the CT room with the positions of the anatomical regions on the medical image. The processing circuitry 220 generates content CONT to be superimposed on the subject P2 based on the medical image from which the anatomical regions have been detected. The processing circuitry 220 displays the content CONT on the AR display 213 so that the content CONT is superimposed on the subject P2 based on the associated positions of the bed 130 and the anatomical regions. In this way, since the three-dimensional position of the bed 130 relative to the CT room is associated with the positions of the anatomical regions on the medical image, the position of the subject P2 can be robustly acquired when the medical image is projected onto the subject P2. Furthermore, since no optical markers are attached to the subject P2 before the examination, the medical image can be projected onto the subject P2 while preventing the examination procedure from becoming complicated.

[0095] (Modification of the second embodiment) A modified example of the second embodiment will be described below. In the above-described second embodiment, the processing circuitry 220 of the AR goggles 200 is described as executing a series of processes: (i) detecting anatomical regions on a medical image; (ii) associating the three-dimensional position of the bed device 130 relative to the CT room with the positions of the anatomical regions on the medical image; (iii) generating content CONT to be superimposed on the subject P2 based on the medical image in which the anatomical regions are detected; and (iv) displaying the content CONT on the AR display 213 so that the content CONT is superimposed on the subject P2 based on the positions of the bed device 130 and the anatomical regions that are associated with each other. However, this is not limiting. For example, the console device 140 or the control device 118 of the X-ray CT apparatus 100 may execute some or all of the processes (i) to (iii). That is, the processing circuitry 150 or the control device 118 of the X-ray CT apparatus 100 may have some or all of the functions of the processing circuitry 220 of the AR goggles 200.

[0096] (Third embodiment) The third embodiment will be described below. The third embodiment differs from the first and second embodiments in that, when the subject P2 moves during scanning, the positions of anatomical landmarks are corrected based on the amount of displacement associated with the body movement. The following description will focus on the differences from the first and second embodiments, and will omit a description of the points in common with these embodiments. In the description of the third embodiment, the same parts as those in the first and second embodiments will be described with the same reference numerals.

[0097] FIG. 10 is a flowchart showing an example of the flow of a series of processes in the medical image display system 1 according to the third embodiment.

[0098] First, the acquisition function 221 acquires an image from the camera 300 capable of capturing an image of the subject P2 placed on the tabletop 133 via the communication interface 211, and calculates the three-dimensional position of the subject P2 relative to the CT room based on the image (step S300). The camera 300 capable of capturing an image of the subject P2 may be, for example, cameras 300a and 300b that serve as the base station of the AR goggles 200, or may be a dedicated camera 300c (not shown) installed on the upper part of the rotating frame 117 of the gantry device 110 so that the tabletop 133 is included in its field of view.

[0099] Next, the correlation function 223 determines whether the subject P2 has moved during the scan based on the three-dimensional position of the subject P2 relative to the CT room (step S302). For example, the correlation function 223 may compare the three-dimensional position P0 of the subject P2 when the top 133 is in the initial position with the three-dimensional position P1 of the subject P2 when the top 133 is moved to a position where scanogram or actual imaging is performed. S In other words, the correlation function 223 calculates the amount of change (amount of displacement) between the three-dimensional position P0 of the subject P2 before scanogram or main imaging is performed and the three-dimensional position P2 of the subject P2 when scanogram or main imaging is performed. SThe association function 223 may determine that the subject P2 has not moved (no body movement) if the calculated amount of variation is within an allowable range, and may determine that the subject P2 has moved (body movement) if the amount of variation is outside the allowable range.

[0100] If the association function 223 determines that the subject P2 is not moving, it ends the processing of this flowchart.

[0101] On the other hand, when it is determined that the subject P2 has moved, the association function 223 corrects the position of the anatomical part to be associated with the three-dimensional position of the tabletop 133 based on the calculated amount of variation (step S304). For example, when there is an amount of variation outside the allowable range regarding the X-axis, the association function 223 may correct the position of the anatomical part when associating the position of the anatomical part with the three-dimensional position of the tabletop 133 so that the amount of variation regarding the X-axis is canceled.

[0102] Next, the display control function 225 re-displays the content CONT on the AR display 213 based on the position of the anatomical part corrected by the association function 223 and the three-dimensional position of the AR goggles 200 (step S306). This ends the processing of this flowchart.

[0103] According to the third embodiment described above, if the subject P2 moves during scanning, the positions of the anatomical parts are corrected based on the displacement associated with the body movement, thereby improving the accuracy of alignment between the content CONT and the subject P2.

[0104] (Modification of the third embodiment) A modified example of the third embodiment will be described below. In the above-described third embodiment, the presence or absence of body movement of the subject P2 is determined on the assumption that the three-dimensional position of the subject P2 can be accurately measured using the camera 300, and correction of the positions of the anatomical parts is omitted when there is no body movement of the subject P2. However, this is not limiting. For example, if the measurement accuracy of the three-dimensional position of the subject P2 decreases, correction of the positions of the anatomical parts may be omitted.

[0105] For example, when imaging the subject P2 using the camera 300, a medical professional P1 may temporarily get between the camera 300 and the subject P2, preventing the imaging of the subject P2. In such a case, the number of anatomical landmarks (feature points) extracted from the image taken by the camera 300 during ALD analysis decreases. Therefore, if the number of anatomical landmarks (feature points) extracted from the image taken by the camera 300 by ALD analysis falls below a threshold during execution of the flowchart of FIG. 10, the association function 223 may determine that the measurement accuracy of the three-dimensional position of the subject P2 has decreased, terminate the processing of this flowchart, and switch to the flowchart of FIG. 9.

[0106] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0107] 1...medical image display system, 100...X-ray CT device, 110...gantry device, 130...bed device, 140...console device, 141...memory, 142...display, 143...input interface, 144...communication interface, 150...processing circuit, 151...system control function, 152...preprocessing function, 153...reconstruction processing function, 154...image processing function, 155...scan control function, 156...output control function, 200...AR goggles, 211...communication interface, 212...input interface, 213...AR display, 214...memory, 220...processing circuit, 221...acquisition function, 222...detection function, 223...association function, 224...generation function, 225...display control function, 300...camera, NW...communication network

Claims

1. an acquisition unit for acquiring a medical image of a subject; a correlation unit that is installed in a medical image diagnostic apparatus that scans the subject and generates the medical image, and that correlates the position of a bed on which the subject is placed during scanning with the position of the medical image; a generation unit that generates content to be superimposed on the subject based on the medical image; a display control unit that controls a display unit so that the content is superimposed on the subject based on the position of the bed and the position of the medical image that are associated with each other; a detection unit that detects an anatomical site on the medical image, The acquisition unit further acquires a position of the subject based on an image of the subject captured by a camera; the associating unit associates the position of the bed with the position of the anatomical part, and corrects the position of the anatomical part associated with the position of the bed based on the position of the subject; the display control unit controls the display unit so that the content is superimposed on the subject based on the position of the bed and the position of the anatomical part, which are associated with each other. Medical image display device.

2. the correlating unit calculates a displacement amount associated with a body movement of the subject based on a position of the subject before the subject is scanned and a position of the subject at the time the subject is scanned, and corrects the position of the anatomical site in accordance with the displacement amount. The medical image display device according to claim 1 .

3. the association unit determines whether or not to correct the position of the anatomical site depending on the accuracy of the position of the subject.

3. The medical image display device according to claim 1.

4. the display unit is a wearable device that applies any one of augmented reality, virtual reality, mixed reality, and projection mapping technology; the display control unit causes the wearable device to display the content so that the content appears to a user wearing the wearable device as being superimposed on the subject; The medical image display device according to claim 1 .

5. the content includes the medical images generated when the subject was previously scanned by the medical image diagnostic device; The medical image display device according to claim 1 .

6. The content includes the medical image generated by scanography or helical scanography. The medical image display device according to claim 1 .

7. The computer acquiring a medical image of the subject; a medical image diagnostic apparatus that scans the subject and generates the medical image, and associates the position of a bed on which the subject is placed during scanning with the position of the medical image; generating content to be superimposed on the subject based on the medical image; controlling a display unit so that the content is superimposed on the subject based on the position of the bed and the position of the medical image, which are associated with each other; detecting an anatomical site on the medical image; acquiring a position of the subject based on an image of the subject captured by a camera; Correlating the position of the couch with the position of the anatomical part; correcting the position of the anatomical part associated with the position of the bed based on the position of the subject; controlling the display unit so that the content is superimposed on the subject based on the position of the bed and the position of the anatomical part that are associated with each other; Medical image display method.

8. On the computer, acquiring a medical image of a subject; Correlating the position of a bed, which is installed in a medical image diagnostic device that scans the subject and generates the medical image, and on which the subject is placed during scanning, with the position of the medical image; generating content to be superimposed on the subject based on the medical image; and controlling a display unit so that the content is superimposed on the subject based on the position of the bed and the position of the medical image, which are associated with each other; detecting an anatomical site on the medical image; acquiring a position of the subject based on an image of the subject captured by a camera; Correlating the position of the couch with the position of the anatomical site; correcting the position of the anatomical part associated with the position of the couch based on the position of the subject; controlling the display unit so that the content is superimposed on the subject based on the position of the bed and the position of the anatomical part that are associated with each other; A program to execute.

Images