Image display device and image display control program

Abstract

This image display device acquires a region-of-interest image obtained by attaching markers to the body surface of a patient and capturing an image of a region of interest of the patient together with the markers. A line-of-sight guide unit guides the line of sight of a user to one of the markers in an image display unit. A marker identification unit identifies the marker in a region corresponding to the line of sight of the user guided by the line-of-sight guide unit. A conversion unit performs, for the region-of-interest image, conversion for aligning the marker in the region-of-interest image to the marker identified by the marker identification unit. The region-of-interest image converted by the conversion unit is displayed on the image display unit.

Description

[Technical Field]

[0001] The present invention relates to an image display device and an image display control program, and more particularly to an image display device and an image display control program for displaying a region of interest image. [Background technology]

[0002] When performing procedures on patients (such as injections, incisions, and catheter insertion), doctors must accurately grasp the position and condition of the patient's organs and tissues before carrying out the procedure. For example, when performing respiratory surgery, a procedure called thoracic drainage is performed. Thoracic drainage is a procedure in which a catheter or other device is inserted into the patient's body to drain blood, pus, and air that has accumulated in the thoracic cavity. When inserting a catheter into the patient's body for thoracic drainage, doctors must accurately grasp the position and condition of the patient's organs and avoid inserting the catheter into any organs.

[0003] When performing thoracic drainage, there is currently no established technology for accurately determining the location of organs and safely inserting a catheter into a patient's body. Generally, when inserting a catheter into a patient's body, an ultrasound device is used to confirm the location of the internal organs and then insert the catheter while avoiding the organs. However, ultrasound cannot be used for thoracic drainage because ultrasound is reflected by the air in the thoracic cavity. Ultrasound devices are extremely difficult to use, and it is extremely difficult for doctors inserting catheters to perform various procedures while operating the ultrasound device.

[0004] Given these circumstances, chest CT images are acquired and analyzed in advance as a region of interest (ROI) image using a CT scanner, and physicians refer to these images before performing chest drainage. However, chest CT images only provide cross-sectional images of the body, and grasping the three-dimensional location of organs must rely on the physician's experience and intuition. Thus, even acquiring and analyzing chest CT images in advance is not sufficient to accurately determine the location of the patient's organs. Therefore, the precise placement of a catheter during chest drainage depends on the physician's skill level. While the above issues pertain to chest drainage, similar problems can occur in other procedures. In other words, when performing various procedures, it is difficult to grasp the state of the patient's internal tissues and organs, making it difficult to determine the appropriate placement of the treatment device.

[0005] In recent years, with the advancement of xR technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR), image display systems have been proposed that enable superimposed display of an image of a region of interest and a real image of the patient on the same screen using image display devices such as AR glasses (see, for example, JP 2021-505226 A). Such systems enable doctors to simultaneously observe an image of a region of interest and a real image of the patient via an image display device. Summary of the Invention [Problem to be solved by the invention]

[0006] In conventional image display systems, it is necessary to align a pre-captured region-of-interest image with an image of the actual patient (real image). However, simply aligning the region-of-interest image with the patient image poses a problem in that the amount of calculation required for alignment and post-alignment image processing becomes enormous, significantly affecting display speed. If the alignment operation is imperfect, the region-of-interest image will not be displayed at the correct position in the actual patient image, and the above problem will persist.

[0007] The present invention has been made in consideration of such problems, and provides an image display device and an image display control program that enable alignment of an image of a region of interest with an image of a real patient to be performed quickly with a small amount of calculation. [Means for solving the problem]

[0008] In order to solve the above problems, the image display device of the present invention comprises an image acquisition unit that acquires a region of interest image obtained by attaching markers to the surface of a patient's body and capturing an image of the patient's region of interest together with the markers; an image display unit that is provided in the user's field of view, a gaze guidance unit that guides the user's gaze to one of the markers; a marker identification unit that identifies the marker in the region of interest guided by the gaze guidance unit; and a conversion unit that performs a conversion on the region of interest image to align the marker in the region of interest image with the marker identified by the marker identification unit, and the image display unit displays the region of interest image converted by the conversion unit.

[0009] Furthermore, the image display control program of the present invention is characterized in that it is configured to be able to cause a computer to execute the steps of: attaching markers to the surface of a patient's body and capturing an image of the patient's region of interest together with the markers to obtain an image of the region of interest; displaying the image of the region of interest together with the patient to which the markers are attached on an image display unit; guiding a user's line of sight to one of the markers on the image display unit; identifying the marker in the region of interest corresponding to the guided line of sight of the user; performing a transformation on the image of the region of interest to align the marker in the image of the region of interest with the identified marker; and displaying the image of the region of interest after the transformation on the image display unit. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide an image display device and an image display control program that enable alignment between an image of a region of interest and an image of a real patient to be performed quickly with a small amount of calculation. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a schematic diagram illustrating the overall configuration of a medical procedure support system 1 including an image display device according to a first embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an example of the hardware configuration of an image server 20. [Figure 3] FIG. 2 is a block diagram illustrating an example of the configuration of the AR glasses 30. [Figure 4] 10 is a conceptual diagram illustrating calculation of coordinates Xm1′ to Xm3′ of the markers MK in the CT image Pcc and coordinates Xm1 to Xm3 of the markers MK in the AR glasses 30. FIG. [Figure 5] 10 is a schematic diagram showing an example of how to attach a marker MK to the body surface of a patient PT. FIG. [Figure 6] 10 is a flowchart showing the procedure for capturing a CT image Pcc using the CT device 10 and calculating the coordinates of a marker MK. [Figure 7] 10 is a flowchart showing a procedure for superimposing and displaying a CT image Pcc and an actual image Ppt of the patient PT on the AR glasses 30. [Figure 8] 10 shows an example of a screen display when guiding the line of sight to a marker MK. [Figure 9] FIG. 10 is a schematic diagram illustrating a second embodiment. [Figure 10] FIG. 10 is a schematic diagram illustrating a second embodiment. [Figure 11] 10 is a flowchart illustrating the operation of the system 1 according to the second embodiment. [Figure 12] 10 is a flowchart illustrating the operation of the system 1 according to the second embodiment. [Figure 13] 10 shows a modified example of the second embodiment. [Figure 14]FIG. 10 is a block diagram illustrating a medical procedure support system 1 according to a third embodiment. [Figure 15] FIG. 10 is a schematic diagram illustrating the configuration of a medical treatment support system 1 according to a fourth embodiment. [Figure 16] FIG. 10 is a schematic diagram illustrating the configuration of a medical treatment support system 1 according to a fifth embodiment. [Figure 17] FIG. 10 is a schematic diagram illustrating the configuration of a medical treatment support system 1 according to a sixth embodiment. [Figure 18] 10 is a schematic diagram showing an example of how to attach a marker MK to the body surface of a patient PT. [Figure 19] FIG. 10 is a diagram for explaining determination of a degree of match between patients. [Figure 20] FIG. 10 is a diagram for explaining determination of a degree of match between patients. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, the present embodiment will be described with reference to the accompanying drawings. In the accompanying drawings, functionally identical elements may be designated by the same numerals. Note that the accompanying drawings show embodiments and implementation examples according to the principles of the present disclosure, but these are for understanding the present disclosure and are not to be used to interpret the present disclosure in a limiting manner. The descriptions in this specification are merely typical examples and are not intended to limit the scope or application of the present disclosure in any way.

[0013] Although the present embodiment has been described in sufficient detail to enable those skilled in the art to implement the present disclosure, it should be understood that other implementations and forms are possible, and that changes in configuration and structure and substitutions of various elements are possible without departing from the scope and spirit of the technical ideas of the present disclosure. Therefore, the following description should not be interpreted as being limited thereto.

[0014] [First embodiment] The overall configuration of a medical procedure support system 1 including an image display device according to the first embodiment will be described with reference to Fig. 1. As an example, this medical procedure support system 1 illustrates a system for supporting the execution of thoracic drainage, but the present invention is not limited to this, and a similar configuration can also be adopted in systems for supporting other procedures, such as central venous pressure measurement (CVP) and epidural anesthesia.

[0015] 1 may include, for example, a CT device 10 as an image capturing device, an image server 20, AR glasses 30 as an image display device, and a display 40. In this system 1, a patient PT undergoing thoracic drainage first acquires a CT image Pcc (Pcc0) of the vicinity of the thoracic cavity as a region of interest using the CT device 10. The CT image Pcc is displayed on the AR glasses 30 when thoracic drainage is performed. Note that in this specification, an image including a region of interest and surrounding organs, such as this CT image Pcc (Pcc0), may be collectively referred to as a "region of interest image."

[0016] Markers MK are affixed to the body surface of the patient PT when imaging is performed with the CT device 10 and when chest drainage is performed. The markers MK are used to align the CT image Pcc with the actual image of the patient PT in the AR glasses 30. As an example, as shown in FIG. 1, at least three markers MK1 to MK3 are affixed to the patient's body surface so as to surround a region of interest. Various calculations and operations based on the markers MK will be described later. The number of markers MK affixed to one patient PT should be at least three, but it is possible to use more than three for more accurate alignment.

[0017] After the CT image acquisition is completed, the patient PT moves to the chest drainage treatment room and receives chest drainage from the doctor DR. The marker MK remains attached in the same position as during CT imaging in order to align the CT image Pcc, as described below. The doctor DR in charge of chest drainage wears the AR glasses 30 and performs chest drainage by observing the actual image Ppt of the patient seen through the AR glasses 30 and the CT image Pcc superimposed on it. When superimposed, the CT image Pcc is subjected to a predetermined transformation using a method described below.

[0018] The doctor DR holds the catheter 60 for thoracic drainage and inserts it into the appropriate target position within the thoracic cavity based on the CT image Pcc and the patient's actual image Ppt. The doctor DR can also refer to the CT image Pcc displayed on the display 40 as an auxiliary reference. The doctor DR checks the positions of the rib cage and deflated lungs in the CT image Pcc superimposed on the AR glasses 30, and recognizes the dead space within the thoracic cavity. The doctor DR then inserts the catheter 60 between the ribs. The doctor DR proceeds with the insertion of the catheter 60 while checking the CT image Pcc displayed on the AR glasses 30 to ensure that the insertion site is in the correct position and angle.

[0019] The CT device 10 is a device for capturing a CT image Pcc of the chest of a patient PT. Here, the CT image Pcc is used to grasp the position and state of organs around a region of interest of the patient PT when performing thoracic drainage. The CT device 10 is an example of an imaging device for capturing images for grasping the position and state of the patient's organs, but is not limited to this. An imaging device other than the CT device 10, for example, an MRI (Magnetic Resonance Imaging) device, may be used as long as it can obtain images for grasping the position and state of the patient's organs.

[0020] Furthermore, the CT device 10 may be shared among multiple medical procedure support systems 1. In other words, the medical procedure support system 1 does not need to have its own CT device 10, and it is sufficient if the system is configured to be able to acquire CT images captured by a CT device 10 located, for example, at an external institution. The CT device 10 and the image server 20 may be connected via a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, a dedicated line, or the like. Furthermore, the image server 20 and the AR glasses 30 do not need to be located in the same organization (such as a hospital), and a system may be configured such that one organization managing the AR glasses 30 can access an image server 20 located in another organization as needed.

[0021] The image server 20 is a computer that manages the captured CT images Pcc and executes image processing for three-dimensional display on the AR glasses 30. The AR glasses 30 superimpose and display the CT images Pcc obtained from the image server 20 together with an actual image Ppt of the patient PT.

[0022] 2, an example of the hardware configuration of the image server 20 will be described. The image server 20 may include, for example, a CPU (Central Processing Unit) 21 as an arithmetic and control device, an input / output interface 22, a RAM (Random Access Memory) 23, a ROM (Read Only Memory) 24, a storage device 25, a 3D modeling engine 26, and a 3D model display engine 27.

[0023] The CPU 21 is a computing device that handles various calculations related to various operations of the image server 20. In addition to the CPU 21, a GPU (Graphical Processing Unit) that handles image processing may be provided. The input / output interface 22 is an interface device that handles input and output of data and signals to and from external devices including the CT device 10. The RAM 23 has a function of temporarily storing various calculation data and the like when executing an image display control program stored in the image server 20. The ROM 24 stores BIOS and firmware for peripheral devices. The storage device 25 is a storage device that stores the above-mentioned image display control program as well as CT images Pcc captured by the CT device 10, and is, for example, a hard disk drive device or a solid state drive device. The RAM 23, ROM 24, and storage device 25 are merely examples of storage devices, and it goes without saying that other storage device configurations can be adopted.

[0024] The 3D modeling engine 26 is a calculation unit that converts the captured CT image Pcc0 (two-dimensional image) into a three-dimensional CT image Pcc. The 3D model display engine 27 is a calculation unit that converts the three-dimensional CT image Pcc into a data format suitable for display on the AR glasses 30. The 3D modeling engine 26 and the 3D model display engine may be realized by the CPU 21 and a program, or may be realized by an image processing processor or GPU separate from the CPU 21.

[0025] An example of the configuration of AR glasses 30 as an image display device will be described with reference to Fig. 3. The AR glasses 30 may include, for example, a display unit 31, a light guide unit 32, a speaker 33, a microphone 34, a sensor 35, a wireless communication unit 36, a visible light / infrared camera 37, and an AR glasses control unit 38. The AR glasses 30 also store an image display control program for controlling image display. The AR glasses control unit 38 further includes a CPU 381, a RAM 382, ​​and a ROM 383.

[0026] The display unit 31 is a display device, such as a microdisplay, that displays the three-dimensional image data Pcc received from the image server 20 via the wireless communication unit 36. The wireless communication unit 36 ​​and RAM 382 (memory) function as an image acquisition unit that acquires CT images in the AR glasses 30. The CT images acquired by the image acquisition unit are displayed on the display unit 31 as an image display unit. The light guide unit 32 is a component that guides light emitted by the display unit 31 to the user's eyes and displays the image of the image data Pcc in front of the user's eyes. As an example, the light guide unit 32 may be configured as a holographic lens that is disposed in front of the user's eyes, has translucency, and is capable of guiding light from the display unit 31. Needless to say, the display unit 31 and the light guide unit 32 may have other configurations as long as the image data Pcc can be superimposed on the actual image Ppt of the patient PT. For example, the display unit 31 and the light guide unit 32 may be replaced with a laser scanner or the like.

[0027] The speaker 33 is a device for transmitting information to the user (doctor DR) by voice, by emitting voice based on voice data received from the image server 20 or an external device. The microphone 34 is a device for detecting the voice (commands, etc.) uttered by the user and converting it into voice data. The voice data output by the microphone 34 is also transmitted to the image server 20 as appropriate, and can be collected and stored in the image server 20.

[0028] The sensor 35 is a sensor for detecting the movement, rotation, tilt, etc. of the AR glasses 30, and for detecting the depth of an object in front of the eyes of the AR glasses 30, and includes, for example, an accelerometer, a gyro, a magnetometer, an infrared detection device, a depth sensor, etc.

[0029] The visible light / infrared camera 37 is an imaging device for performing the following operations, for example. Determine the spatial structure around the AR glasses 30 - Grasp the position Xg of the AR glasses 30 in the determined spatial structure -Detects the user's gaze Capture an image of an object in front of the user - Determine the position Xm of the marker MK The type, number, and arrangement of cameras can be changed in various ways depending on the purpose and specifications.

[0030] When the image display control program stored in the AR glasses 30 is executed, a marker identification unit 391, a coordinate calculation unit 392, a line of sight guidance unit 393, an instrument tip identification unit 394, and a conversion unit 395 are realized within the AR glasses 30. Note that, to reduce the calculation load on the AR glasses 30, these programs may be executed on the image server 20 or another computer.

[0031] The marker identification unit 391 has a function of executing image processing for identifying markers MK affixed to the body surface of the patient PT in a view presented to the user by the AR glasses 30. The coordinate calculation unit 392 calculates coordinates (first coordinates) of the markers MK included in the CT image Pcc and coordinates (second coordinates) of the markers MK identified by the marker identification unit 391. As shown in FIG. 4, the coordinates Xm1' to Xm3' of the markers MK in the CT image Pcc are calculated as coordinates of a coordinate system Cx1 set with a reference point in the CT device 10 as the reference point. On the other hand, the coordinates Xm1 to Xm3 of the markers MK identified by the marker identification unit 391 in the AR glasses 30 can be calculated as coordinates of a coordinate system Cx2 with the position Xg of the AR glasses 30 as the reference point. In this embodiment, in order to reduce the amount of calculation required for marker identification, the marker identification unit 391 performs a marker identification operation only in a partial region corresponding to the line of sight guided by a line of sight guidance unit 393, which will be described later.

[0032] The line-of-sight guidance unit 393 has a function of guiding the line of sight of the user of the AR glasses 30 to the marker MK. As described below, the line-of-sight guidance unit 393 guides the user to direct their line of sight toward one of the markers MK. When the user's line of sight is directed toward the marker MK as a result of the guidance, the marker identification unit 391 performs a marker identification operation in a partial area corresponding to the direction of the line of sight. This limits the area in which the marker identification operation is performed, thereby reducing the amount of calculation. The instrument tip identification unit 394 is a unit for identifying the tip of a treatment tool such as a catheter. The conversion unit 395 compares the coordinates Xm1'-Xm3' calculated by the coordinate calculation unit 392 with the coordinates Xm1-Xm3 and performs a conversion to match the coordinates Xm1-Xm. Performing such a conversion makes it possible to accurately align the CT image Pcc with the actual image of the patient PT observed through the AR glasses 30, thereby supporting accurate chest drainage. The calculation in the transformation unit 395 may be a linear transformation such as an affine transformation, but may also be a nonlinear transformation using, for example, a B-spline method as the nonlinear transformation algorithm.

[0033] FIG. 5 shows an example of how markers MK are attached to the body surface of a patient PT. A plurality of markers MK, for example, three markers (MK1 to MK3), are used as a set. The markers MK1 to MK3 are attached to the body surface of the patient PT so as to surround a region of interest DA. Each of the markers MK1 to MK3 may have a diameter of approximately 2 cm. They may be made of white alumina, for example. They may be fixed to the body by any method, for example, medical tape (double-sided or single-sided). Note that, when imaging with the CT device 10, the markers MK1 to MK3 are preferably made of a material that has a lower X-ray transmittance than the human body. Furthermore, the markers MK1 to MK3 may have the same shape and color, but for easier identification, it is preferable that they have different colors (red, blue, yellow, etc.), shapes (circle, square, triangle), brightness, etc.

[0034] For example, when performing thoracic drainage, markers MK1 to MK3 can be attached to the midpoint of each clavicle, with one marker MK1 and one marker MK2 attached to the hypochondrium (septum plexus). These points can be considered "fixed points" whose movement due to arm movements, breathing, etc. is small compared to the reference point, and whose horizontal movement is small and negligible. Selecting fixed points as the attachment positions for markers MK1 to MK3 enables more accurate alignment of the CT image Pcc. Here, the reference point can be set at a position where the amount of movement due to arm movements, breathing, etc. is approximately average.

[0035] The operation of the medical procedure support system 1 according to the first embodiment will be described with reference to Figs. 6 to 8. Fig. 6 is a flowchart showing the procedure for capturing a CT image Pcc using the CT device 10 and calculating the coordinates of a marker MK. Fig. 7 is a flowchart showing the procedure for superimposing the CT image Pcc on the actual image Ppt of the patient PT in the AR glasses 30. Fig. 8 shows an example of a screen display when guiding the line of sight to the marker MK.

[0036] When performing thoracic drainage using this medical procedure support system 1, first a marker MK is affixed to the chest of the patient PT (step S11), and then a CT image Pcc0 of the patient's chest is taken with the CT device 10 (step S12). Note that, unlike typical CT scans, when taking the CT image Pcc0, it is preferable for the patient PT to lower both arms toward their lower body. This is because subsequent thoracic drainage will be performed with both arms lowered, and it is therefore preferable to take the CT scan in the same posture as at that time.

[0037] The captured CT image Pcc0 is transferred (acquired) to the image server 20, and an intermediate file (Pcc') processed as voxel data is generated and saved (step S13). The voxel data is also transferred to the AR glasses 30. The coordinate calculation unit 392 in the AR glasses 30 identifies the positions of the three markers MK1 to MK3 based on this voxel data and calculates their coordinates Xm1', Xm2', and Xm3' (step S14). Note that step S14 may be performed in parallel with the steps in the flowchart of FIG. 7 below. Note that the voxel data is data (volumetric data) in which CT values ​​are entered for each lattice in a lattice space of a three-dimensional cube. The data for each lattice is called a voxel value. The coordinate Xmi of the marker MK can be obtained by extracting a voxel having a specific CT value for identifying the marker MK.

[0038] After the voxel data is acquired and stored in the image server 20, the patient PT moves to the treatment room to perform chest drainage (the marker MK remains attached to the chest), and the doctor DR activates the AR glasses 30 (step S21) and puts them on his or her head. After activation, the AR glasses 30 grasp the spatial structure S(x) around the AR glasses 30 according to the outputs of the various sensors 35 and the visible light / infrared camera 37, identify the position of the AR glasses 30, and calculate the coordinate Xg of that position (step S22).

[0039] Next, the line-of-sight guidance unit 393 of the AR glasses 30 displays a screen as shown in FIG. 8 for the doctor DR, who is the user, via the display unit 31, and sequentially guides the doctor DR's line of sight to one of the markers MK1 to MK3 (step S23). Specifically, an instruction OR1 saying "Please direct your gaze to the upper left marker" is displayed in a part of the screen (for example, the lower left), and a line-of-sight display mark GDM indicating the direction of the doctor DR's line of sight detected according to the output of the visible light / infrared camera 37 and an area display mark CM indicating an area centered on the line of sight are displayed. If the doctor DR determines that the target marker MK1 is included near the center of the area display mark CM, he or she presses a confirm button (not shown) to confirm the position of the area display mark CM. Thereafter, the same operation is repeated for the markers MK2 and MK3, and the position of the area display mark CM including the markers MK1 to MK3 is identified (step S24). The area display mark may be confirmed by pressing the confirm button, or, for example, by issuing a voice command to the microphone 34 to confirm. Furthermore, if it is determined that the line of sight has been fixed for a predetermined time or more (for example, three seconds or more), the line of sight direction may be determined to be the position of the region display mark CM.

[0040] When the position of the area display mark CM is identified, the marker identifying unit 391 is activated and the area display The position of the marker MK included in the mark CM is identified (step S25). Since the area of ​​the region display mark CM is very small compared to the area of ​​the entire view of the AR glasses 30, the amount of calculation can be reduced. Once the position of the marker MK is identified, the coordinate calculation unit 292 calculates the coordinate Xm (Xm1 to 3) of the marker MK (step S26). Steps S23 to S26 are repeated the number of times equal to the number of markers MK.

[0041] Next, after aligning the coordinates Xm1' to Xm3' with the coordinates Xm1 to Xm3 (step S27), the voxel data expressed in the coordinate system Cx1 is converted to an expression in the coordinate system Cx2 by affine transformation or the like (step S28). For the voxel data expressed in the coordinate system Cx2, it is assumed that light is emitted from the coordinate Xg, and the voxel values ​​of the lattice through which the light passes are handled appropriately (volume ray casting). This results in a CT image Pcc, which is a 3D image displayed on the AR glasses 30. Note that the coordinate Xg can be defined for each of the left and right eyes of the AR glasses, and images obtained by emitting light from left and right positions can be displayed. This results in an image with parallax, enabling stereoscopic viewing.

[0042] The obtained 3D image, the CT image Pcc, is transmitted to the display unit 31 and displayed on the AR glasses 30, superimposed on the actual image Ppt of the patient PT. When the program for the AR glasses 30 is running on the image server 20, the 3D image data of the CT image is transmitted to the display unit 31 via the wireless communication unit 36, for example, by wireless communication. The transmission rate is approximately 30 frames per second, and as described above, when the user (doctor DR) fixes his or her gaze near the region of interest DA, a sufficiently smooth image can be displayed. If the transmission rate increases to 90 frames per second, the image can be displayed smoothly even when the user shifts their gaze.

[0043] If the marker MK is extracted from the entire spatial structure recognized by the AR glasses 30, the amount of calculation becomes extremely large, and, for example, CT images can only be transmitted at about 3 frames per second. Therefore, in this embodiment, the line of sight of the user (doctor DR) is guided in the direction of the marker MK by the line of sight guidance unit 393, a line of sight display mark CM is set in the line of sight, and the marker MK is recognized (searched) within the line of sight display mark CM. This narrows the spatial range to be searched, and enables the marker MK to be recognized quickly (for example, about 50 to 100 times faster than when searching the first half). This operation can be performed sequentially for the three markers.

[0044] As described above, according to the medical procedure support system 1 of the first embodiment, when the CT image obtained by the CT device 10 is superimposed and displayed on the AR glasses 30, the markers MK are identified in a limited area after the line of sight is guided by the line of sight guidance unit 393. Therefore, the alignment of the CT image can be performed quickly with a small amount of calculation.

[0045] [Second embodiment] Next, a medical procedure support system 1 according to a second embodiment will be described with reference to FIGS. 9 to 13. The overall configuration of the medical procedure support system 1 according to the second embodiment, as well as the configurations of the image server 20 and the AR glasses 30, may be the same as those of the first embodiment (FIGS. 1 to 3), and therefore a redundant description will be omitted. However, the system 1 according to the second embodiment differs from the first embodiment in that it is configured to determine the respiratory state of the patient PT and display a CT image according to that state. Specifically, as shown in FIG. 9, in addition to markers MK1 to MK3 placed at fixed points, a marker MK4 (a marker for respiratory detection) placed at a fluctuating point that fluctuates due to breathing is used. The movement of this marker MK4 is detected, and a CT image corresponding to the movement is displayed on the AR glasses 30. Here, the "fluctuating point" is, for example, near the patient's nipple (in the case of a male). If chest breathing is strong, this position is a suitable position (fluctuating point) for attaching the marker MK4. In the case of patients who predominantly breathe abdominally rather than thoracically, it may be preferable to attach the marker MK4 to the abdomen near the navel.

[0046] The concept of CT image acquisition in the system 1 of the second embodiment will be described with reference to FIG. 10. For example, in the expiratory state where exhalation is at its maximum, the inhalation state where inhalation is at its maximum, and an intermediate state between the two, the coordinates of the marker MK4 are obtained and CT images Pcc10 to Pcc30 are acquired. During thoracic drainage, a deviation of up to 1 cm in the planar direction of the CT image may occur between the inhalation state (inhalation state) and the exhalation state (expiration state). Even in the example of FIG. 10, a deviation may occur between the CT images Pcc10 to Pcc30. For this reason, the system 1 of the second embodiment acquires multiple CT images Pcc10 to Pcc30 taking respiration into consideration and stores them in association with the coordinate values ​​of the marker MK.

[0047] The operation of the system 1 of the second embodiment will be described with reference to the flowcharts of Figures 11 and 12. The basic operation is similar to that of the first embodiment, so a duplicated description will be omitted, but as described in Figure 10, the second embodiment differs from the first embodiment in that a plurality of CT images are acquired and saved for each different respiratory state (steps S12' to S13'), and the coordinate Xmi' of the marker MK is calculated for each of the plurality of CT images (step S14').

[0048] The procedure shown in FIG. 12 is basically the same as the procedure shown in FIG. 7, but differs from the first embodiment in that in steps S30 and S31, the position of marker MK4 is identified in the view of the AR glasses 30, and the CT image corresponding to that position is switched and displayed (the CT image being displayed is changed).

[0049] In the example of Figure 10, separate CT images are taken for the intermediate state and are used for switching display. Alternatively, as shown in Figure 13, CT images can be taken for the exhalation state and the inhalation state, and the CT image of the intermediate state can be generated by interpolation processing based on the CT images for the exhalation state and the inhalation state.

[0050] As described above, the system of the second embodiment not only achieves the same effects as the first embodiment, but also makes it possible to display CT images that are tailored to the respiratory state of the patient PT, making it easier for the doctor DR to carry out medical procedures.

[0051] [Third embodiment] Next, a medical procedure support system 1 according to a third embodiment will be described with reference to FIG. 14. The overall configuration of the medical procedure support system 1 according to the third embodiment may be the same as that according to the first embodiment (FIG. 1), and therefore a duplicated description will be omitted. However, in this third embodiment, the 3D modeling engine 26 and the 3D model display engine 27 are omitted from the image server 20, and instead a 3D modeling engine 395 and a 3D model display engine 396 are provided in the AR glasses 30. The function of 3D modeling of CT images has been transferred to the AR glasses 30, and the basic operation is the same as that according to the first embodiment.

[0052] [Fourth embodiment] The configuration of a medical procedure support system 1 according to a fourth embodiment will be described with reference to Fig. 15. The overall configuration of the system 1 is the same as that of the first embodiment, and the configurations of the image server 20 and the AR glasses 30 may also be the same, so duplicated explanations will be omitted. The system 1 according to the fourth embodiment differs from the first embodiment in that, in addition to the AR glasses 30, AR glasses 30T are provided that are capable of viewing images similar to those of the AR glasses 30 and are worn by the instructor DRT of the doctor DR.

[0053] The instructor DRT is located near the doctor DR who is the training subject and wears AR glasses 30T. Like the AR glasses 30, the AR glasses 30T are capable of observing an actual image Ppt of the patient PT, and like the AR glasses 30, are also capable of superimposing a CT image Pcc. The instructor DRT can provide training to the doctor DR by viewing the display on the AR glasses 30T. The AR glasses 30 and 30T may exchange data directly via wireless communication, or may send and receive data indirectly via the image server 20.

[0054] [Fifth embodiment] The configuration of a medical treatment support system 1 according to the fifth embodiment will be described with reference to Fig. 16. Fig. 16 shows the overall configuration of the medical treatment support system 1 according to the fifth embodiment. The CT device 10 is not shown.

[0055] The medical procedure support system 1 of the fifth embodiment supports remote thoracic drainage, in which a patient PT is located at a hospital HP1, and a doctor DR in charge of the thoracic drainage is located at a hospital HP2 that is geographically separated from the hospital HP1. The hospitals HP1, HP2, and the image server 20 are connected by a network NW.

[0056] A patient PT is present in a hospital HP1, and is wearing the same marker MK as in the previously described embodiment. A robot 70 is installed next to the patient PT, responsible for inserting a chest drainage catheter 60, and an actual image of the patient PT is captured by a camera 80. The image captured by the camera 80 is transmitted to the AR glasses 30 via a network NW. The robot 70 is operated by a controller 90 carried by a doctor DR in a hospital HP2. The AR glasses 30 superimpose the actual image Ppt of the patient PT sent from the camera 80 on the CT image Pcc, and are capable of performing the same alignment and conversion as in the previously described embodiment.

[0057] According to the fifth embodiment, the effects of the previous embodiments can also be obtained in medical treatments such as remotely controlled chest drainage.

[0058] [Variations] In the various embodiments described above, the procedure performed by the doctor DR has been described as thoracic drainage, but as mentioned above, the present invention is not limited to thoracic drainage and can be applied to other procedures. For example, a similar system can be used for injections into the veins of the arm or the arteries of the wrist. At least three markers MK can be attached around the veins of the forearm or the arteries of the wrist, and a CT image can be taken, and the CT image can be similarly displayed on the AR glasses 30.

[0059] Furthermore, for epidural anesthesia, at least three markers can be attached around the spine on the back, and a CT scan can be similarly performed (a chest CT scan is taken in the lateral position), which can then be used during epidural anesthesia.The CT image displayed on the AR glasses 30 identifies the spinal cord and dura mater, and epidural anesthesia can be performed by inserting a needle into the epidural space.

[0060] [others] The present invention is not limited to the above-described embodiments and includes various modifications. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described components. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of each embodiment with other components. For example, when acquiring a CT image, image processing may be performed such as reducing the brightness of the CT image in the area where the catheter 60 is present or increasing the transparency of the catheter 60 relative to the actual image of the patient. Furthermore, a configuration may be employed in which the transparency of the CT image is changed by voice control via the microphone 34 of the AR glasses 30. Furthermore, a configuration may be employed in which the transparency of the catheter 60, etc. in the CT image can be changed according to the doctor's preference, rather than automatically.

[0061] [Sixth embodiment] Next, a medical treatment support system 1 according to a sixth embodiment will be described with reference to FIGS. 17 to 20. The overall configuration of the medical treatment support system 1 according to the sixth embodiment and the configuration of the image server 20 may be the same as those of the first embodiment (FIGS. 1 and 2), and therefore a duplicated description will be omitted. However, the system 1 according to the sixth embodiment differs from the first embodiment in that, as shown in FIG. 17, when an image display control program stored in the AR glasses 30 is executed, the AR glasses 30 also function as a determination unit 397. The determination unit 397 will be described later.

[0062] Furthermore, the system 1 of the sixth embodiment differs from the first embodiment in that, as shown in FIG. 18, in addition to the three markers MK1, MK2, and MK3, a marker MK4 is used to determine the degree of correspondence between the patient whose CT image Pcc was taken and the patient at the time of performing a procedure such as thoracic drainage using AR glasses 30.

[0063] The marker MK4 is used for patient identification and is attached to a position where the amount of change in position due to the patient's breathing is equal to or less than a reference value. Here, the position where the amount of change in position due to the patient's breathing is equal to or less than a reference value is a position that can be considered a fixed point as described in the first embodiment. In the example of Fig. 18, the marker MK4 is attached near the manubrium, but the position where the marker MK4 is attached is not limited to near the manubrium.

[0064] In this embodiment, the CT apparatus 10 images the region of interest DA of the patient PT together with four markers MK1 to MK4, and obtains a CT image Pcc as a region of interest image.

[0065] After the CT image Pcc has been taken, the patient PT moves to a treatment room and receives treatment such as thoracic drainage from the doctor DR. Markers MK1 to MK4 are also attached to the patient PT's body surface when treatment such as thoracic drainage is performed.

[0066] The doctor DR in charge of the treatment wears the AR glasses 30 and performs the treatment while observing the actual image Ppt of the patient seen through the AR glasses 30 and the CT image Pcc superimposed thereon.

[0067] When the image display control program stored in the AR glasses 30 is executed, the AR glasses 30 function as a marker identification unit 391, a coordinate calculation unit 392, a line of sight guidance unit 393, an instrument tip identification unit 394, and a conversion unit 395, as described in the first embodiment. In this embodiment, the AR glasses 30 also function as a determination unit 397. Note that the processing of the determination unit 397 is executed, for example, between step S26 and step S27 in the flowchart of FIG. 7.

[0068] The determination unit 397 determines the degree of match between the patient displayed on the AR glasses 30 and the patient whose region of interest image was captured, based on the positions Xm1 to Xm4 of the markers MK1 to MK4 identified by the marker identification unit 391 and the positions Xm1' to Xm4' of the markers MK1 to MK4 in the CT image Pcc as the region of interest image.

[0069] For example, the determination unit 397 determines the degree of match between the patient displayed on the AR glasses 30 and the patient from whom the region of interest image was captured, based on the distance between marker MK4 as a specific marker identified from the markers identified by the marker identification unit 391 and the other markers MK1 to MK3, and the distance between marker MK4' in the CT image Pcc as the region of interest image and the other markers MK1' to MK3'.

[0070] Specifically, the determination unit 397 calculates distances d14, d24, and d34 from the position Xm4 of the marker MK4 to the positions Xm1 to Xm3 of the other markers MK1 to MK3, respectively, as shown in Fig. 19. Similarly, the determination unit 397 calculates distances d14', d24', and d34' from the position Xm4' of the marker MK4' in the CT image Pcc as the region of interest image to the positions Xm1' to Xm3' of the other markers MK1' to MK3', respectively.

[0071] Next, the determination unit 397 calculates the average value da of the distances d14, d24, and d34, and also calculates the average value da' of the distances d14', d24', and d34', and calculates the difference Δd (absolute value) between the average value da and the average value da'. If the difference Δd is equal to or less than a predetermined threshold, the determination unit 397 determines that the patient displayed on the AR glasses 30 and the patient whose region of interest image was captured match. On the other hand, if the difference Δd is greater than the predetermined threshold, the determination unit 397 determines that the patient displayed on the AR glasses 30 and the patient whose region of interest image was captured do not match. In this case, a warning message indicating that the patients are different is displayed on the display unit 31 of the AR glasses 30.

[0072] Since the average values ​​da and da' are considered to be patient-specific, by determining whether the difference between the two is equal to or less than a threshold, it is possible to determine whether the patient displayed on the AR glasses 30 matches the patient whose region of interest image was captured. This prevents a patient other than the patient whose CT image was captured from being mistakenly treated by the doctor DR. The degree of match may be calculated based on the difference Δd, and the calculated degree of match may be displayed on the display unit 31 of the AR glasses 30. The degree of match is expressed as a percentage, for example, and can be calculated using a formula in which the degree of match is 100% when the difference Δd is 0, and decreases as the difference Δ increases.

[0073] In addition, the determination unit 397 may determine whether the patient displayed on the AR glasses 30 matches the patient whose region of interest image was captured by determining whether the sum of the squares of the differences between the corresponding distances is less than or equal to a predetermined threshold.

[0074] Specifically, the determination unit 397 calculates the difference Δd14 between the distance d14 and the distance d14', the difference Δd24 between the distance d24 and the distance d24', and the difference Δd34 between the distance d34 and the distance d34'.

[0075] Then, the sum of the squares of the differences Δd14, Δd24, and Δd34, i.e., Δd14 2 +Δd24 2 +Δd342 Then, if the calculated sum of squares is equal to or less than the threshold, it is determined that the patient displayed on the AR glasses 30 matches the patient whose region of interest image was captured. On the other hand, if the calculated sum of squares is greater than the threshold, it is determined that the patient displayed on the AR glasses 30 does not match the patient whose region of interest image was captured. Note that the degree of match may be calculated based on the calculated sum of squares and displayed on the display unit 31 of the AR glasses 30. The degree of match is expressed as a percentage, for example, and can be calculated using a formula in which the degree of match is 100% when the calculated sum of squares is 0, and the degree of match decreases as the calculated sum of squares increases.

[0076] In addition, the determination unit 397 may determine the degree of match between the patient displayed on the AR glasses 30 and the patient from whom the region of interest image was captured, based on the angle formed by the line segments connecting marker MK4 as a specific marker identified from the markers identified by the marker identification unit 391 to the other markers MK1 to MK3, and the angle formed by the line segments connecting marker MK4' in the CT image Pcc as the region of interest image to the other markers MK1' to MK3'.

[0077] 20, the determination unit 397 calculates an angle θ12 formed by a line segment L14 connecting the position Xm4 of the marker MK4 identified by the marker identification unit 391 to the position Xm1 of the marker MK1, and a line segment L24 connecting the position Xm4 of the marker MK4 to the position Xm2 of the marker MK2. The determination unit 397 also calculates an angle θ13 formed by the line segment L14 and a line segment L34 connecting the position Xm4 of the marker MK4 to the position Xm3 of the marker MK3. The determination unit 397 also calculates an angle θ23 formed by the line segment L34 and a line segment L24 connecting the position Xm4 of the marker MK4 to the position Xm2 of the marker MK2.

[0078] Similarly, the determination unit 397 calculates the angle θ12' formed by the line segment L14' connecting the position Xm4' of marker MK4' in the CT image Pcc to the position Xm1' of marker MK1 in the CT image Pcc, and the line segment L24' connecting the position Xm4' of marker MK4 to the position Xm2' of marker MK2' in the CT image Pcc. The determination unit 397 also calculates the angle θ13' formed by the line segment L14' and the line segment L34' connecting the position Xm4' of marker MK4' to the position Xm3' of marker MK3' in the CT image Pcc. The determination unit 397 also calculates the angle θ23' formed by the line segment L34' and the line segment L24' connecting the position Xm4' of marker MK4 to the position Xm2' of marker MK2'.

[0079] Next, the determination unit 397 calculates the average value θa of the angles θ12, θ13, and θ34, and also calculates the average value θa' of the angles θ12', θ13', and θ34', and calculates the difference Δθ (absolute value) between the average value θa and the average value θa'. If the difference Δθ is equal to or less than a predetermined threshold, the determination unit 397 determines that the patient displayed on the AR glasses 30 and the patient whose region of interest image was captured match. On the other hand, if the difference Δθ is greater than the predetermined threshold, the determination unit 397 determines that the patient displayed on the AR glasses 30 and the patient whose region of interest image was captured do not match. In this case, a warning message indicating that the patients are different is displayed on the display unit 31 of the AR glasses 30.

[0080] Since the average values ​​θa and θa' are considered to be patient-specific, by determining whether the difference between the two is equal to or less than a threshold, it is possible to determine whether the patient displayed on the AR glasses 30 matches the patient whose region of interest image was captured. This prevents a patient other than the patient whose CT image was captured from being treated by the doctor DR by mistake. The degree of match may be calculated based on the difference Δθ, and the calculated degree of match may be displayed on the display unit 31 of the AR glasses 30. The degree of match is expressed as a percentage, for example, and can be calculated using a formula in which the degree of match is 100% when the difference Δθ is 0, and decreases as the difference θ increases.

[0081] In addition, the determination unit 397 may determine the degree of match between the patient displayed on the AR glasses 30 and the patient whose region of interest image was captured by determining whether the sum of the squares of the differences between each corresponding angle is less than or equal to a predetermined threshold.

[0082] Specifically, the determination unit 397 calculates the difference Δθ12 between the angle θ12 and the angle θ12', the difference Δθ13 between the angle θ13 and the angle θ13', and the difference Δθ34 between the angle θ23 and the angle θ23'.

[0083] Then, the sum of the squares of the differences Δθ12, Δθ13, and Δθ23, i.e., Δθ12 2 +Δθ13 2 +Δθ23 2 Then, if the calculated sum of squares is equal to or less than a threshold, it is determined that the patient displayed on the AR glasses 30 matches the patient whose region of interest image was captured. On the other hand, if the calculated sum of squares is greater than the threshold, it is determined that the patient displayed on the AR glasses 30 does not match the patient whose region of interest image was captured. Alternatively, the degree of match may be calculated based on the calculated sum of squares and displayed on the display unit 31 of the AR glasses 30. The degree of match is expressed as a percentage, for example, and can be calculated using a formula in which the degree of match is 100% when the calculated sum of squares is 0, and the degree of match decreases as the calculated sum of squares increases.

[0084] In the above, the marker MK4 is set as the specific marker, but any one of the markers MK1 to MK3 may be set as the specific marker.

[0085] In addition, the determination unit 397 may determine the degree of match between the patient displayed on the AR glasses 30 and the patient from whom the region of interest image was captured, based on the distance between the position of each marker M1 to MK4 identified by the marker identification unit 391 and the position of each marker MK1' to MK4' in the CT image Pcc as the region of interest image, which corresponds to the position of each marker MK1 to M4.

[0086] For example, the coordinates Xm1' to Xm4' in the coordinate system Cx1 of the markers MK1' to MK4' in the CT image Pcc are transformed into the coordinate system Cx2 of the AR glasses 30 by affine transformation or the like, and the degree of correspondence between the patient displayed on the AR glasses 30 and the patient whose region of interest image was captured is determined based on the transformed coordinates Xm1'' to Xm4'' and the coordinates Xm1 to Xm4 of the markers MK identified in the AR glasses 30.

[0087] Specifically, for example, the sum of squares of the distance D1 between coordinate Xm1" and coordinate Xm1, the distance D2 between coordinate Xm2" and coordinate Xm2, the distance D3 between coordinate Xm3" and coordinate Xm3, and the distance D4 between coordinate Xm4" and coordinate Xm4 is calculated, and if the calculated sum of squares is equal to or less than a threshold, it is determined that the patient displayed on the AR glasses 30 matches the patient whose region of interest image was captured, and if the calculated sum of squares is greater than the threshold, it is determined that the patient displayed on the AR glasses 30 does not match the patient whose region of interest image was captured.

[0088] Alternatively, without performing affine transformation or the like, the sum of squares may be calculated in the same manner as described above based on the markers MK1' to MK4' in the CT image Pcc and the coordinates Xm1 to Xm4 of the markers MK identified in the AR glasses 30, and the degree of match between the patient displayed on the AR glasses 30 and the patient whose region of interest image was captured may be determined based on the calculated sum of squares. Note that the degree of match may be calculated based on the calculated sum of squares and displayed on the display unit 31 of the AR glasses 30. The degree of match is expressed as a percentage, for example, and can be calculated using a formula in which the degree of match is 100% when the calculated sum of squares is 0, and the degree of match decreases as the calculated sum of squares increases.

[0089] As described above, the system of the sixth embodiment can determine whether the patient displayed on the AR glasses 30 matches the patient whose region of interest image was captured. This prevents a patient different from the patient whose CT image was captured from being treated by the doctor DR by mistake.

[0090] In this embodiment, the marker MK4 is described as being used to identify the patient, but it may also be used as a marker for accurate alignment when the actual image Ppt of the patient PT and the CT image Pcc are superimposed and displayed.

[0091] The disclosures of Japanese Patent Application Nos. 2023-182769 and 2024-052353 are incorporated herein by reference in their entirety. In addition, all documents, patent applications, and technical standards described herein are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually indicated to be incorporated by reference.

Claims

1. an image acquisition unit that acquires an image of a region of interest of the patient by capturing an image of the region of interest of the patient together with a marker attached to the body surface of the patient; a transformer for transforming the region of interest image; an image display unit that displays the region of interest image converted by the conversion unit by superimposing it on the image of the patient; an identifier for identifying a marker position indicator indicative of a position of the marker in the patient image; Equipped with the conversion unit converts the region of interest image so that the position of the marker in the region of interest image coincides with the position of the marker position indicator identified by the identification unit; At least three of the markers are arranged at positions where the amount of change in position due to breathing of the patient is smaller than a reference value. Image display device.

2. a line-of-sight guidance unit that guides the user's line of sight to one of the markers; The identification unit identifies the marker position indicator in an area corresponding to the line of sight of the user guided by the line of sight guidance unit. The image display device according to claim 1 .

3. The marker further includes a breathing detection marker that is arranged at a position where a change in position due to breathing of the patient is larger than the reference value, The image display device according to claim 1 , wherein the region of interest image displayed on the image display unit is changed in accordance with a movement of a marker position indicator that indicates the position of the marker for respiratory detection.

4. 4. The image display device according to claim 3, wherein a new region of interest image is generated by performing interpolation processing from a plurality of region of interest images in accordance with movement of a marker position indicator that indicates the position of the marker for respiratory detection.

5. 4. The image display device according to claim 1, wherein the image acquisition unit acquires a plurality of images for a plurality of different stages of the patient's breathing.

6. At least four markers are arranged, including a marker arranged at a position different from the at least three arranged markers; the region of interest image is an image obtained by imaging the region of interest together with the at least four markers; 3. The image display device according to claim 2, further comprising a determination unit that determines a degree of match between the patient displayed on the image display unit and the patient from whom the region of interest image was captured, based on a marker position index indicating the position of each marker identified by the identification unit and the position of each marker in the region of interest image.

7. 7. The image display device according to claim 6, wherein the determination unit determines a degree of match between the patient displayed on the image display unit and the patient from whom the region of interest image was captured, based on a distance between a marker position index indicating a position of a specific marker identified from the at least four markers and marker position indexes indicating positions of other markers, and a distance between the specific marker and other markers in the region of interest image.

8. 7. The image display device according to claim 6, wherein the determination unit determines a degree of match between the patient displayed on the image display unit and the patient from whom the region of interest image was captured, based on an angle formed by a line segment connecting a marker position index indicating the position of a specific marker identified from the at least four markers to a marker position index indicating the positions of other markers, and an angle formed by a line segment connecting the specific marker to the other markers in the region of interest image.

9. The determination unit determines, based on the distances between the marker position index indicating the position of each marker identified by the identification unit and the position of each marker in the region of interest image corresponding to the marker position index indicating the position of each marker, The image display device according to claim 6 , wherein a degree of coincidence between the patient displayed on the image display unit and the patient from whom the region of interest image was taken is determined.

10. acquiring a region of interest image obtained by imaging the region of interest of the patient together with a marker attached to a body surface of the patient; transforming the region of interest image; a step of displaying the region of interest image converted in the converting step on an image display unit in such a manner that the region of interest image is superimposed on the image of the patient; identifying a marker location indicator indicating a location of the marker in an image of the patient; The computer is configured to be able to execute the the converting step converts the region of interest image so that the position of the marker in the region of interest image coincides with the position of the marker position indicator identified in the identifying step; At least three of the markers are arranged at positions where the amount of change in position due to breathing of the patient is smaller than a reference value. Image display control program.

11. directing a user's gaze to one of the markers; The identifying step identifies the marker position indicator in a region corresponding to the user's line of sight guided by the guiding step. The image display control program according to claim 10.

12. The marker further includes a breathing detection marker that is arranged at a position where a change in position due to breathing of the patient is larger than the reference value, The image display control program according to claim 10 , wherein the region of interest image displayed on the image display unit is changed in accordance with a movement of a marker position indicator indicating the position of the marker for respiratory detection.

13. 13. The image display control program according to claim 12, wherein a new region of interest image is generated by performing interpolation processing from a plurality of region of interest images in accordance with movement of a marker position indicator that indicates the position of the marker for respiratory detection.

14. 13. The image display control program according to claim 10, wherein the step of acquiring the region of interest image acquires a plurality of images for a plurality of different stages of the patient's breathing.

15. At least four markers are arranged, including a marker arranged at a position different from the at least three arranged markers; the region of interest image is an image obtained by imaging the region of interest together with the at least four markers; 11. The image display control program according to claim 10, further comprising a step of determining a degree of match between the patient displayed on the image display unit and the patient from whom the region of interest image was captured, based on a marker position index indicating the position of each marker identified in the marker identifying step and the position of each marker in the region of interest image.

16. 16. The image display control program according to claim 15, wherein the determining step determines a degree of match between the patient displayed on the image display unit and the patient from whom the region of interest image was captured, based on a distance between a marker position index indicating a position of a specific marker identified from the at least four markers and marker position indexes indicating positions of other markers, and a distance between the specific marker and other markers in the region of interest image.

17. 16. The image display control program according to claim 15, wherein the determining step determines a degree of match between the patient displayed on the image display unit and the patient from whom the region of interest image was captured, based on an angle formed by a line segment connecting a marker position index indicating the position of a specific marker identified from the at least four markers to a marker position index indicating the positions of other markers, and an angle formed by a line segment connecting the specific marker to the other markers in the region of interest image.

18. 16. The image display control program according to claim 15, wherein the determining step determines a degree of match between the patient displayed on the image display unit and the patient from whom the region of interest image was captured, based on distances between marker position indicators indicating the positions of the markers identified in the marker identifying step and positions of the markers in the region of interest image corresponding to the marker position indicators indicating the positions of the markers.

Images