Medical image processing device, x-ray diagnostic device, and medical image processing method

The medical image processing apparatus aligns activity position data with blood vessel images to guide the precise placement of electrode-equipped stents, addressing the challenge of accurate and safe stent positioning in thin veins, enhancing diagnostic efficiency.

JP2024165689APending Publication Date: 2024-11-28CANON MEDICAL SYST CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023082084
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-18
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

The placement of electrode-equipped stents in blood vessels is challenging due to the lack of clear markers and the delicate nature of veins, requiring advanced technology and experience to ensure accurate and safe positioning, especially in thin veins prone to rupture.

Method used

A medical image processing apparatus that includes an acquisition section, alignment section, and display section to align activity position data with blood vessel images, calculate positional relationships, and display information for optimal device placement within the blood vessels, using fMRI and X-ray imaging to guide the placement of electrode-equipped stents.

Benefits of technology

The apparatus provides precise guidance for electrode-equipped stent placement, reducing user operation complexity and improving diagnostic efficiency by determining optimal positions and avoiding dangerous areas within the blood vessels.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024165689000001_ABST
    Figure 2024165689000001_ABST
Patent Text Reader

Abstract

To provide a user with information on the arrangement and placement of a device capable of receiving an electric signal of an active region where a part of a subject is made active.SOLUTION: A medical image processing device includes an acquisition part, a positioning part, a calculation part, and a display part. The acquisition part acquires active position data on positions of a plurality of active regions where a part of a subject is made active, and a blood vessel image indicating a three-dimensional blood vessel on the plurality of active regions. The positioning part executes positioning of the active position data and the blood vessel image. The calculation part calculates a positional relation between at least one of the plurality of active regions and the blood vessel on the basis of a result of the positioning. The display part displays information on the arrangement of a device capable of receiving an electric signal from the active regions in the blood vessel of the subject on the basis of the positional relation.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The embodiments disclosed in this specification and the drawings relate to a medical image processing apparatus, an X-ray diagnostic apparatus, and a medical image processing method. [Background technology]

[0002] Conventionally, stents placed in the blood vessels of subjects have been used clinically to treat aneurysms and myocardial infarction. Attempts are underway to digitize electrical signals from the motor cortex of the brain by attaching receiving electrodes to the stent. If a stent equipped with electrodes (hereafter referred to as an electrode-equipped stent) could be used to control digital devices using information generated by the brain, it could become a new option for people with motor neuron disorders. Electrode-equipped stents have already undergone clinical trials on humans, and there is a high possibility that they will be put to practical use in the near future.

[0003] The placement of an electrode-equipped stent differs from treatment using a regular stent (a stent without electrodes). In other words, there are no blood vessel aneurysms or stenoses at the placement site of an electrode-equipped stent to mark the placement site. In addition, the veins in which the electrode-equipped stent is placed are much thinner than arteries and are more prone to rupture. For these reasons, the placement of an electrode-equipped stent is considered to be more difficult than the placement of stents in arteries, which is usually performed in endovascular treatment.

[0004] Conventionally, the location of neural activity in the brain can be confirmed and imaged by fMRI (functional magnetic resonance imaging). fMRI can confirm the location of neural activity in the brain non-invasively, and can visualize which parts of the brain are active when performing a target task. For this reason, even in the preparation stage before placing an electrode-equipped stent, fMRI is used to confirm the location of neural activity in the brain, 3D (three-dimensional) imaging of the vein to be placed, and marking of the target location is performed.

[0005] The alignment and marking of the brain's neural activity areas and blood vessels are performed manually by the user. Therefore, the decision of the placement position of the electrode-equipped stent is left to the surgeon's experience. In addition, the surgeon must carry out the procedure while comparing the angio fluoroscopic image and the marked model image, which are displayed separately.

[0006] For these reasons, advanced technology and experience are required to place an electrode-equipped stent accurately and safely in the optimal placement site. In other words, it is difficult to set the optimal placement site for an electrode-equipped stent and to place the electrode-equipped stent accurately and safely in the optimal placement site. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2019-000362 A Summary of the Invention [Problem to be solved by the invention]

[0008] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to provide a user with information regarding the placement of a device capable of receiving an electrical signal from an active region that activates a part of a subject. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0009] The medical image processing device according to this embodiment includes an acquisition unit, a registration unit, a calculation unit, and a display unit. The acquisition unit acquires activity position data related to positions of a plurality of activity areas that activate parts of a subject, and a blood vessel image showing three-dimensional blood vessels related to the plurality of activity areas. The registration unit executes registration between the activity position data and the blood vessel image. The calculation unit calculates a positional relationship between at least one of the plurality of activity areas and the blood vessel based on a result of the registration. The display unit displays information related to the placement of a device capable of receiving an electrical signal from the activity area within the blood vessel of the subject based on the positional relationship. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a medical information processing system 1 including a medical image processing apparatus according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of an activity vessel superimposed image generated by matching a blood vessel image with activity position data according to the embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of distances between each of a plurality of active regions and blood vessels according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a target position for a region of greatest activity determined by a calculation function or selected by a user according to an embodiment. [Diagram 5] FIG. 5 is a diagram showing an example of setting a target position based on the center of gravity positions of three activity regions according to the embodiment. [Figure 6] FIG. 6 is a flowchart showing an example of a procedure of an image display process according to the embodiment. [Figure 7] FIG. 7 is a diagram showing an example of displaying different hues according to the distance from a center position corresponding to the position with the shortest distance from an active region to a blood vessel according to the embodiment. [Figure 8] FIG. 8 is a block diagram showing an example of the configuration of an X-ray diagnostic apparatus according to a second application example of the embodiment. [Figure 9] FIG. 9 is a diagram showing an example of an image in which an indwelling position image is superimposed on a fluoroscopic image according to a second application example of the embodiment. [Figure 10] FIG. 10 is a diagram showing an example in which the hue of a marker corresponding to a target position is changed according to the second application example of the embodiment. [Figure 11] FIG. 11 is a flowchart illustrating an example of a procedure of a placement display process according to a second application example of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of a medical image processing apparatus, an X-ray diagnostic apparatus, and a medical image processing method will be described in detail with reference to the drawings. In the following embodiments, parts with the same reference numerals perform similar operations, and duplicated descriptions will be omitted as appropriate.

[0012] (Embodiment) Fig. 1 is a block diagram showing an example of a configuration of a medical information processing system 1 including a medical image processing device 30 according to an embodiment. As shown in Fig. 1, the medical information processing system 1 according to the embodiment includes an X-ray diagnostic device 10, an image storage device 20, and a medical image processing device 30. As shown in Fig. 1, the X-ray diagnostic device 10, the image storage device 20, and the medical image processing device 30 are connected to each other via a network.

[0013] The X-ray diagnostic apparatus 10 collects X-ray image data from a subject P. For example, the X-ray diagnostic apparatus 10 collects a plurality of X-ray image data from the subject P, and transmits the collected plurality of X-ray image data to an image storage apparatus 20 or a medical image processing apparatus 30. The configuration of the X-ray diagnostic apparatus 10 will be described later.

[0014] The image storage device 20 stores a plurality of X-ray image data collected by the X-ray diagnostic apparatus 10. For example, the image storage device 20 is realized by a computer device such as a server device. In this embodiment, the image storage device 20 acquires a plurality of X-ray image data from the X-ray diagnostic apparatus 10 via a network, and stores the acquired plurality of X-ray image data in a memory provided inside or outside the apparatus.

[0015] The image storage device 20 also stores functional images of the subject collected by various diagnostic devices. The functional images are, for example, images obtained by fMRI (functional Magnetic Resonance Imaging) (hereinafter referred to as fMRI images). The fMRI images are three-dimensional voxel data, and correspond to, for example, activity location data related to the locations of multiple active areas that activate parts of the subject. The parts of the subject are, for example, parts that are moved by muscles, such as fingers, limbs, facial muscles, and eyeballs. The active areas correspond to areas that visualize hemodynamic responses related to brain and spinal cord activity. When the subject's brain is the subject of the activity location data, the active areas correspond to neural activity parts in the brain. For example, the fMRI images are images obtained by superimposing structural information generated by MRI of the subject on which part of the brain the functional activity of the brain occurred. The activity location data corresponds to, for example, a grayscale representation of the intensity of neural activity in each of multiple voxels corresponding to brain areas. An fMRI image is generated by a magnetic resonance imaging apparatus through magnetic resonance imaging of a subject. Since a known method can be used to generate an fMRI image, a description thereof will be omitted.

[0016] The functional image is not limited to the fMRI image. For example, the functional image may be a map showing the distribution of the strength of myoelectric potential acquired by an electromyograph, or a magnetoencephalogram capturing the brain activity of the subject by a magnetic field. The functional image may also be a map of electrical signals acquired by an electrode sheet attached to the subject. In the following, for the sake of concrete explanation, the activity position data will be explained as an fMRI image (voxel data). At this time, the image storage device 20 acquires the fMRI image from an MRI device (not shown) via a network, and stores the acquired fMRI image in a memory provided inside or outside the device.

[0017] The image storage device 20 stores vascular images of a subject collected by various diagnostic devices. The vascular image is an image showing a three-dimensional vascular structure related to a plurality of active regions. That is, the vascular image corresponds to a 3D vascular model showing a three-dimensional vascular structure. That is, the vascular image is volume data showing a vascular structure in the vicinity of a plurality of active regions. The vascular image is acquired by contrast photography using, for example, an MRI device, an X-ray CT (Computed Tomography) device, an X-ray diagnostic device 10 that collects contrast images, or the like. In the X-ray diagnostic device 10 that collects contrast images, the vascular image may be generated by DSA (Digital Subtraction Angiography). Alternatively, in the X-ray diagnostic device 10 that collects contrast images, the vascular image may be generated based on image processing of the contrast images. Since known methods can be used to generate vascular images by these devices, a description thereof will be omitted.

[0018] The medical image processing device 30 acquires a plurality of time-series X-ray image data from the X-ray diagnostic device 10 via a network, and executes various processes using the acquired plurality of X-ray image data. For example, the medical image processing device 30 is realized by a computer device such as a workstation. In this embodiment, the medical image processing device 30 acquires a plurality of X-ray image data from the X-ray diagnostic device 10 or the image storage device 20 via a network. In addition, the medical image processing device 30 acquires activity position data from the image storage device 20 via a network. In addition, the medical image processing device 30 executes alignment between the activity position data and the blood vessel image, calculates the positional relationship between at least one of the plurality of activity regions and the blood vessel based on the result of the alignment, and displays information on the arrangement of a device capable of receiving an electrical signal from the activity region in the blood vessel of the subject on the display 32 based on the calculated positional relationship.

[0019] As shown in FIG. 1, the medical image processing device 30 includes an input interface 31, a display 32, a memory 33, and a processing circuit .

[0020] The input interface 31 is realized by a trackball, a switch, a button, a mouse, a keyboard, a touch pad for performing input operations by touching an operation surface, a touch screen in which a display screen and a touch pad are integrated, a non-contact input circuit using an optical sensor, a voice input circuit, and the like for performing various instructions and various settings. The input interface 31 converts an input operation received from an operator into an electric signal and outputs it to the processing circuit 34. Note that the input interface 31 is not limited to an interface having physical operation parts such as a mouse and a keyboard. For example, an electric signal processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the medical image processing device 30 and outputs the electric signal to the processing circuit 34 is also included as an example of the input interface 31. The input interface 31 is an example of an input unit.

[0021] The display 32 displays various types of information. For example, the display 32 displays a GUI (Graphical User Interface) for receiving instructions from an operator and various types of X-ray image data. For example, the display 32 is a liquid crystal display or a CRT (Cathode Ray Tube) display. The display 32 is an example of a display unit.

[0022] The memory 33 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, etc. For example, the memory 33 stores a plurality of X-ray image data acquired from the image storage device 20. Also, for example, the memory 33 stores a program for each circuit included in the medical image processing device 30 to realize its function. The memory 33 is an example of a storage unit.

[0023] The processing circuitry 34 controls the operation of the entire medical image processing apparatus 30 by executing an acquisition function 34a, an alignment function 34b, a calculation function 34c, and a display control function 34d.

[0024] The processing circuitry 34 reads out a program corresponding to the acquisition function 34a from the memory 33 and executes it to acquire a blood vessel image from the image storage device 20. The acquisition function 34a may acquire a blood vessel image from the X-ray diagnostic device 10 by DSA of the subject. The acquisition function 34a also acquires activity position data from the image storage device 20. The acquisition function 34a stores the acquired blood vessel image and activity position data in the memory 33. The processing circuitry 34 that realizes the acquisition function 34a corresponds to an acquisition unit.

[0025] The processing circuit 34 reads out a program corresponding to the alignment function 34b from the memory 33 and executes it to align the activity position data with the blood vessel image. For example, the alignment function 34b detects a plurality of anatomical landmarks in the activity position data and the blood vessel image. The detection of the plurality of anatomical landmarks can be performed by known methods such as segmentation processing and inputting to a trained model for image recognition, and therefore a description thereof will be omitted. Next, the alignment function 34b uses the detected plurality of anatomical landmarks to align the activity position data with the blood vessel image.

[0026] The alignment is, for example, rigid alignment (such as affine transformation) and / or non-rigid alignment of at least one of the activity position data and the blood vessel image. A specific method of alignment is omitted here because various known methods can be applied. Through the alignment, the alignment function 34b generates, for example, an activity vessel superimposed image in which the activity position data is superimposed on the blood vessel image as a result of the alignment between the activity position data and the blood vessel image. The alignment function 34b stores the aligned activity position data and the blood vessel image in the memory 33 as, for example, an activity vessel superimposed image. The processing circuit 34 that realizes the alignment function 34b corresponds to the alignment unit.

[0027] FIG. 2 is a diagram showing an example of an activity vessel superimposed image AVSI generated by aligning a blood vessel image VI with activity location data APD. As shown in FIG. 2, the blood vessel image VI shows a three-dimensional blood vessel structure in the brain of the subject. Also, as shown in FIG. 2, the activity location data APD shows an activity area corresponding to a part of the subject in gray scale corresponding to the intensity of the activity amount. As shown in FIG. 2, the activity location data APD shows an fMRI image. Also, as shown in FIG. 2, the activity vessel superimposed image AVSI is obtained by superimposing the activity location data APD on the blood vessel image VI by three-dimensionally aligning the blood vessel image VI with the activity location data APD. The activity vessel superimposed image AVSI corresponds to a three-dimensional model showing three-dimensional blood vessels and a plurality of three-dimensional activity areas.

[0028] The processing circuit 34 reads out from the memory 33 a program corresponding to the calculation function 34c and executes it to calculate the positional relationship between at least one of the plurality of active regions and the blood vessels in the blood vessel image VI based on the result of the alignment between the activity position data and the blood vessel image VI by the alignment function 34b (the activity vessel superimposed image AVSI). For example, the calculation function 34c calculates the distance between at least one of the plurality of active regions and the blood vessels on the aligned three-dimensional model (the activity vessel superimposed image AVSI). The processing circuit 34 realizing the calculation function 34c corresponds to the calculation unit.

[0029] FIG. 3 is a diagram showing an example of the distance between each of a plurality of active regions and the blood vessel BV. In FIG. 3, three active regions (AR1, AR2, AR3) are shown as the plurality of active regions. In FIG. 3, the calculation function 34c calculates three shortest distances (D1, D2, D3) from the blood vessel BV corresponding to the three active regions (AR1, AR2, AR3) using the activity vessel superimposed image AVSI. As shown in FIG. 3, in the three distances (D1, D2, D3) related to the three active regions (AR1, AR2, AR3), the distance D1 related to the first active region AR1 is shorter than the other two active regions (AR2, AR3).

[0030] In the following, for the sake of concrete explanation, at least one of the multiple activity regions is assumed to be an activity region corresponding to the largest representative value of the activity amount among the multiple activity regions (hereinafter referred to as the maximum activity region). The maximum activity region corresponds to an activity region in which, for example, a representative value of the activity amount (hereinafter referred to as the activity representative value) such as the average value, maximum value, or median value of the multiple activity amounts corresponding to the multiple voxels in each of the multiple activity regions is the largest. The activity representative value is calculated by the calculation function 34c by calculating the average value, maximum value, or median value of the multiple activity amounts corresponding to the multiple voxels in each of the multiple activity regions. The maximum activity region is specified by the calculation function 34c based on the activity position data. The maximum activity region may be an activity region selected by the user via the input interface 31.

[0031] Specifically, the processing circuit 34 extracts the center line of the blood vessel BV in the active vessel superimposed image AVSI by the calculation function 34c. The calculation function 34c may extract the blood vessel wall instead of the center line. A known segmentation process or the like can be applied to the extraction of the center line and / or the blood vessel wall, and therefore the description will be omitted. Next, the calculation function 34c calculates the distance from the center line or the blood vessel wall of the blood vessel BV to the most active area in the active vessel superimposed image AVSI as the above positional relationship. The above distance is, for example, the shortest distance. It is known that the active parts of the brain in the activity position data are different parts that are strongly active depending on the action to be performed by the subject. For example, when it is desired to perform multiple desired actions with a stent equipped with one electrode (hereinafter referred to as an electrode-equipped stent), multiple fMRI images at the time of each desired action may be used to calculate the above shortest distance.

[0032] The processing circuit 34 generates information on the placement of a device capable of receiving an electrical signal from the active region in the blood vessel of the subject P based on the positional relationship by using the calculation function 34c. The device is, for example, a stent (electrode-equipped stent) that can be placed in the venous blood vessel BV related to the active region and is equipped with an electrode that receives an electrical signal generated in the active region. That is, the stent in this embodiment is different from a stent used for the purpose of expanding a site where an artery has become narrowed (heart, neck, kidney, lower limbs, etc.) and a stent used when the esophagus, trachea, or digestive tract has become narrowed due to a malignant tumor. The electrode-equipped stent used in this embodiment can be a known one, so a description thereof will be omitted.

[0033] For example, the processing circuit 34 uses the shortest distance calculated by the calculation function 34c with respect to the maximum activity region to set a position (hereinafter referred to as a target position) indicating a target of device placement with respect to receiving an electrical signal from the maximum activity region on the blood vessel BV. Specifically, the calculation function 34c reads out the length of the device from the memory 33. Then, the calculation function 34c specifies the position on the blood vessel BV with respect to the shortest distance as the center of the device in the long axis direction. Then, the calculation function 34c calculates the placement (orientation, coordinates) of the device along the blood vessel BV as the target position with the specified position as the center of the device in the long axis direction. The target position is calculated by the calculation function 34c as, for example, three-dimensional coordinates in the active blood vessel superimposed image AVSI. The target position, the device length, the distance between the maximum activity region and the blood vessel BV, and the like are stored in the memory 33 together with information regarding the placement of the device. That is, the information regarding the placement of the device includes the target position, the device length, the distance between the (maximum) activity region and the blood vessel BV, and the like.

[0034] Fig. 4 is a diagram showing an example of a target position TP for the maximum activity area AR1 specified by the calculation function 34c or selected by the user. In Fig. 4, the first activity area AR1 of the three activity areas (AR1, AR2, AR3) is specified or selected as the area with the maximum amount of activity. As shown in Fig. 4, in the blood vessel BV for the maximum activity area AR1, the target position TP is set with the position for the shortest distance D1 as the center of the device arrangement (hereinafter referred to as the center position) CP.

[0035] As an application example of this embodiment, when the functional image is a myoelectric potential, the calculation function 34c calculates a target position in a venous blood vessel related to a muscle to be measured for the myoelectric potential. In the above description, the blood vessel is set to be in the brain, but when the device receives the electrical signal passing through a nerve in the cervical vertebrae, the blood vessel corresponds to, for example, the jugular vein.

[0036] Furthermore, when the user desires to receive electrical signals from a plurality of activity regions, the calculation function 34c calculates, for example, the centroid positions of the plurality of activity regions selected by the user via the input interface 31. The plurality of activity regions for calculating the centroid position are not limited to the user's selection, but are a plurality of previously set top activity representative values ​​(for example, the top n activity representative values ​​in descending order (n is a previously set integer (for example, 2, 3, 4, 5, etc.))) among the plurality of activity representative values ​​corresponding to the plurality of activity regions. The plurality of activity representative values ​​may be determined by the calculation function 34c using a previously set threshold value. An activity region corresponding to an activity representative value below the threshold value (i.e., an activity representative value below a certain strength) is excluded from the calculation of the centroid position. The threshold value corresponds to the strength of the activity amount and is stored in the memory 33. The threshold value can be appropriately adjusted by the user via the input interface 31.

[0037] For example, the processing circuit 34 uses the calculation function 34c to calculate the center of gravity of the activity amounts in the multiple activity regions based on the activity amounts of each of the multiple voxels in each of the multiple activity regions. Specifically, the calculation function 34c calculates the center of gravity for the multiple activity regions using the activity amounts of each of the multiple voxels in each of the multiple activity regions that correspond to an activity representative value selected by the user or exceeding a predetermined threshold. In calculating the center of gravity, the magnitude of the activity amount of each of the multiple voxels may be used as a weight.

[0038] When the center position is calculated, the processing circuit 34 uses the calculation function 34c to calculate the shortest distance between the center position and the blood vessel BV as the positional relationship based on the active blood vessel superimposed image AVSI, which is the result of the alignment. That is, the calculation function 34c calculates the position of the blood vessel BV closest to the center position (coordinates in the active blood vessel superimposed image AVSI). The process of generating information on the arrangement of the device based on the positional relationship is as described above, so a description thereof will be omitted.

[0039] FIG. 5 is a diagram showing an example of setting a target position TP based on the center of gravity CG of three activity regions (AR1, AR2, AR3). In FIG. 5, three activity regions (AR1, AR2, AR3) are selected by a user or selected as corresponding to an activity representative value exceeding a predetermined threshold. As shown in FIG. 5, in a blood vessel BV related to the three activity regions (AR1, AR2, AR3), a center position CP for device placement is set with a position related to the shortest distance from the center of gravity CG of the three activity regions (AR1, AR2, AR3) as the target position TP. That is, the target position TP is set so that the target position TP and the center position CP overlap.

[0040] The processing circuitry 34 reads out from the memory 33 a program corresponding to the display control function 34d and executes it to cause the display 32 to display information regarding the placement of a device (electrode-equipped device) capable of receiving an electrical signal from an active region in a blood vessel of a subject based on the positional relationship calculated by the calculation function 34c. The electrode-equipped device corresponds to, for example, an electrode-equipped stent. As a result, the display 32 displays information regarding the placement of the electrode-equipped device. For example, the display control function 34d causes the display 32 to display the activity position data and information regarding the placement of the electrode-equipped device superimposed on the blood vessel image VI. At this time, the display 32 displays the activity position data and information regarding the placement of the electrode-equipped device superimposed on the blood vessel image VI. The processing circuitry 34 that realizes the display control function 34d corresponds to a display control unit.

[0041] The overall configuration of the medical image processing apparatus 30 according to the embodiment has been described above. Hereinafter, a process of displaying active position data and information related to the placement of an electrode-equipped device by superimposing them on a blood vessel image VI (hereinafter, referred to as image display process) will be described with reference to FIG.

[0042] 6 is a flowchart showing an example of the procedure of the image display process. For the sake of concrete explanation, the active location data is assumed to be a three-dimensional fMRI image APD. The blood vessel image VI is assumed to be blood vessel volume data in the brain of the subject, generated by the DSA method in the X-ray diagnostic device 10.

[0043] (Image display processing) (Step S601) The processing circuit 34, by using the acquisition function 34a, acquires the fMRI image APD and the blood vessel image VI from the image storage device 20. The fMRI image APD and the blood vessel image VI are images relating to the same subject. The acquisition function 34a stores the fMRI image APD and the blood vessel image VI in the memory 33.

[0044] (Step S602) The processing circuit 34 reads out the fMRI image APD and the blood vessel image VI from the memory 33 by the alignment function 34b. The alignment function 34b executes alignment between the fMRI image APD and the blood vessel image VI. This alignment is a three-dimensional alignment. As a result, the alignment function 34b generates an activity vessel superimposed image AVSI. The alignment function 34b stores the generated activity vessel superimposed image AVSI in the memory 33.

[0045] (Step S603) The processing circuit 34 uses the calculation function 34c to calculate the positional relationship between at least one of the multiple activity areas and the blood vessel BV based on the result of the alignment. When one activity area is selected by a user, for example, when a first activity area AR1 is selected by the user as shown in Fig. 4, the calculation function 34c calculates the shortest distance D1 from the blood vessel BV to the first activity area AR1 as the positional relationship, as shown in Fig. 4.

[0046] Furthermore, when a plurality of activity areas are selected by the user, for example, when first to third activity areas (AR1, AR2, AR3) are selected by the user as shown in Fig. 5, the calculation function 34c calculates the center of gravity position CG as shown in Fig. 4. Next, the calculation function 34c calculates the shortest distance from the center of gravity position CG to the blood vessel BV.

[0047] (Step S604) The processing circuit 34 calculates a target position TP for the placement of the electrode-equipped device on the blood vessel BV based on the calculated positional relationship by the calculation function 34c. The calculation function 34c stores information (coordinates, direction vector, etc.) related to the calculated target position TP in the memory 33.

[0048] (Step S605) The processing circuit 34 causes the display control function 34d to superimpose the target position TP on the active blood vessel superimposed image AVSI and display it on the display 32. At this time, the target position TP can be adjusted as appropriate by a user's instruction via the input interface 31. In addition, in a state in which the target position is superimposed on the active blood vessel superimposed image AVSI, the selection of the active region can be changed as appropriate. At this time, the processing from step S603 onwards is repeated. Note that the display control function 34d may superimpose the target position TP on the fMRI image or the blood vessel image VI and display it on the display 32. When a user's instruction via the input interface 31 is input to confirm the target position TP, the display control function 34d stores in the memory 33 an image in which the target position TP is superimposed on the active blood vessel superimposed image AVSI (hereinafter referred to as a target position presenting image).

[0049] The medical image processing apparatus 30 according to the embodiment described above acquires activity position data related to the positions of a plurality of active regions that activate a part of a subject, and a blood vessel image VI showing a three-dimensional blood vessel BV related to the plurality of active regions, performs registration between the acquired activity position data and the blood vessel image VI, calculates a positional relationship between at least one of the plurality of active regions and the blood vessel BV based on the result of the registration, and displays information on the arrangement of a device capable of receiving an electric signal from the active region in the blood vessel of the subject based on the calculated positional relationship. At this time, in the medical image processing apparatus 30 according to the embodiment, the device is, for example, a stent having an electrode that receives an electric signal generated in the active region. Moreover, the medical image processing apparatus 30 according to the embodiment displays the activity position data and the information on the arrangement of the device by superimposing them on the blood vessel image VI.

[0050] For example, the medical image processing apparatus 30 according to the embodiment calculates the shortest distance D1 between one of the multiple activity regions and the blood vessel BV as the positional relationship based on the result of the alignment. Also, the medical image processing apparatus 30 according to the embodiment calculates the center of gravity of the activity amount in each of the multiple activity regions based on the activity amount of each of the multiple voxels in the multiple activity regions, and calculates the shortest distance D1 between the blood vessel BV and the calculated center of gravity as the positional relationship based on the result of the alignment.

[0051] From these facts, the medical image processing apparatus 30 according to the embodiment can present the target position TP of device placement to the user based on the activity position data such as fMRI images and the blood vessel image VI, together with the activity position data and the blood vessel image VI. Therefore, the medical image processing apparatus 30 according to the embodiment can reduce the user's operation regarding the setting of the target position TP of device placement, and present the optimal device placement position to the user. As a result, the medical image processing apparatus 30 according to the embodiment can improve the efficiency (throughput) of diagnosis regarding device placement.

[0052] (First application example) In this application example, when the target position TP calculated in the embodiment is not suitable for placement of the device, a change of the target position is suggested. For example, the processing circuit 34 calculates a risky position that is dangerous with respect to the placement of the electrode-equipped device based on the structural information of the blood vessel BV in the blood vessel image VI by the calculation function 34c. The structural information of the blood vessel BV corresponds to, for example, the curvature of the blood vessel BV superimposed on the target position TP and the presence or absence of a branch in the blood vessel BV superimposed on the target position TP. For example, the calculation function 34c calculates the curvature of the blood vessel BV superimposed on the target position TP. Note that the calculation function 34c may calculate the radius of curvature of the blood vessel BV superimposed on the target position TP instead of the curvature. In addition, the calculation function 34c specifies the presence or absence of a branch in the blood vessel BV superimposed on the target position TP. The image display process related to this application example is performed, for example, after step S605.

[0053] The processing circuit 34 uses the calculation function 34c to calculate a dangerous position (such as coordinates in the blood vessel image VI) that poses a risk with respect to the placement of the electrode-mounted device based on the length of the electrode-mounted device, the elasticity of the electrode-mounted device, the calculated curvature (or the calculated radius of curvature), and the presence or absence of a branch. For example, the calculation function 34c may determine the target position TP as a dangerous position by calculating the length of an overlapping portion between the length of the electrode-mounted device and the length of the branch. The dangerous position corresponds to a case where there is a branch in the blood vessel BV that overlaps the target position TP, that is, a case where a part of the electrode-mounted device overlaps with the branch when the electrode-mounted device is placed at the target position TP.

[0054] When a type of electrode-equipped device is selected via the input interface 31, the length and elasticity of the electrode-equipped device are determined, for example, by the calculation function 34c by comparing the selected type with a correspondence table that associates the type with the length and elasticity of the electrode-equipped device. In addition, the calculation function 34c of the processing circuit 34 calculates a danger position of the target position TP based on the curvature (or radius of curvature) of the blood vessel BV, the length of the electrode-equipped device, and the elasticity of the electrode-equipped device. The calculation function 34c stores the calculated danger position (coordinates) in the memory 33.

[0055] The processing circuit 34 causes the display control function 34d to display the device arrangement, among the information on the device arrangement, on the blood vessel in the blood vessel image VI in a different hue depending on the distance from the position related to the shortest distance (the above-mentioned central position CP). At this time, the display 32 displays the arrangement of the electrode-equipped device on the blood vessel in the blood vessel image VI in a different hue depending on the distance from the central position CP.

[0056] Fig. 7 is a diagram showing an example of displaying different hues SC according to the distance from a central position CP corresponding to the position with the shortest distance from the active area AR1 to the blood vessel BV. In Fig. 7, different hues SC are represented by different shades of hatching. For example, as shown in Fig. 7, the display 32 displays the blood vessel BV in a different hue SC for every 1 mm away from the central position SC. As shown in Fig. 7, when a target position TP is moved / adjusted along the blood vessel BV by a user's operation via the input interface 31, the different hues SC according to the distance from the central position CP correspond to a scale.

[0057] Furthermore, the processing circuit 34 causes the display control function 34d to display the calculated danger position on the blood vessel BV in a hue (hereinafter referred to as danger hue) different from the hue corresponding to the above scale on the display 32. The danger hue is a hue different from the hue shown in FIG. 7, and may be, for example, a warning color such as reddish orange. The display control function 34d may also cause the display 32 to display the curvature or curvature radius at the target position TP on the blood vessel BV according to the position of the target position TP. This allows the user to grasp the curvature or curvature radius at the target position TP.

[0058] The medical image processing device 30 according to the first application example of the embodiment described above displays the device location, among the information on the device location, on the blood vessel BV in the blood vessel image VI in different hues CS according to the distance from the position related to the shortest distance (center position CP). Thus, according to the medical image processing device 30 according to the first application example of the embodiment, the user can easily move and adjust the target position TP via the input interface 31.

[0059] Further, the medical image processing device 30 according to the first application example of the embodiment calculates a risk position that is dangerous with respect to the placement of the device based on the structural information of the blood vessel BV, and displays the risk position on the blood vessel BV in a hue (risk hue) different from the above hue. As a result, according to the medical image processing device 30 according to the first application example of the embodiment, when the curvature of the blood vessel BV at the calculated target position TP is large, or when the target position TP is a position that is not suitable for placement of the electrode-equipped device, such as a site (e.g., a branch) that is considered to be other dangerous, the risk hue can be displayed on the blood vessel BV. As a result, the user can change the target position TP with one touch via the input interface 31 to a position where it is safe to place the electrode-equipped device. Since other effects are similar to those of the embodiment, a description thereof will be omitted.

[0060] (Second application example) In this application example, the target position TP determined by the input interface 31 is displayed on a display together with a fluoroscopic image acquired from the X-ray diagnostic apparatus 10. For the sake of concrete explanation, in the following application example, various functions in the processing circuit 34 of the medical image processing device 30 will be described as being mounted on the X-ray diagnostic apparatus 10. Note that the technical features realized in this application example can also be realized by the medical image processing device 30 alone by acquiring a fluoroscopic image from the X-ray diagnostic apparatus 10.

[0061] 8 is a block diagram showing an example of the configuration of an X-ray diagnostic apparatus 10 according to a second application example of the embodiment. As shown in FIG. 8, the X-ray diagnostic apparatus 10 includes an X-ray high voltage device 101, an X-ray tube 102, a collimator 103, a filter 104, a tabletop 105, a C-arm 106, an X-ray detector 107, a control device 108, a memory 109, a display 110, an input interface 111, and a processing circuit 112.

[0062] The X-ray high voltage device 101 supplies a high voltage to the X-ray tube 102 under the control of the processing circuit 112. For example, the X-ray high voltage device 101 has electric circuits such as a transformer and a rectifier, and includes a high voltage generating device that generates a high voltage to be applied to the X-ray tube 102, and an X-ray control device that controls the output voltage according to the X-rays irradiated by the X-ray tube 102. The high voltage generating device may be of a transformer type or an inverter type.

[0063] The X-ray tube 102 is a vacuum tube having a cathode (filament) that generates thermoelectrons and an anode (target) that generates X-rays upon impact of the thermoelectrons. The X-ray tube 102 generates X-rays by irradiating thermoelectrons from the cathode to the anode using a high voltage supplied from the X-ray high voltage device 101. In this way, the X-ray tube 102 irradiates the subject P with X-rays.

[0064] The collimator (also called X-ray aperture device) 103 has, for example, four slidable aperture blades. By sliding the aperture blades, the collimator 103 narrows down the X-rays generated by the X-ray tube 102 and irradiates the X-rays to the subject P. Here, the aperture blades are plate-shaped members made of lead or the like, and are provided near the X-ray irradiation port of the X-ray tube 102 to adjust the irradiation range of the X-rays.

[0065] The filter 104 changes the radiation quality of the X-rays that pass through it depending on its material and thickness, in order to reduce the radiation dose to the subject P and improve the image quality of the X-ray image data, thereby reducing soft ray components that are easily absorbed by the subject P and reducing high energy components that cause a decrease in contrast in the X-ray image data. In addition, the filter 104 changes the dose and irradiation range of the X-rays depending on its material, thickness, position, etc., and attenuates the X-rays so that the X-rays irradiated from the X-ray tube 102 to the subject P have a predetermined distribution.

[0066] The top board 105 is a bed on which the subject P rests, and is placed on a bed (not shown). The subject P is not included in the X-ray diagnostic apparatus 10.

[0067] The C-arm 106 holds the X-ray tube 102, collimator 103, filter 104, and X-ray detector 107 so that they face each other with the subject P in between. Note that, although Fig. 8 illustrates an example in which the X-ray diagnostic apparatus 10 is a single plane, the embodiment is not limited thereto, and a biplane case may also be used. In addition, a known driving mechanism for the C-arm 106, such as one for an angiography apparatus for the circulatory system, can be applied.

[0068] The X-ray detector 107 is, for example, an X-ray flat panel detector (FPD) having detection elements arranged in a matrix. The X-ray detector 107 detects X-rays irradiated from the X-ray tube 102 and transmitted through the subject P, and outputs a detection signal corresponding to the detected X-ray amount to the processing circuit 112. The X-ray detector 107 may be an indirect conversion type detector having a grid, a scintillator array, and a photosensor array, or may be a direct conversion type detector having a semiconductor element that converts the incident X-rays into an electric signal.

[0069] The control device 108 includes driving mechanisms such as motors and actuators, and circuits for controlling these mechanisms. Under the control of the processing circuit 112, the control device 108 controls the operations of the collimator 103, the filter 104, the top plate 105, the C-arm 106, and the like. For example, the control device 108 adjusts the aperture of the aperture blades of the collimator 103 to control the irradiation range of the X-rays irradiated to the subject P. The control device 108 also adjusts the position of the filter 104 to control the distribution of the dose of the X-rays irradiated to the subject P. For example, the control device 108 also rotates and moves the C-arm 106 and moves the top plate 105.

[0070] The memory 109 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, a hard disk, an optical disk, etc. The memory 109 receives and stores, for example, X-ray image data collected by the processing circuitry 112. The memory 109 also stores programs corresponding to various functions read and executed by the processing circuitry 112. The memory 109 stores the same memory contents as those stored in the memory 33 in the medical image processing device 30 shown in FIG.

[0071] The display 110 displays various types of information. For example, the display 110 displays a GUI for receiving instructions from an operator and various types of X-ray image data. For example, the display 110 is a liquid crystal display or a CRT display. The display 110 displays the same display contents as the display 32 in the medical image processing device 30 illustrated in FIG. 1.

[0072] The input interface 111 is realized by a trackball, a switch, a button, a mouse, a keyboard, a touch pad for performing input operations by touching an operation surface, a touch screen in which a display screen and a touch pad are integrated, a non-contact input circuit using an optical sensor, a voice input circuit, and the like for performing various instructions and various settings. The input interface 111 converts an input operation received from an operator into an electric signal and outputs it to the processing circuit 112. The input interface 111 is not limited to an interface having physical operation parts such as a mouse and a keyboard. For example, an example of the input interface 111 includes an electric signal processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the X-ray diagnostic apparatus 10 and outputs the electric signal to the processing circuit 112. The input interface 111 is capable of inputting operations similar to those of the input interface 31 in the medical image processing apparatus 30 described in FIG. 1.

[0073] The processing circuitry 112 executes a control function 112a, an acquisition function 112b, an acquisition function 34a, an alignment function 34b, a calculation function 34c, and a display control function 34d, thereby controlling the operation of the entire X-ray diagnostic apparatus 10. Regarding the processes related to the acquisition function 34a, the alignment function 34b, the calculation function 34c, and the display control function 34d, the description of the processes similar to those in the embodiment will be omitted.

[0074] The processing circuitry 112 reads out a program corresponding to the control function 112a from the memory 109 and executes it to control various functions of the processing circuitry 112 based on an input operation received from an operator via the input interface 111. The processing circuitry 112 that realizes the control function 112a corresponds to a control unit.

[0075] The processing circuit 112 collects X-ray image data by reading and executing a program corresponding to the collection function 112b from the memory 109. For example, the collection function 112b controls the X-ray high voltage device 101 and adjusts the voltage supplied to the X-ray tube 102 to control the amount of X-rays irradiated to the subject P and on / off. The collection function 112b also controls the control device 108 and adjusts the opening of the aperture blades of the collimator 103 to control the irradiation range of the X-rays irradiated to the subject P. The collection function 112b also controls the control device 108 and adjusts the position of the filter 104 to control the distribution of the X-ray dose.

[0076] Moreover, the processing circuitry 112 controls the control device 108 by the collecting function 112b, and controls the rotation and movement of the C-arm 106, the movement of the tabletop 105, and the like. The collecting function 112b also generates X-ray image data based on a detection signal received from the X-ray detector 107, and stores the generated X-ray image data in the memory 109. Here, the collecting function 112b may perform various image processing on the X-ray image data stored in the memory 109. For example, the collecting function 112b performs noise reduction processing using an image processing filter and scattered radiation correction on the X-ray image data. The processing circuitry 112 realizing the collecting function 112b corresponds to the collecting unit. As a result, the collecting function 112b generates a blood vessel image VI showing a three-dimensional blood vessel BV based on the irradiation of X-rays on the subject P. At this time, the processing circuitry 112 realizing the collecting function 112b corresponds to the image generating unit.

[0077] The processing circuit 112 acquires a fluoroscopic image of the subject P from the collection function 112b by the acquisition function 34a. The acquisition function 34a also acquires geometric information of the imaging system related to the imaging of the subject P in relation to the acquired fluoroscopic image from the control device 108. The geometric information is, for example, geometric information such as the position of the C-arm 106, the angle of the C-arm 106, and the position (coordinates) of the tabletop 105. The geometric information may be geometric information related to the X-ray tube 102 and the X-ray detector 107 in imaging the subject P with X-rays. The acquisition function 34a may store the fluoroscopic image and the geometric information in the memory 109 in association with each other. The acquisition function 34a also acquires a blood vessel image VI in which a target position TP is set (hereinafter, referred to as a placement position setting image) from the memory 109.

[0078] The processing circuitry 112 performs alignment between the placement position setting image and the fluoroscopic image by the alignment function 34b. Based on the result of the alignment, the alignment function 34b associates the placement position setting image with geometric information related to the fluoroscopic image. The alignment function 34b stores information related to the association between the placement position setting image and the geometric information (hereinafter referred to as association information) in the memory 109. The association information is, for example, a matrix for displaying the placement position setting image from the same viewpoint and line of sight as the fluoroscopic image based on the geometric information.

[0079] The processing circuit 112 calculates a target position TP indicating a target of device placement among information on device placement based on the geometric information on the acquired fluoroscopic image, following changes in the geometric information of the imaging system, using the calculation function 34c. Specifically, the calculation function 34c converts the placement position setting image after positioning into an image corresponding to the same viewpoint and line of sight direction as the fluoroscopic image, using the geometric information and association information on the acquired fluoroscopic image. As a result, the calculation function 34c calculates an image for displaying the placement position setting image (hereinafter referred to as the placement position image) corresponding to the fluoroscopic image by converting the placement position setting image following changes in the geometric information of the imaging system.

[0080] The processing circuitry 112 reads out a program corresponding to the display control function 34d from the memory 109 and executes it to display the X-ray image data collected by the collection function 112b on the display 110. In addition, the display control function 34d displays on the display 110 a GUI for receiving instructions from an operator.

[0081] Moreover, the processing circuitry 112 causes the display control function 34d to superimpose the target position TP on the fluoroscopic image and display it on the display 110. That is, the display control function 34d superimposes the placement position image on the fluoroscopic image and displays it on the display 110. The display control function 34d may superimpose the target position TP in the placement position image on the fluoroscopic image and display it on the display 110. As a result, the display 110 displays the target position TP superimposed on the fluoroscopic image. The display control function 34d may display a display image corresponding to at least one of FIGS. 3 to 5 and 7 on a part of the display 110 on which the fluoroscopic image is displayed, or on a monitor (for example, a reference monitor not shown in FIG. 8) different from the display 110 on which the fluoroscopic image is displayed.

[0082] Fig. 9 is a diagram showing an example of an image in which an indwelling position image is superimposed on a fluoroscopic image FI. As shown in Fig. 9, a target position TP is displayed on a blood vessel BV in a fluoroscopic image FI of a subject P. At this time, the blood vessel BV and the target position TP are displayed on an updated display 110 in response to an update of the fluoroscopic image.

[0083] When the electrode-equipped device moves to the target position TP, the processing circuit 112 changes the hue of the marker indicating the target position TP by the display control function 34d and displays it on the display 110. For example, the calculation function 34c calculates the position of the electrode-equipped device in the perspective image FI. Specifically, the calculation function 34c identifies the position of the electrode-equipped device in the perspective image FI by a known image recognition technique. Then, the calculation function 34c calculates the difference between the identified position of the electrode-equipped device and the target position TP. The difference is, for example, a difference (distance) between the coordinates of the identified position of the electrode-equipped device and the coordinates of the target position TP. The calculation function 34c compares the calculated difference with a preset value, and if the calculated difference is equal to or less than the preset value, it determines that the electrode-equipped device has reached the target position TP. The preset value is stored in the memory 109. In response to the determination that the electrode-equipped device has reached the target position TP, the display control function 34d changes the hue of the marker indicating the target position TP and displays it on the display 110.

[0084] FIG. 10 is a diagram showing an example in which the hue of the marker TPCC corresponding to the target position TP is changed. As shown in FIG. 10, when the electrode-equipped device reaches the target position TP, unlike FIG. 9, the hue of the marker TPCC (hatched in FIG. 10) is changed and displayed on the display 110. That is, the display 110 notifies the user that the electrode-equipped device has reached the target position TP, triggered by the arrival of the electrode-equipped device at the target position TP (hereinafter, referred to as device arrival). The notification of device arrival is not limited to the change in the hue of the marker indicating the target position TP, and may be realized by, for example, sound or lighting of a lamp. When the notification of device arrival is output by sound, the output of the sound is not limited to the display 110, and may be output from a known speaker or the like.

[0085] In the X-ray diagnostic apparatus 10 shown in FIG. 8, each processing function is stored in the memory 109 in the form of a program executable by a computer. The processing circuit 112 is a processor that realizes a function corresponding to each program by reading the program from the memory 109 and executing it. In other words, the processing circuit 112 in a state in which each program is read has a function corresponding to the read program. Note that, in FIG. 8, it has been described that the control function 112a, the collection function 112b, the acquisition function 34a, the alignment function 34b, the calculation function 34c, and the display control function 34d are realized by a single processing circuit 112, but the processing circuit 112 may be configured by combining a plurality of independent processors, and each processor may realize a function by executing a program.

[0086] The term "processor" used in the above description means a circuit such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)). The processors in the processing circuit 34 and the processing circuit 112 realize their functions by reading and executing a program stored in the memory 33 or the memory 109. Instead of storing a program in the memory 33 or the memory 109, the program may be directly built into the circuit of the processor. In this case, the processor realizes its function by reading and executing the program built into the circuit. The processor of this embodiment is not limited to being configured as a single circuit for each processor, and may be configured as a single processor by combining multiple independent circuits to realize its function.

[0087] The overall configuration of the X-ray diagnostic apparatus 10 according to the second application example of the embodiment has been described above. The display process (hereinafter referred to as the placement display process) when the electrode-equipped device is placed at the target position TP will be described below with reference to Fig. 11. Fig. 11 is a flowchart showing an example of the procedure of the placement display process. The placement display process is a process in which, for example, in response to updating of the fluoroscopic image accompanying the movement of the imaging system, the blood vessel BV and the target position TP are superimposed on the fluoroscopic image and displayed on the display 110 in accordance with the movement of the imaging system.

[0088] (Detention display processing) (Step S111) The processing circuitry 112 acquires the placement position setting image from the memory 109 using the acquisition function 34a.

[0089] (Step S112) The control device 108 performs fluoroscopic imaging of the subject P under the control of the control function 112a. As a result, the processing circuitry 112 generates a fluoroscopic image by the acquisition function 112b. At this time, the fluoroscopic image is associated with geometric information. The processing circuitry 112 acquires the fluoroscopic image and the geometric information by the acquisition function 34a.

[0090] (Step S113) The processing circuitry 112 performs alignment between the placement position setting image and the fluoroscopic image by the alignment function 34b. The alignment corresponds to associating the line of sight and line of sight direction in the placement position setting image with the geometric information of the fluoroscopic image. As a result, the alignment function 34b generates association information that associates the fluoroscopic image with the placement position setting image.

[0091] (Step S114) The processing circuitry 112 generates a placement position image based on the association information, the geometric information, and the placement position setting image by the calculation function 34c. The placement position image is an image generated with the same viewpoint and line of sight as the fluoroscopic image, and has a blood vessel BV and a target position TP.

[0092] (Step S115) The processing circuitry 112 causes the display control function 34d to superimpose the placement position image on the fluoroscopic image and display it on the display 110. As a result, the display 110 displays the target position TP on the blood vessel BV in the fluoroscopic image FI of the subject P as shown in Fig. 9. At this time, the display control function 34d may display a display image corresponding to at least one of Figs. 3 to 5 and 7 and / or an fMRI image on a part of the display 110 or on a reference monitor different from the display 110.

[0093] (Step S116) When the imaging system (C-arm 106, tabletop 105, etc.) is moved during fluoroscopic imaging of the subject P (Yes in step S116), the process of step S117 is executed. When the imaging system is not moved during fluoroscopic imaging of the subject P (No in step S116), the process of step S118 is executed.

[0094] (Step S117) The control device 108 performs fluoroscopic imaging on the subject P under the control of the control function 112a. As a result, the processing circuitry 112 generates a fluoroscopic image by the collection function 112b. The processing circuitry 112 acquires the fluoroscopic image and geometric information by the acquisition function 34a. After this step, the processing from step S114 onwards is repeated.

[0095] (Step S118) The processing circuitry 112 uses the calculation function 34c to determine whether the electrode-equipped device has reached the target position TP based on the difference between the position of the electrode-equipped device in the fluoroscopic image FI and the target position Tp. If the electrode-equipped device is placed at the target position TP (Yes in step S118), the process of step S119 is executed. If the electrode-equipped device is not placed at the target position TP (No in step S118), the process of step S116 and subsequent steps is executed.

[0096] (Step S119) The processing circuit 112 changes the hue of the marker indicating the target position TP by the display control function 34d and displays it on the display 110. At this time, as shown in Fig. 10, the display 110 changes the hue of the marker TPCC (hatched in Fig. 10) from the hue before the electrode-equipped device reached the target position TP and displays it. Note that the response when the electrode-equipped device reaches the target position TP is not limited to the change in the hue of the marker TPCC, and may be, for example, a sound output. With this step, the placement display process ends.

[0097] As a modified example of the second application example, an image corresponding to at least one of Figs. 3 to 5 and 7 relating to the active blood vessel superimposed image may be used in the placement display process, similar to the placement position setting image in the placement display process. At this time, the calculation function 34c generates an image corresponding to at least one of Figs. 3 to 5 and 7 relating to the active blood vessel superimposed image, corresponding to the same viewpoint and the same line of sight as the fluoroscopic image, following the movement of the imaging system, similar to the description of the placement display process. Next, the display control function 34d displays the image generated following the movement of the imaging system on a part of the display 110 or a reference monitor, etc. As a result, a part of the display 110 or a reference monitor, etc., displays an image corresponding to at least one of Figs. 3 to 5 and 7 corresponding to the fluoroscopic image as a reference image for the procedure, following the movement of the imaging system.

[0098] The placement display process is not limited to using the geometric information, and may generate a placement position image, for example, by performing registration (image processing) between a fluoroscopic image and a placement position setting image in accordance with the movement of the imaging system. In this case, it is not necessary to obtain the geometric information.

[0099] The X-ray diagnostic apparatus 10 according to the second application example of the embodiment described above irradiates X-rays to a subject P, generates a vascular image VI showing a three-dimensional blood vessel BV based on the irradiation of the subject P with the X-rays, obtains activity position data relating to the positions of a plurality of active areas that activate parts of the subject P and a vascular image VI showing the three-dimensional blood vessel BV related to the plurality of active areas, aligns the obtained activity position data with the vascular image VI, calculates a positional relationship between at least one of the plurality of active areas and the blood vessel BV based on the result of the alignment, and displays information regarding the placement of a device capable of receiving an electrical signal from the active area within the blood vessel of the subject P based on the calculated positional relationship. In addition, the X-ray diagnostic apparatus 10 according to the second application example of the embodiment acquires a fluoroscopic image FI generated based on fluoroscopic photography of the subject P and geometric information of the imaging system related to the imaging of the subject P, calculates a target position TP indicating a target for the placement of the electrode-equipped device from information related to the placement of the electrode-equipped device based on the geometric information related to the fluoroscopic image FI in accordance with changes in the geometric information of the imaging system, and displays the target position TP on the display 110 by superimposing it on the fluoroscopic image FI.

[0100] From these facts, according to the X-ray diagnostic apparatus 10 of the second application example of the embodiment, by using the three-dimensional blood vessel image VI as a base, similarly to the display of a three-dimensional roadmap image, the user can confirm the depth of the blood vessel BV and the current position of the target position TP from the top, bottom, left and right directions by following the rotation and movement of the C-arm 106 and the tabletop 105. Also, according to the X-ray diagnostic apparatus 10 of the second application example of the embodiment, since the display image corresponding to at least one of Figures 3 to 5 and Figure 7 can be simultaneously displayed on, for example, a reference monitor, the user can compare and confirm these images.

[0101] Furthermore, the X-ray diagnostic apparatus 10 according to the second application example of the embodiment notifies the user that the electrode-equipped device has reached the target position TP when the electrode-equipped device reaches the target position TP. For example, the X-ray diagnostic apparatus 10 according to the second application example of the embodiment can change the color of the marking of the placement position of the electrode-equipped device if the electrode-equipped device has accurately reached the target position TP after moving the electrode-equipped device to the target position TP. As a result, the X-ray diagnostic apparatus 10 according to the second application example of the embodiment can provide feedback to the user that the electrode-equipped device has reached the target position TP (notify the user). Other effects are similar to those of the embodiment, and therefore will not be described.

[0102] When the technical idea of ​​the present embodiment is realized by a medical image processing method, the medical image processing method acquires activity position data related to the positions of a plurality of active regions that activate a part of the subject P, and a blood vessel image VI showing a three-dimensional blood vessel BV related to the plurality of active regions, performs registration between the activity position data and the blood vessel image VI, calculates a positional relationship between at least one of the plurality of active regions, the blood vessel, and the BV based on the result of the registration, and displays information on the placement of a device that can receive an electric signal from the active region in the blood vessel of the subject P based on the positional relationship. The medical image processing method may further include acquiring a fluoroscopic image FI generated based on fluoroscopic photography of the subject P and geometric information of an imaging system related to imaging of the subject P, calculating a target position TP indicating a target of the placement of the device among the information on the placement of the device based on the geometric information related to the fluoroscopic image FI, following a change in the geometric information of the imaging system, and displaying the target position TP by superimposing it on the fluoroscopic image FI. The processing procedure in the medical image processing method complies with the image display processing and the placement display processing. Moreover, the effects of the medical image processing method are similar to those of the embodiment, the first application example, and the second application example, and therefore a description of the processing procedure and effects of the medical image processing method will be omitted.

[0103] When the technical idea of ​​the embodiment is realized by a medical image processing program, the medical image processing program causes a computer to obtain activity position data related to positions of a plurality of active areas that activate a part of a subject P and a blood vessel image VI showing a three-dimensional blood vessel BV related to the plurality of active areas, execute alignment between the activity position data and the blood vessel image VI, calculate a positional relationship between at least one of the plurality of active areas, the blood vessel, and the BV based on the result of the alignment, and display information on the arrangement of a device capable of receiving an electric signal from the active area in the blood vessel of the subject P based on the positional relationship. The medical image processing program further causes a computer to obtain a fluoroscopic image FI generated based on fluoroscopic photography of the subject P and geometric information of an imaging system related to imaging of the subject P, calculate a target position TP indicating a target of the arrangement of the device among the information on the arrangement of the device based on the geometric information related to the fluoroscopic image FI, following a change in the geometric information of the imaging system, and display the target position TP by superimposing it on the fluoroscopic image FI.

[0104] For example, the image display process and the indwelling display process can be realized by installing an image evaluation program in a computer such as the medical image processing device 30 or the X-ray diagnostic device 10 shown in FIG. 1 and developing the program on a memory. At this time, the program that can cause the computer to execute the process can be stored in a storage medium such as a magnetic disk (hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), or a semiconductor memory and distributed. In addition, the distribution of the medical image processing program is not limited to the above-mentioned medium, and may be distributed using an electric communication function, such as downloading via the Internet. The processing procedure in the medical image processing program conforms to the image display process and the indwelling display process. In addition, the effect of the medical image processing program is the same as that of the embodiment, the first application example, and the second application example. For these reasons, the processing procedure and effect of the medical image processing program will not be described.

[0105] According to at least the embodiment, the first application example, the second application example, etc. described above, it is possible to provide a user with information regarding the placement of a device capable of receiving an electrical signal from an active region that activates a part of the subject P. As a result, according to the embodiment, the first application example, the second application example, etc., it is possible to place a device accurately and safely by, for example, calculating an optimal device placement position on the apparatus side from the positional relationship between the cranial nerve activity area and the blood vessel.

[0106] Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0107] 1 Medical information processing system 10. X-ray diagnostic equipment 20 Image storage device 30 Medical image processing device 31 Input Interface 32 Display 33 Memory 34 Processing circuit 34a Acquisition Function 34b Alignment function 34c Calculation Function 34d Display control function 101 X-ray high voltage device 102 X-ray tube 103 Collimator 104 Filters 105 Tabletop 106 C-Arm 107 X-ray detector 108 Control device 109 Memory 110 Display 111 Input Interface 112 Processing circuit 112a Control Functions 112b Collection function

Claims

1. an acquisition unit that acquires activity position data relating to positions of a plurality of activity regions that activate a part of a subject and a blood vessel image showing a three-dimensional blood vessel related to the plurality of activity regions; a registration unit for performing registration between the activity location data and the blood vessel image; a calculation unit that calculates a positional relationship between at least one of the plurality of active regions and the blood vessel based on a result of the alignment; a display unit that displays information regarding the arrangement of a device capable of receiving an electrical signal from the active region within the blood vessel of the subject based on the positional relationship; A medical image processing device comprising:

2. the display unit displays the activity position data and information regarding the placement of the device in a superimposed manner on the blood vessel image. The medical image processing device according to claim 1 .

3. The calculation unit calculates, based on a result of the alignment, a shortest distance between one of the plurality of active regions and the blood vessel as the positional relationship. The medical image processing device according to claim 2 .

4. The calculation unit is calculating a center of gravity position of the activity amount in each of the plurality of activity regions based on the activity amount of each of a plurality of voxels in each of the plurality of activity regions; calculating, based on a result of the alignment, the shortest distance between the center of gravity position and the blood vessel as the positional relationship; The medical image processing device according to claim 2 .

5. the display unit displays, on the blood vessel in the blood vessel image, a location of the device among the information regarding the location of the device, in a different hue depending on a distance from a position regarding the shortest distance.

5. The medical image processing device according to claim 3.

6. The calculation unit calculates a risk position that is associated with a risk regarding placement of the device based on structural information of the blood vessel, the display unit displays the danger position on the blood vessel in a hue different from the hue of the blood vessel. The medical image processing device according to claim 5 .

7. The acquisition unit acquires a fluoroscopic image related to the subject, The display unit displays information regarding the arrangement of the device together with the fluoroscopic image. The medical image processing device according to claim 1 .

8. The acquisition unit further acquires geometric information of an imaging system related to imaging of the subject, the calculation unit calculates a target position indicating a target of the arrangement of the device, among information regarding the arrangement of the device, based on the geometric information regarding the perspective image, in accordance with a change in the geometric information of the imaging system; the display unit displays the target position by superimposing it on the fluoroscopic image. The medical image processing device according to claim 7 .

9. the information about the device includes a target location indicating a target for placement of the device with respect to receiving the electrical signal; The display unit notifies a user that the device has reached the target position when the device reaches the target position. The medical image processing device according to claim 1 .

10. The device is a stent having electrodes that receive electrical signals generated in the active area. The medical image processing device according to claim 1 .

11. An X-ray tube that irradiates an object with X-rays; an image generating unit that generates a three-dimensional blood vessel image based on the irradiation of the X-rays on the subject; an acquisition unit that acquires activity position data relating to positions of a plurality of activity regions that activate a part of the subject, and the three-dimensional blood vessel image relating to the plurality of activity regions; a registration unit for performing registration between the activity location data and the blood vessel image; a calculation unit that calculates a positional relationship between at least one of the plurality of active regions and the blood vessel based on a result of the alignment; a display unit that displays information regarding the arrangement of a device capable of receiving an electrical signal from the active region within the blood vessel of the subject based on the positional relationship; An X-ray diagnostic apparatus comprising:

12. the acquiring unit acquires a fluoroscopic image generated based on fluoroscopic photography of the subject and geometric information of an imaging system related to imaging of the subject; the calculation unit calculates a target position indicating a target of the arrangement of the device, among information regarding the arrangement of the device, based on the geometric information regarding the perspective image, in accordance with a change in the geometric information of the imaging system; the display unit displays the target position by superimposing it on the fluoroscopic image.

12. The X-ray diagnostic apparatus according to claim 11.

13. Acquiring activation position data relating to positions of a plurality of activation regions that activate a part of a subject and a blood vessel image showing a three-dimensional blood vessel relating to the plurality of activation regions; performing a registration of said activity location data with said vascular image; Calculating a positional relationship between at least one of the plurality of active regions and the blood vessel based on a result of the alignment; displaying information regarding the placement of a device capable of receiving an electrical signal from the active region within a blood vessel of the subject based on the positional relationship; A medical image processing method comprising:

14. acquiring a fluoroscopic image generated based on fluoroscopic photography of the subject and geometric information of an imaging system related to imaging of the subject; calculating a target position indicating a target of the arrangement of the device, among information on the arrangement of the device, based on the geometric information on the fluoroscopic image, in accordance with a change in the geometric information of the imaging system; displaying the target position by superimposing it on the fluoroscopic image; The medical image processing method according to claim 13 , further comprising:

Citation Information

Patent Citations

  • Medical image processing device, medical image diagnosis device, and medical image processing program

    JP2019000362A