Generate medical result images

By segmenting the reference image and the target image into multiple image segments and establishing a specific registration matrix, combined with two-dimensional real-time instrument tracking technology, the problem of vascular path map mapping error during neural intervention is solved, and the images during interventional process are improved Guide accuracy and reduce the use of contrast agent and X-ray doses.

CN112912005BActive Publication Date: 2024-11-26SIEMENS HEALTHINEERS AG
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201880098959.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2018-10-24
Publication Date
2024-11-26
Estimated Expiration
2038-10-24

AI Technical Summary

Technical Problem

During neurointervention, there is inaccuracy in the global registration based on 3D/3D bone structure, resulting in errors in vascular path map mapping, increasing the burden of patient contrast agent and X-ray dose.

Method used

By segmenting the reference image and the target image into multiple image segments, and establishing a specific registration matrix based on each segment, registering using rigid transformation technology of intensity, combined with two-dimensional real-time device tracking technology, medical result images are generated, reducing Use of contrast agents and X-ray doses.

Benefits of technology

Improves image guidance accuracy during interventional procedures, reduces the use of contrast agents and X-ray doses, and provides a higher accuracy in surgical instrument location and a global overview of the vascular system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112912005B_ABST
    Figure CN112912005B_ABST
Patent Text Reader

Abstract

The invention relates to a method for generating a medical result image (RESI) using a current image (CI), a target image (TI) and a reference image (REFI). All images at least partially depict the same body region of a patient (6). The method comprises the following steps: i. defining (S13; S23) at least one image segment (ISEG) within the target image, ii. registering (S14; S24) the reference image with the target image by establishing a registration matrix (REGMA) for each image segment within the target image, wherein the registration matrix is ​​specific to the respective image segment, iii. detecting (S16; S26) a position (IPOS) of a surgical instrument in the current image, the position corresponding to the image segment of the target image, and iv. fusing the current image and the reference image by using the registration matrix assigned to the image segment according to the position of the surgical instrument within the current image, thereby generating (S17; S27) a medical result image. A computing unit thereof, a medical imaging device comprising such a unit, and a computer program product, a computer readable medium for performing such a method are also provided.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] It is known to combine three-dimensional (3D, volumetric) image data sets, each of which is acquired under a separate medical imaging modality using 3D / 3D registration techniques. For example, a computed tomography (CT) 3D image or a magnetic resonance tomography (MRT) 3D image can be fused with, or superimposed on, an angiography / angiography 3D image. It is further known to superimpose a desired volumetric data set onto a two-dimensional (2D) fluoroscopy / fluoroscopic image to provide intuitive intra-procedural guidance by displaying the superposition. The superimposed volume can be dynamically updated as the geometry of the angiography system (e.g., a C-arm angiography x-ray system used to acquire the fluoroscopic images) changes. Thus, diagnostic medical imaging data sets that may be acquired conventionally and / or long before an interventional procedure can therefore be used to provide additional anatomical information. Using 3D CT angiography (CTA) or MRT angiography (MRA), detailed vascular information can be provided during interventional procedures such as catheterization, stenting, or coiling procedures. Thus, repetitive intraoperative 2D / 3D angiography acquisitions can be reduced, thereby advantageously reducing the overall x-ray dose and / or contrast agent burden to the patient. Examples for these procedures are described, for example, in Zhang, Qiang, et al., “ 基于CBCT的3D MRA与血管造影图像融合以及 用于神经介入的MRA图像导航 ” (in: Medicine; Vol. 95, No. 32; pp. 1-7; DOI 10.1097 / MD.0000000000004358; 2016) or “ 三 维CTA与血管造影图像融合用于神经介入手术期间的实时引导 神经介入手术 ” (in: Neuroimaging; pp. 1–7; 2016).

[0002] With regard to neurointerventions including endovascular treatment of vascular disorders involving the brain, medulla, head and / or neck, as well as endovascular treatment of other peripheral vascular malformations, it is particularly advantageous to provide an overview of the vascular system throughout the region of interest. This can be achieved by generating a CTA or MRA 3D roadmap and combining it with 3D angiography (e.g., Siemens DynaCT Large Volume or DynaCT 360 technology, which enables the use of a 30*40 cm field of view (FOV) covering the aortic arch to the cranial end). 2The overview is provided by registering the patient's portrait scan with a detector. However, the patient position is often different between CTA / MRA and angiography acquisitions, mainly due to cervical spine twisting. This prevents global registration based on 3D / 3D bone structures and often introduces inaccuracies during 3D vascular path mapping.

[0003] To correct for these roadmap inaccuracies, it is known to use additional, preferably intraoperative digital subtraction angiography (DSA) to adjust for any deviations between CTA / MRA and real-time vessel position. This involves considerable contrast administration, since the DSA is ideally repeated for different anatomical regions.

[0004] Alternatively, it is known to acquire individual 3D angiographic images of the thoracic-cervical and cranial regions, thereby ensuring the best registration accuracy for the current region of interest, while maintaining an overview of the entire supra-aortic circulation from the aortic arch to the intracranial vessels. Of course, for each 3D angiographic acquisition, a 3D / 3D registration needs to be performed individually (see Zhang, Qiang et al., “ 维CTA与血管造影图像融合用于神经介入手术期间的实 时引导 ”; in: Neuroimaging; pp. 1-7; 2016).

[0005] Both of these approaches involve additional contrast agent and / or X-ray dose burden to the patient.

[0006] It is therefore an object of the present invention to provide an alternative means and / or method which allows intra-operative medical image superposition while keeping patient X-ray dose and contrast agent administration as low as possible.

[0007] This object is solved by a method for generating a medical result image using a current image, a target image and a reference image, a corresponding computing unit, a medical imaging device, a computer program product, and a computer-readable storage medium according to the independent claims. Alternative and / or preferred embodiments are objects of the dependent claims.

[0008] In the following, the technical solution according to the present invention is described with respect to the claimed device and with respect to the claimed method. Features, advantages or alternative embodiments described herein can also be assigned to other claimed purposes, and vice versa. In other words, the claims discussing the method of the present invention can be improved by the features described or claimed with respect to the device. In this case, for example, the functional features of the method are embodied by the target unit of the device.

[0009] A first aspect of the present invention relates to a method for generating a medical result image using a current image, a target image and a reference image. All images involved at least partially depict the same body region of a patient. The current image, the reference image and the target image are all medical images acquired using a medical imaging device, such as a computed tomography system, a magnetic resonance tomography system, a C-arm x-ray system, etc. The depicted body region of the patient corresponds to a body part, a body (sub) region, such as the abdomen, chest, neck, head, etc. The reference image, the target image and the current image at least partially depict the same body region, that is, they all include or show at least one common anatomical structure, organ, tissue, etc. Each of the reference image, the target image and the current image may include additional or extra anatomical structures that are not present in one of the other images. In other words, the current image, the target image and the reference image may cover different or the same field of view. Preferably, the reference image and the target image cover a larger field of view than the current image. Although the target image is preferably a three-dimensional image, most preferably an angiography image, the current image is preferably a two-dimensional image, most preferably a fluoroscopy image. The current image preferably depicts a scene and / or a body part in which a medical, i.e., surgical intervention occurs. Preferably, the target image and the current image are acquired using the same medical imaging device. Preferably, they are acquired using a C-arm x-ray device. Preferably, the target image and the current image are acquired during a medical or surgical intervention procedure (e.g., a catheterization, stenting, or coiling procedure) on a patient. Further preferably, the target image is acquired at the beginning of a medical intervention corresponding to an initial image of the imaged body region. Preferably, the current image is acquired at any later point in time during the medical intervention. Preferably, the reference image is a preoperative three-dimensional image, such as a magnetic resonance angiography image or a computed tomography angiography image. Most preferably, the reference image depicts an overview of the vascular system of the imaged patient. In other words, the reference image is not acquired during the same medical procedure, but is preferably acquired before the intervention. Further preferably, the reference image is acquired as a diagnostic image as part of the patient's medical examination pathway and / or therapy pathway and exists in an electronic patient health record file and is stored in a database, such as a local PACS (Picture Archiving and Communication System) of a medical enterprise or hospital, or in a cloud data storage device.

[0010] All images involved in the method of the invention may preferably be digital image files according to the DICOM standard or the like. These images may all be loaded and processed by a computing unit according to the invention, which will be described further below. Image processing, image manipulation and / or image analysis according to the invention takes place in image space.

[0011] The method comprises a number of steps.

[0012] The first step involves defining at least one image segment within the target image. The method of the present invention identifies at least one, preferably more than one, image segment. In other words, the target image is subdivided into segments. The segments may be smaller in size than the target image, or may be the same size as the target image. Preferably, the segment position and / or size is selected, oriented and / or aligned relative to the patient's anatomy depicted in the target image.

[0013] According to a preferred embodiment of the invention, the at least one image segment is defined by setting at least one segmentation plane oriented based on the anatomical structure in the depicted body region. Most preferably, the segmentation plane is set perpendicular to the longitudinal body axis of the patient. By defining more than one segmentation plane, several image segments corresponding to transversely oriented image segments can be defined.

[0014] According to another preferred embodiment of the present invention, the segmentation plane is manually set by a user.

[0015] Thus, by visually analyzing the target image and the displayed anatomical structures, the user can individually locate at least one segmentation plane, which is then used as an image segment boundary. The segmentation plane can be aligned with at least one anatomical structure, such as a bone structure and / or an organ and / or a specific landmark present in the target image. Alternatively, the at least one segmentation plane can be automatically set by the computing unit of the present invention based on the target image segmentation results and / or landmark and / or structure and / or texture detection results. In addition, the segmentation plane can be semi-automatically set by automatically suggesting the segmentation plane, wherein the suggestion can be accepted and / or corrected by the user.

[0016] The second step involves registering the reference image with the target image by establishing a registration matrix for each image segment within the target image, wherein the registration matrix is ​​specific to the corresponding image segment. Image registration generally describes the alignment of two images, wherein differences in the images may be caused, for example, by differences in viewing angles, use of different medical imaging devices, patient movement, anatomical changes over time, etc. In other words, both the reference image and the target image are aligned to each other in order to compensate for the differences discussed. The registration matrix corresponds to the sum of mathematical and / or geometric and / or special transformations, which when applied to, for example, the reference image space optimally align the anatomical structures of the reference image with the corresponding structures of the target image. Similarly, the target image can be aligned to the reference image. However, since the target image and also the current image generally represent the latest anatomical state or condition of the patient, it is preferred to align the reference image to the target image. Preferably, before registering the reference image and the target image, the anatomical structures / objects / organs / tissues / structures in the two images are segmented using segmentation techniques that are well known per se in the field of medical image processing. Furthermore, pre-registering the reference image to the coordinate system of the medical imaging device used to acquire the target image may be necessary for the registration.

[0017] According to a preferred embodiment of the present invention, the registration of the reference image and the target image is performed using a rigid transformation technique based on intensity. Rigid registration is usually limited to linear transformations, such as rotation, translation, scaling, etc. Linear transformations are characterized in that they can only be applied globally to images, which means that only local deviation differences between the reference image and the target image can be partially taken into account. In other words, the rigid registration matrix should be understood as a compromise or trade-off of transformations, which generally leads to the alignment of anatomical structures, but it is less than 100% aligned. Intensity-based registration usually compares the intensity patterns identified in the reference image and the target image so that they correspond to each other, and attempts to find a transformation that causes the alignment of the anatomical structures of the reference image and the target image. If it is considered necessary, the registration matrix automatically established according to the present invention can be manually corrected and / or adapted by the user.

[0018] According to the concept of the invention, in this step not only one registration matrix is ​​established, but at least two registration matrices are established. The registration matrix is ​​specific to the corresponding image segment of the target image. In other words, the registration matrix is ​​body region specific.

[0019] According to another preferred embodiment of the present invention, an image segment-specific registration matrix is ​​established only based on anatomical features located in the corresponding image segment. In other words, the registration process only considers anatomical features and / or structures, such as organs, tissues, lesions, etc., located within the corresponding image segment. Therefore, compared with the registration matrix established by considering the entire target image, the image segment-specific registration matrix is ​​more accurate for the anatomical structures (preferably bone structures) located within the segment. Therefore, at least two registration matrices that only take into account the anatomical structures in the corresponding image segment are constructed. For establishing the registration matrix of the corresponding image segment, the anatomical structures outside the corresponding image segment are not considered. Therefore, at least two registration matrices of different image segments can be different from each other. Therefore, each registration matrix only represents a transformation operation adapted to the patient's anatomical structure within the corresponding segment.

[0020] The third step involves detecting the position of the surgical instrument in the current image, which position corresponds to the image segment of the target image. Here, object detection processes known per se in the field of medical image processing can be applied. The surgical instrument can be, for example, a catheter, a stent, etc., or just a specific part of the instrument.

[0021] According to a preferred embodiment of the present invention, this step is performed using a two-dimensional real-time instrument tracking technique. For example, in " 用于腹主动脉瘤血管内修复术中高级可视化的选择性动脉装置自动检测 用于腹主动脉瘤血管内修复术中高级可视化的选择性动脉装置自动检测 ” (in: Med Eng Phys., 2015, Vol. 37(10), pp. 979-986). Alternatively, the user may provide information about where the surgical instrument is located in the current image by providing manual input via a user interface.

[0022] This step is based on the inventive insight that at least one image segment identified in the target image and the anatomical structure within the segment are also present in the current image. In other words, the detected current position of the surgical instrument is assigned to an image segment by verifying to which image segment of the target image the detected position belongs. Therefore, the detected position corresponds to an image segment defined in the target image. In other words, first the target image boundary needs to be transferred to the current image, for example by using a registration technique for registering the target image and the current image. For example, in order to simplify the method steps, the target image and the current image can be registered to a common coordinate system, preferably the coordinate system of a C-arm X-ray device.

[0023] The fourth step of the method of the present invention involves fusing the current image and the reference image by using the registration matrix assigned to the image segments according to the position of the surgical instrument within the current image, thereby generating a medical result image. In order to fuse the current image and the reference image, the registration matrix corresponding to the image segment to which the current surgical instrument position belongs is first applied to the reference image to align the anatomical structure to the target image and thereby also to the current image. Then, the reference image and the current image are merged / fused / superimposed.

[0024] According to another preferred embodiment, an image-segment-specific registration matrix is ​​applied globally to the reference image. Although the transformations defined in the segment-specific registration matrix are based on anatomical structures within the respective image segment, the registration matrix is ​​applied to the complete reference image and not only to the reference image sector corresponding to the image segment in the target image. As a result, the highest registration accuracy for this image segment (including instrument position) is provided in the result image, accepting a smaller overlay accuracy for the remaining image parts of the result image. The result image corresponds to an image overlay including information on the latest position of the surgical instrument, and a preferably global overview of the vascular system, and is used for intraoperative guidance of the user.

[0025] The inventive method provides high intra-interventional or intra-operative registration accuracy for surgical image guidance by determining the current instrument position and applying the most accurate registration matrix for the image segments corresponding to the detected instrument position.

[0026] According to a preferred embodiment of the invention, in the method steps for defining at least one image segment within the target image and registering the reference image with the target image by establishing a registration matrix for each image segment within the target image, the current image is used as the target image, wherein the registration matrix is ​​specific to the respective image segment. According to this embodiment, the invention advantageously requires only two images to generate the result image.

[0027] According to another preferred embodiment of the invention, the current image is repeatedly updated during the surgical intervention, and the steps for detecting the instrument position and generating the result image are repeated using the updated current image as well. In other words, the method of the invention can be repeatedly applied during the medical intervention or surgery to repeatedly provide updated result images for intervention guidance. In each iteration or for each current image, it is checked in which image segment the current instrument position is located. If the instrument position moves from one image segment to another between the acquisition of two consecutive current images, the registration matrix is ​​updated accordingly for generating the result image for the second of the two consecutive current images. For all further iterations, the updated registration matrix is ​​used as long as the instrument tip stays within the corresponding image segment. In this embodiment, the result image corresponds to an image superposition including information about the latest position of the surgical instrument during the intervention, and a preferred global overview of the vascular system, wherein the registration matrix applied to the reference image is selected according to the surgical instrument position.

[0028] According to another preferred embodiment of the present invention, in the step for defining at least one image segment within the target image and registering the reference image with the target image by establishing a registration matrix for each image segment within the target image, the current image first acquired during the surgical intervention is used as the target image. In other words, the target image corresponds to the first of a plurality of current images acquired during the surgical intervention. In this way, the application or transfer of the at least one image segment defined using the target image to a plurality of current images is advantageously simplified, since the current images are acquired using the same medical imaging device and are therefore registered to the same coordinate system from the beginning.

[0029] According to another preferred embodiment of the invention, during the surgical intervention, the steps for defining at least one image segment within the target image and registering the reference image with the target image by establishing a registration matrix for each image segment within the target image are repeated, wherein the updated current image is used as the target image. Thus, at least one updated registration matrix is ​​established, wherein the at least one updated registration matrix is ​​applied in the step for generating the medical result image. This embodiment of the invention advantageously takes into account severe changes between the target image and the current image, which severe changes may occur during the surgical intervention, and prohibits the continued use of the original target image and the corresponding registration matrix for the current image.

[0030] Furthermore, according to this embodiment of the invention, an image segment-specific registration matrix is ​​globally applied to the reference image in order to generate a result image. In other words, the geometric transformation corresponding to the segment-specific registration is not only applied segment by segment to the reference image, but also to the complete reference image. The method recognizes the fact that inaccuracies and / or deviations of the superposition of anatomical structures in the result image outside the image segment where the surgical instrument is currently located do not seriously affect the quality of the interventional guidance, as long as the registration quality within this image segment is at maximum, so as to provide optimal guidance where the surgical instrument is currently located.

[0031] According to another preferred embodiment of the invention, the steps for detecting instrument position and generating result images are performed in real time or near real time. This embodiment advantageously allows instantaneous display of result images and / or a continuous sequence of updated result images for a user.

[0032] Another aspect of the present invention relates to a computing unit for generating a medical result image using a current image, a target image, and a reference image. The computing unit includes a definition unit adapted to define at least one image segment within the target image. The computing unit includes a registration unit adapted to register the reference image with the target image by establishing at least one registration matrix for each image segment. The computing unit includes a detection unit adapted to detect a position of a surgical instrument in the current image, which corresponds to an image segment of the target image, and the computing unit includes a generation unit adapted to fuse the current image and the reference image using a registration matrix assigned to the image segment according to the position of the surgical instrument, thereby generating a medical result image. The computing unit may optionally include an acquisition unit adapted to acquire and / or receive and / or load the current image, the target image, and the reference image, for example, from a medical imaging device, a PACS, a cloud storage device, etc.

[0033] The computing unit according to the invention is adapted to implement the method of the invention. The computing unit can be configured to perform in particular the following steps: fuse the current image and the reference image by using a registration matrix assigned to the image segments according to the position of the surgical instrument, thereby generating a medical result image. The computing unit can likewise be arranged to perform all steps of the method of the invention for an individual medical imaging device and / or several medical imaging devices in a hospital, a medical setting, etc.

[0034] The computing unit can be implemented as a data processing system or a part of a data processing system. Such a data processing system can, for example, include a cloud computing system, a computer network, a computer, a tablet computer, a smart phone, etc. The computing unit can include hardware and / or software. For example, the hardware can be a processor system, a memory system, and a combination thereof. The hardware can be configured and / or operated by software. In general, all units, subunits or modules can at least temporarily exchange data with each other, for example via a network connection or a corresponding interface.

[0035] Another aspect of the present invention relates to a medical imaging device for generating a medical result image using a current image, a target image and a reference image. The medical imaging device comprises a computing unit of the present invention. Preferably, the computing unit is physically integrated into the medical imaging device. Alternatively, the computing unit can be physically located separately from the medical imaging device. The medical imaging device is an imaging device for medical purposes. In particular, the medical imaging device can involve imaging using optical electromagnetic radiation and / or X-ray radiation. In particular, the medical imaging device can be a magnetic resonance imaging device, a computer tomography imaging device, an X-ray imaging device, a positron emission tomography (PET) imaging device and / or an ultrasound imaging device. Most preferably, the medical imaging device is a C-arm x-ray device typically used to obtain angiography and / or fluoroscopy images.

[0036] Another aspect of the invention relates to a computer program product comprising a program element which, when loaded into a memory of a computing unit, causes the computing unit to execute the steps of the method according to the invention.

[0037] Another aspect of the invention relates to a computer-readable medium on which a program element is stored which is readable and / or executable by a computing unit so as to carry out technical operations, for example comprising the steps of the method of the invention, when the program element is executed by the computing unit.

[0038] The implementation of the invention by means of a computer program product and / or a computer readable medium has the advantage that already existing provisioning systems can easily be adopted by means of a software update in order to function as proposed by the invention.

[0039] For example, a computer program product may be a computer program, or may include another element beside the computer program itself. The other element may be hardware, such as a memory device on which the computer program is stored, a hardware key for using the computer program, etc., and / or may be software, such as a document or software key for using the computer program. The computer program product may further include development materials, a runtime system and / or a database or library. The computer program product may be distributed among several computer instances.

[0040] The characteristics, features and advantages of the invention described above and the manner in which they are achieved become clearer and more easily understood from the following description and embodiments which will be described in detail with respect to the accompanying drawings. The following description does not limit the invention to the embodiments included. In different drawings, the same components or parts may be marked with the same reference symbols. In general, the drawings are not drawn to scale. In the following:

[0041] Figure 1 A schematic flow chart of a method according to an embodiment of the present invention is shown.

[0042] Figure 2 A schematic flow chart of a method according to another embodiment of the present invention is shown.

[0043] Figure 3 depicts a schematic diagram of a medical imaging device in the form of a C-arm x-ray imaging device including a computing unit according to an embodiment of the present invention,

[0044] Figure 4 shows a reference image including a segmentation plane according to an embodiment of the present invention, and

[0045] Figure 5 A target image including a segmentation plane according to another embodiment of the present invention is shown.

[0046] Figure 1A schematic flow chart of the method of the present invention according to an embodiment of the present invention is shown. In a first step S11, a reference image REFI is acquired. This step includes: either using a medical imaging device for image acquisition, and / or loading a corresponding reference image data set from a local or central storage unit (such as a PACS or cloud storage device) into a computing unit 7 for further processing. The reference image REFI is preferably a three-dimensional MRA or CTA, which shows an overview of the vascular system covering at least the body area of ​​the patient to be imaged. Preferably, a contrast agent is used to acquire the three-dimensional reference image, because those images are most suitable for imaging the vascular system. The reference image REFI also depicts the patient's bone structure. In a second step S12, a target image TI is acquired. This preferably includes using a medical imaging device for image acquisition, but may also include loading a corresponding target image data set from a local or central storage unit (such as a PACS or cloud storage device) into a computing unit 7 for further processing. The target image TI is preferably a three-dimensional angiography image, which is acquired using a C-arm x-ray imaging device 1 with the application of a contrast agent at the beginning of a surgical intervention. Therefore, the target image TI also depicts the patient's vascular system. The target image TI preferably has the same or similar field of view as the reference image REFI, but may also have a smaller field of view. The target image TI also depicts bone structures. Although the target image TI corresponds to an intra-interventional image dataset, the reference image REFI instead corresponds to an image acquired before or long before the surgical intervention. Therefore, the target image TI represents the current or latest state of the patient's anatomical structure in the imaged body region. In a third step S13, at least one image segment ISEG is defined in the target image TI. Alternatively, the image segment ISEG may be defined in the reference image REFI. The image segment ISEG is aligned to an anatomical structure (e.g., bone and / or bone landmark) and / or oriented according to the anatomical structure. For example, the image segment ISEG is defined by setting at least one segmentation plane SP, which is aligned to an anatomical structure in the depicted body region and / or oriented according to the anatomical structure. Preferably, the target image TI is presented to the user via the output unit 48, and the segmentation plane SP is manually input by the user considering the depicted patient anatomical structure via the input unit 50. For example, the user can draw a line at the desired position using an activated mouse cursor. For further user support, both the target image TI and the reference image REFI can be presented to the user. Based on local deviations between the patient's anatomical structures in the two images, the user can individually decide the number and position of image segments ISEG suitable for the patient. For example, three image segments ISEG can be defined. Alternatively, at least one segmentation plane SP can be automatically set by the calculation unit 7 and presented to the user via the input / output unit 48 / 50 for confirmation or correction.Furthermore, step S13 may be performed fully automatically without user input. Here, it may first be necessary to segment the target image TI and / or the reference image REFI to identify anatomical structures. Based on the segmented and analyzed anatomical structures (such as bones, organs, tissues, etc.), the segmentation plane SP may be automatically set. In a fourth step S14, the target image TI and the reference image REFI are registered with each other. This step S14 comprises: establishing a registration matrix REGMA for each image segment ISEG. The registration matrix REGMA of each image segment ISEG is specific to the image segment ISEG, since it only takes into account the anatomical features within the image segment ISEG. The registration matrix corresponds to the sum of mathematical transformations that, when applied to each image element of the reference image REFI, make the anatomical structures within the corresponding image segment ISEG consistent with the corresponding anatomical structures in the target image TI. The registration is preferably an intensity-based rigid registration. In a further step S15, a current image CI is acquired. The current image CI corresponds to a two-dimensional fluoroscopic image acquired during the same surgical intervention in which the target image TI was acquired. The current image CI typically depicts a smaller field of view than the target image TI. In other words, the field of view of the current image CI is collimated to a smaller region of interest within the imaged body region, such as where a surgical intervention occurs. The current image CI is typically acquired without the involvement of a contrast agent. In order to further reduce the contrast agent burden on the patient, the current image CI can be used as the target image TI in steps S12, S13 and S14. Most preferably, a plurality of current images CI are acquired during the surgical intervention, each current image CI depicting the latest status of the surgical procedure and / or anatomical structure. In detail, the current image CI depicts the position IPOS of (a portion of) a medical instrument, preferably the position of the catheter tip in the depicted vascular system. In another step S16, the current instrument position IPOS is detected using well-known instrument tracking technology. Preferably, the instrument is tracked using two-dimensional real-time instrument tracking technology. Since the target image TI and the current image CI are acquired using the same C-arm x-ray imaging device 1, the instrument position IPOS can be easily transferred to the target image TI and assigned to one of the at least one image segments ISEG, each of which is also assigned a specific registration matrix REGMA (see above). In the final step S17, the registration matrix REGMA assigned to the image segment ISEG in which the instrument is located in the current image CI is used to generate the result image RESI in the following manner: first, the mentioned registration matrix REGMA is applied to the reference image REFI, and then the current image CI and the reference image REFI are fused. It should be mentioned that the registration matrix REGMA can be specially established, that is, specifically for the patient's anatomical structure within the corresponding image segment ISEG.However, in step S17, the registration matrix REGMA is applied globally, i.e. to all image elements (i.e. voxels) of the reference image REFI. Therefore, the overlap or superposition of the current image CI and the transformed reference image REFI (i.e. the result image RESI) provides the user with optimal intervention guidance in the depicted image area where the surgical instrument is located. This is due to the fact that, in the image segment ISEG including the instrument position IPOS, the registration of the reference image REFI is performed using a corresponding registration matrix REGMA specifically adapted to the patient's anatomy in this image segment ISEG, wherein the registration matrix REGMA may only be suboptimally adapted to the surrounding body area. The result image RESI can be presented to the user immediately. Not only step S16 but also step S17 can be performed in real time or near real time.

[0047] Figure 2 1 shows a schematic flow chart of the method of the present invention according to another embodiment of the present invention. Basically, steps S21, S22, S23, S24, S25, S26 and S27 correspond to steps S11, S12, S13, S14, S15, S16 and S17, respectively, and can be used in conjunction with the method of the present invention according to another embodiment of the present invention. Figure 1 The same method as described is used. However, Figure 2 It further comprises an iteration loop I1 which is based on the updating of the current image CI during the surgical intervention. Figure 1 As indicated, several current images CI may be acquired during a surgical intervention. Steps S25 (acquiring a current image CI), step S26 (detecting a current position IPOS of a surgical instrument), and step S27 (generating a result image RESI using a registration matrix REGMA of the image segment ISEG in which the instrument is currently located) are continuously repeated, thereby providing updated result images RESI, each of which depicts the latest position IPOS of the surgical instrument in the context of a global anatomical overview, in particular an overview of the vascular system provided by the reference image REFI. According to Figure 1 In step S15, the current image CI first acquired in the iteration loop I1 can be used as the target image TI. Figure 2 It also includes an iteration loop I2, according to which the target image TI can be updated during the surgical intervention, in case the anatomical deviation between the current image CI or the target image TI and the reference image REFI is above a maximum acceptable predefined threshold for a useful image registration, so as to provide at least one updated registration matrix REGMA according to step S24 for each image segment ISEG. Here, the target image TI can be updated using the current image CI acquired during the surgical intervention.

[0048] In the following, the invention is again outlined to describe a use case of a neurointerventional procedure. However, it is to be noted that the invention is not limited to this particular use case, but can be applied to other surgical interventional procedures, and to different body regions (eg, abdomen or legs).

[0049] The present invention can be advantageously applied, for example, to surgical interventions, such as neurointerventions in the head, neck or spinal cord. Here, a three-dimensional diagnostic CTA / MRA reference image dataset REFI may not be used to provide adequate guidance during surgical interventions. This may be mainly due to cervical spine distortion, i.e., local anatomical deviations, which may be difficult to account for using global registration techniques. In order to overcome this obstacle, the present invention decomposes the global registration problem into multiple local registrations, such as, for example, chest region (chest image segment) registration, neck region (neck image segment) registration, and cranial region (head image segment) registration, which depends on the current position IPOS of the surgical instrument (i.e., catheter). In other words, the present invention uses the target image TI and the reference image REFI to perform an automatic and region-specific 3D / 3D registration based on an intensity-based rigid transformation, and combines it with a 2D real-time catheter tracking method. As a result, a higher registration accuracy is achieved in real time for the current C-arm position of the C-arm x-ray imaging device, and the current region of interest (i.e., the image segment ISEG where the surgical instrument is currently located), without the need for additional contrast injection and / or angiography acquisition.

[0050] First, preferably, two 3D volume datasets covering similar areas are acquired (e.g., a pre-interventional CTA depicting the vascular tree = reference image REFI, and an intra-interventional low-dose 3D non-contrasted angiography of the same patient = target image TI). Next, segmentation planes SP are defined in the target image TI to segment different anatomical segments / regions ISEG, such as: chest, neck and cranial regions, based on the common bone structures depicted in the two 3D images. This is preferably performed by user interaction to define the planes SP. For example, the user can position at least one segmentation plane aligned with the following landmarks: skull base, cervical spine, thoracic spine. Figure 4 A reference image REFI according to an embodiment of the invention is depicted, which shows at least the bone and vascular structures of the head, neck and chest of a patient. Figure 5A target image TI according to another embodiment of the present invention is depicted, which represents the same body region and likewise represents at least bone and vascular structures. In addition, in both the reference and target images REFI, TI, two segmentation planes SP are depicted, which are used to segment the head image segment from the neck image segment and further from the chest image segment. Then, for each corresponding anatomical image segment ISEG, an intensity-based automatic registration is performed, which searches for a rigid motion transformation between 3D CTA and 3D angiography, including rotation, translation, scaling. The registration accuracy can be confirmed by the user, where minor manual adjustments can be allowed. The registration matrices REGMA (here, one for each head, neck and chest image segment) are saved separately. Each registration matrix REGMA will later be applied to the complete volume (i.e., each individual image element) of the reference image REFI, but only in its corresponding image segment ISEG to ensure the highest registration accuracy. Further, an intra-interventional two-dimensional fluoroscopy of the patient is started to generate at least one initial current image CI. Preferably, the 3D reference image REFI is registered to the current 3D axis of the C-arm x-ray angiography device (as in the subsequent catheter movement from the chest to the head) using the registration matrix REGMA established for the chest image segments and then superimposed on the initial current image CI and displayed for initial interventional guidance. For example, the reference image REFI is virtually projected onto a 2D detector plane for the current geometry of the C-arm x-ray angiography system 1 (which includes the initial current image CI). A representation of the segmentation plane SP can also be projected onto the current image CI. The 3D reference image REFI can therefore and must be dynamically updated further in the process by geometric changes of the angiography system 1. Using the optical guidance provided by the virtual projection, catheterization can be started and the continuously acquired current images CI can be used to track the continuous movement of, for example, the catheter tip position IPOS. Regarding tracking, a large number of methods have been reported in the literature, such as the "Tracking Method" by BAERT, SAM et al. 血管内介入期间的导丝跟踪 血管内介入 ” (in IEEE Trans. Med. Imaging; Vol. 28, No. 8; pp. 965-972; 2003), or “ 荧光透视中的稳健导丝跟踪" (in: Proc. IEEE Comput. Vis. Pattern Recognit; pp. 691-698; 2009). The catheter tip position IPOS and the movement direction are continuously detected and recorded. As soon as the instrument position IPOS reaches or passes through the segmentation plane SP between the chest and the neck, the registration is updated in the following sense: the registration matrix REGMA of the neck image segment is activated and used to update the 3D reference image REFI and to generate a result image RESI by superimposing the transformed reference image REFI with the current image CI. As long as the catheter tip position IPOS is within the neck image segment, the registration matrix REGMA of the neck image segment is applied. As soon as the catheter tip moves again beyond the segmentation plane SP, the registration is updated again.

[0051] The present invention improves the accuracy of the registration of each current image CI to the specific region of interest where the surgical instrument is currently located, and thus enhances the efficacy of 3D guidance during interventional procedures. No additional contrast injection or X-ray exposure is required, thereby improving the clinical workflow and reducing iodinated contrast and radiation-induced side effects for the patient.

[0052] Figure 3A medical imaging device 1 according to an embodiment of the invention is depicted. The medical imaging device is a single-plane angiographic x-ray system 1 in the form of a C-arm x-ray device. The C-arm device 1 comprises a stand, which is formed as an articulated robot comprising six axes and is arranged to hold a C-arm 2. The C-arm 2 comprises an x-ray source 3 (e.g. an x-ray tube unit and a collimator) and an x-ray detector 4 at its ends, respectively. The angiographic system 1 is rotatably mounted, it can rotate around a rotation center and / or a rotation axis that is arranged in the plane of the C-arm 2 and / or passes through the plane of the C-arm 2. The angiographic system 1 itself can be mounted in a fixed or movable manner. A patient table 5 is located in the beam path of the x-ray source 3 in order to place a patient 6 to be imaged with the C-arm 1. The medical imaging device 1 according to this embodiment comprises a computing unit 7 formed as a computer. The computing unit 7 can be physically part of the C-arm device 1. The computing unit 7 is typically configured to receive and process image signals detected by the x-ray detector 4, such as the current image CI and / or the target image TI. However, the computing unit 7 is likewise configured to receive and / or load medical images from an internal or external storage unit (e.g., a storage unit 60 or a cloud storage device). The processed and / or generated images (e.g., the current image CI and / or the result image RI) can be displayed on a display screen of the monitor unit 9 for user consideration. The monitor unit 9 can include several screen monitors, in particular flat-panel screens. The computing unit 7 can alternatively be configured as an independent unit that is not physically connected to the C-arm imaging system 1. The computing unit 7 can further be connected to the output unit 48 and the input unit 50 for data exchange. The output unit 48 and the monitor unit 9 can also be implemented as only one unit. The output unit 48 may, for example, be used for a graphical display of the target image TI so as to enable manual setting of segmentation planes, and / or for a graphical display of automatically set segmentation planes within the target image TI and / or an automatically generated registration matrix, which the user can then confirm or correct using the input unit 50. The input unit 50 is therefore used for selecting / confirming and / or correcting the information presented via the output unit 48. The output unit 48 may be formed as an LCD screen, a plasma screen, or an OLED screen, which may further be a touch screen, which then also serves as the input unit 50. The input unit 50 may further be implemented as a keyboard, a mouse, a microphone or a camera for detecting and processing auditory or visual input signals provided by the user.

[0053] The computing unit 7 may be connected to the x-ray detector 4 and / or the x-ray tube 3 for data exchange, wherein the connection may be wired or wireless.

[0054] The computing unit 7 comprises an image processing unit 8. The image processing unit 8 is further subdivided into a definition unit 81, a registration unit 82, a detection unit 83 and a generation unit 84. The subunits or modules 81, 82, 83, 84 of the image processing unit 8 are configured to analyze, manipulate, process or generate x-ray images, in particular a reference image REFI, a target image TI, a current image CI and / or a result image RESI. For example, the definition unit 81 can be configured to perform object, landmark and / or texture analysis on the medical image, and to segment anatomical structures in the medical image accordingly, such as organs or tissues, in particular bones and vascular systems. The definition unit 81 is further configured to define at least one image segment ISEG, for example by defining at least one segmentation plane SP aligned to the segmented anatomical structure in the target image TI. The detection unit 83 is configured to detect surgical instruments in the current image CI. The detection unit 83 is particularly configured to follow a moving instrument position and / or a moving instrument component position IPOS, such as a catheter tip, during a surgical intervention using a plurality of consecutive current images CI. The registration unit 82 is configured to register not only the reference image REFI to the target image TI, but also to register the target image TI to the current image CI where applicable and necessary. The registration matrix is ​​particularly configured to establish individual registration matrices for individual image segments ISEG defined in the target image TI, wherein the individual registration matrices REGMA are image segment specific in the sense that each registration matrix REGMA only takes into account the anatomical structures located within the corresponding image segment ISEG. The generation unit 84 is configured to generate the result image RESI by identifying the registration matrix REGMA associated with the image segment ISEG where the surgical instrument is located, and then applying the identified registration matrix REGMA to fuse the reference image REFI and the current image CI. The calculation unit 7 also includes a storage unit 60. The storage unit 60 is used to store information about the defined position and / or orientation of the segmentation plane SP, detected landmarks, organs, tissues, structures, etc., and / or the established registration matrix REGMA, each of which is used for subsequent use during the process of the method of the present invention.

[0055] The calculation unit 7 can function in conjunction with a computer-readable medium, in particular using a computer program comprising a program code to perform the method of the invention. The computer program can be stored on a computer-readable medium. The computer-readable medium can in particular be a CD, a DVD, a Blu-ray disc, a memory stick or a hard disk. The calculation unit 7 can be implemented in the form of hardware and / or software. For example, the calculation unit 7 can be implemented as an FPGA (“field programmable gate array”), or include an arithmetic logic unit.

[0056] In this embodiment, the storage unit 60 stores at least one computer program, which, when executed on the computing unit 7, performs all steps of the method of the present invention. The computer program may include program code. The computer program may be implemented on a separate computing system. For example, the medical imaging device 1 may be configured so that the computing unit 7 loads the computer program into its internal random access memory via the Internet or an intranet for performing the steps of the method according to the present invention.

[0057] Wherever applicable, individual embodiments, their individual aspects and / or features may be combined or exchanged with one another without limiting or expanding the scope of the described invention, provided that such combination or exchange makes sense and is within the meaning of the invention. Advantages described with respect to one embodiment of the invention also benefit other embodiments of the invention where applicable.

Claims

1. A method for generating a medical result image using a current image, a target image and a reference image, all images at least partially depicting the same body region of a patient, the method comprising the following steps: i. defining at least one image segment within the target image, ii. registering the reference image with the target image by establishing a registration matrix for each image segment within the target image, wherein each registration matrix is ​​specific to a corresponding image segment, iii. detecting the position of the surgical instrument in the current image and verifying which image segment the detected position corresponds to, and iv. Generate a medical result image by applying a registration matrix assigned to an image segment corresponding to the detected position to a reference image and fusing the current image and the reference image.

2. The method according to claim 1, wherein in steps i. and ii., the current image is used as the target image.

3. The method according to claim 1, wherein during the surgical intervention, the current image is repeatedly updated, and steps iii. to iv. are repeated using the updated current image. 4 . The method according to claim 3 , wherein in steps i. and ii. a current image first acquired during the surgical intervention is used as the target image.

5. The method of claim 3, wherein during surgical intervention, steps i. and ii. are repeated to establish at least one updated registration matrix using the updated current image as the target image, wherein the at least one updated registration matrix is ​​used in step iv. to generate a medical result image.

6. The method according to claim 1 , wherein in step ii., the image segment-specific registration matrix - is established solely based on anatomical features located in the corresponding image segment, and - is applied globally to the reference image.

7. The method according to any one of claims 1 to 5, wherein steps iii. to iv. are performed in real time or near real time.

8. The method according to claim 1, wherein the image segments are defined by providing at least one segmentation plane which is oriented based on anatomical structures in the depicted body region. The method according to claim 8 , wherein the segmentation plane is manually set by a user.

10. The method according to any one of claims 1 to 5, wherein the registration of the reference image and the target image is performed using an intensity-based rigid transformation technique.

11. The method according to any one of claims 1 to 5, wherein step iii is performed using two-dimensional real-time instrument tracking technology.

12. A computing unit for generating a medical result image using a current image, a target image and a reference image, all images at least partially depicting the same body region of a patient, the computing unit comprising: a definition unit adapted to define at least one image segment within the target image, a registration unit adapted to register the reference image with the target image by establishing a registration matrix for each image segment, wherein each registration matrix is ​​specific to a respective image segment, a detection unit adapted to detect a position of the surgical instrument in the current image and to verify to which image segment the detected position corresponds, and A generating unit is adapted to generate a medical result image by applying a registration matrix assigned to the image segment corresponding to the detected position to a reference image and fusing the current image with the reference image.

13. The computing unit according to claim 12, adapted to implement the method according to any one of claims 1 to 11.

14. A medical imaging device for generating a medical result image using a current image, a target image and a reference image, comprising the calculation unit according to claim 12 or 13. 15 . A computer program product comprising a program element which, when loaded into a memory of a computing unit, causes the computing unit to execute the steps of the method according to claim 1 . 16 . A computer-readable medium having stored thereon a program element readable and executable by a computing unit, so as to carry out the steps of the method according to claim 1 when the program element is executed by the computing unit.