Image alignment with the tracking system

The medical device generates a 2D image from 3D data and aligns reference frames using landmark superimposition and algorithms, addressing alignment challenges in image-guided surgery systems, thereby improving tracking accuracy.

JP7577745B2Active Publication Date: 2024-11-05BIOSENSE WEBSTER (ISRAEL) LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2022533519
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-12-05
Filing Date
2020-11-17
Publication Date
2024-11-05
Estimated Expiration
2040-11-17

AI Technical Summary

Technical Problem

Existing image-guided surgery systems face challenges in accurately aligning tracking systems with patient images due to variations in patient anatomy, leading to difficulties in registering and superimposing instrument positions accurately, especially when using non-ionizing radiation modalities like MRI or CT.

Method used

A medical device incorporating a position tracking system, alignment tool, display screen, and processing unit generates a 2D image from 3D image data, superimposes landmarks, and aligns reference frames by maximizing correlation between tracking system coordinates and image data using algorithms like ICP or cumulative distance metrics.

Benefits of technology

Facilitates rapid and accurate alignment of tracking systems with patient images, enhancing the precision of instrument tracking during surgeries by improving the convergence and accuracy of the registration process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007577745000002
    Figure 0007577745000002
  • Figure 0007577745000003
    Figure 0007577745000003
  • Figure 0007577745000004
    Figure 0007577745000004
Patent Text Reader

Abstract

The medical device includes an alignment tool including a position sensor, and a position tracking system configured to acquire position coordinates of the sensor within a first frame of reference defined by the position tracking system. The processing unit is configured to receive 3D image data related to the patient's body within a second frame of reference, generate a 2D image of the patient's surface based on the 3D image data, render the 2D image on a display screen, and superimpose icons indicating the locations of respective landmarks on the 2D image. The processing unit receives position coordinates acquired by the position tracking system while the alignment tool is in contact with locations on the patient corresponding to the icons on the display, and aligns the first and second frames of reference by comparing the position coordinates with the three-dimensional image data.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates generally to image registration, and more particularly to images generated in different modalities that may be used for image-guided surgery. [Background technology]

[0002] In image-guided surgery, medical personnel use instruments that are tracked in real time so that the position and / or orientation of the instrument can be presented on an image of the patient's anatomy during a surgical procedure. In some cases, both tracking and imaging of the patient's anatomy can be achieved by one modality, such as fluoroscopy. However, because fluoroscopy uses ionizing radiation, its use needs to be minimized. As a result, in many scenarios, patient images are provided by one modality, such as magnetic resonance imaging (MRI) or computerized tomography (CT) fluoroscopy, and instrument tracking uses a different modality, such as magnetic tracking. Summary of the Invention [Means for solving the problem]

[0003] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The embodiments of the present invention described below provide improved methods for registering images with a tracking system, as well as systems and software for implementing such methods.

[0004] Thus, according to one embodiment of the present invention, a medical device is provided that includes an alignment tool including a position sensor and configured to contact a surface of a portion of a patient's body. The position tracking system is configured to acquire position coordinates of the position sensor in a first frame of reference defined by the position tracking system in the vicinity of the portion of the patient's body and a display screen. The device further includes a processing unit configured to receive three-dimensional (3D) image data relating to at least a portion of the patient's body in a second frame of reference, generate a two-dimensional (2D) image of the surface of the portion of the patient's body based on the 3D image data, and render the 2D image on the display screen. The processing unit is further configured to superimpose on the displayed 2D image a number of icons indicating locations of respective landmarks on the surface of the portion of the body, and align the first and second frames of reference by receiving position coordinates acquired by the position tracking system while the alignment tool contacts locations on the surface of the portion of the patient's body that correspond to the icons on the display, and comparing the position coordinates with corresponding locations in the three-dimensional image data.

[0005] In a disclosed embodiment, the position tracking system comprises a magnetic position tracking system.

[0006] In another embodiment, the three-dimensional image data includes data from a computed tomography (CT) system. Alternatively, the three-dimensional image data includes data from a magnetic resonance imaging (MRI) system.

[0007] In a further embodiment, the portion of the patient's body includes the patient's head and the 2D image shows the patient's face.

[0008] In another embodiment, aligning the first and second reference frames includes applying relative scaling, rotation, and translation between the first and second reference frames to maximize correlation between position coordinates and corresponding locations in the three-dimensional image data.

[0009] In yet another embodiment, the processing unit receives landmark locations from a user marking locations on the 2D image.

[0010] In yet another embodiment, the processing unit is configured to use the registered reference frame to track and display a location of the invasive probe inside the portion of the body.

[0011] According to an embodiment of the present invention, there is also provided a method of registering medical images, comprising: acquiring position coordinates of a position sensor in an alignment tool in a first frame of reference defined by a position tracking system in the vicinity of a portion of a patient's body when the alignment tool contacts a surface of the portion of the body; receiving three-dimensional (3D) image data relating to at least a portion of the patient's body in a second frame of reference; generating a two-dimensional (2D) image of the surface of the portion of the patient's body based on the 3D image data; and rendering the 2D image on a display screen. The method further comprises superimposing a plurality of icons on the displayed 2D image, indicating the location of respective landmarks on the surface of the portion of the body; receiving position coordinates acquired by the position tracking system while the alignment tool contacts locations on the surface of the portion of the patient's body that correspond to the icons on the display; and registering the first and second frames of reference by comparing the position coordinates with corresponding locations in the 3D image data.

[0012] The invention will be more fully understood from consideration of the following detailed description taken in conjunction with the drawings, in which: [Brief description of the drawings]

[0013] [Figure 1] 1 is a schematic, pictorial illustration of a medical device, according to one embodiment of the present invention; [Diagram 2] 4 is a schematic diagram of a user interface screen, according to one embodiment of the present invention. [Diagram 3]4 is a flow chart that illustrates a schematic diagram of a registration procedure between a 3D image and a position tracking system, according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Overview Magnetic tracking systems are used in invasive diagnostic and therapeutic procedures, such as image-guided surgery, to track instruments using pre-acquired images, such as CT images, of a portion of the patient's body undergoing the procedure. For the tracking to be effective, the reference frames of the image and the tracking system need to be registered with each other. For example, in a typical registration procedure between a CT image and a magnetic tracking system, the coordinates of a number of different anatomical points (called landmarks) are marked in the CT image, and the coordinates of the same landmarks are acquired by the tracking system. Once such pairs of coordinate points are acquired, a fitting process is applied to estimate the transformations, including scaling, rotation, and translation, that best align, i.e., register, the two sets of points. The fitting can be calculated using algorithms known in the art, such as, for example, a cumulative distance metric or an iterative closest point (ICP) algorithm.

[0015] As an example, consider a procedure that requires tracking of an instrument used on a patient's head, such as an ear, nose and throat (ENT) procedure. In such a procedure, the patient's head is aligned with the reference frame of a tracking system. An example of such an alignment procedure is provided in U.S. Patent Application Publication No. 2019 / 0046272. In the procedure described, a medical practitioner, such as a physician, positions the distal end of a probe containing a magnetic tracking sensor at a pre-set number of landmark points on the patient's skin. The landmark points correspond to pre-defined locations in a CT image. In this cited example, four initial landmark points are acquired, including a point below the tip of the patient's nose, a point on the left and right sides of the patient's face excluding the eyes, and a point between the eyes, and signals from the tracking sensor are acquired at these points.

[0016] As signals from the tracking sensors are acquired, the processor calculates their respective position coordinates in the reference frame of the magnetic assembly to generate four ordered pairs of positions, each having the form (tracking sensor position, CT position), with each pair pointing to a corresponding position. The system processor uses these four ordered pairs to generate a preliminary registration, i.e., a transformation including scale, translation and rotation parameters that align the CT coordinate system with that of the magnetic assembly.

[0017] The physician continues by positioning the distal tip of the probe on the patient's skin at additional patient-defined landmark points. Each time a signal is acquired, the processor uses the coordinates determined by the signal to update the transformation with the new locations as additions to the source cloud of points.

[0018] To define the landmark points, the system guides the physician in the alignment process by presenting a schematic image of a "generic" head on a screen viewed by the physician, with markers on the image indicating the points to be touched. However, the characteristics of a real patient may differ significantly from a generic head, making it difficult for the physician to determine where to touch the patient. In extreme cases, the differences may be too large to allow for accurate alignment.

[0019] The embodiments of the invention described herein address this problem by providing a medical device incorporating a position tracking system, an alignment tool with a position sensor, a display screen, and a processing unit. Accurate alignment between the position tracking system and the patient's 3D image is enabled by generating a true and realistic two-dimensional (2D) image of the patient's body from the 3D image data and guiding the alignment procedure based on this 2D image, rather than simply using a generic predefined image. This approach facilitates rapid convergence of the fitting process between the CT coordinate system and the tracking system, resulting in more accurate alignment than systems known in the art.

[0020] In a disclosed embodiment, the processing unit receives 3D image data of a portion of the patient's body and generates a 2D image of the surface of the portion of the patient's body based on the 3D image data. The processing unit further renders the 2D image on a display screen and overlays it on the displayed 2D image icons indicating the location of the respective landmarks on the surface of the portion of the body under guidance from the physician. The physician touches corresponding points on the patient's body, guided by these icons on the 2D image, with an alignment tool, and indicates to the processing unit which points the physician touched. The processing unit receives from these points the corresponding 3D position coordinates of the position sensor acquired by the position tracking system. Finally, the processing unit aligns the reference frame of the position tracking system with the reference frame of the 3D image data by relative translation and rotation of the two reference frames until the correlation between the 3D coordinates acquired by the position tracking system and the coordinates of the 3D image data corresponding to the icons is maximized.

[0021] System Description 1 is a schematic pictorial diagram of a medical device 10, according to one embodiment of the present invention. The device 10 is used to register a magnetic position tracking system 12 with images, which are assumed herein, by way of example, to include a computed tomography (CT) image 48 of a patient 14. The position tracking system 12 is assumed herein, by way of example, to comprise a magnetic tracking system. The Carto® system, manufactured by Biosense Webster of Irvine, Calif., uses a tracking system similar to that described herein to track the location and orientation of a distal tip of a probe inserted into or brought near a patient.

[0022] The position tracking system 12 is used to track the position and orientation of one or more instruments, such as catheters or guidewires, that are inserted into a patient 14 during a medical procedure on the patient. As described below, the position tracking system 12 can also track the position and orientation of an alignment probe 16 that is external to the patient. The probe 16 is fixedly connected to a handle 18 that may be held by a medical practitioner 20, typically a physician, during use of the system 10. The combination of the probe 16 and handle 18 form a rigid probe assembly 22 that facilitates positioning of the probe at a desired location by the physician 20.

[0023] For clarity and brevity of the following description, it is assumed that the medical procedures referred to above include invasive procedures on the paranasal sinuses of the patient 14, whereby the medical device 10 and position tracking system 12 are configured to operate in and around the region of the paranasal sinuses. However, the systems 10 and 12 may alternatively be configured to operate in and around other regions of the patient, such as the chest, kidneys, or abdomen, and one of ordinary skill in the art would be able to adapt the description herein to such other regions. Additionally, the principles of the present invention may be applied in conjunction with other types of tracking systems (not necessarily magnetic), as well as other kinds of 3D imaging modalities, such as MRI.

[0024] The tracking system 12 comprises a processing unit 26 operated by a system processor 24 and in communication with a probe tracking module 28, the functionality of which is described below. The processor 24 may be implemented in a console 30 and comprises a motion control 32, which typically comprises a pointing device such as a mouse or trackball. The physician 20 uses the motion control 32 to send commands to the system processor 24, which is further used to present data and guidance images to the physician on a display screen 34, as described below.

[0025] The system processor 24 typically comprises a programmable processor that operates the device 10 using software stored in memory of the processing unit 26. The software may be downloaded to the system processor 24 in electronic form, for example over a network, or the software may alternatively or additionally be provided and / or stored on a non-transitory tangible medium, such as magnetic, optical, or electronic memory. The system processor 24 further stores a digitized 3D CT image 48 of the head 38 of the patient 14, the CT image possibly having been acquired by a separate CT system (not shown) at a different time. The CT image 48 includes, for each point in the image, its 3D coordinates, as well as the radiographic density of the image at each point, the density being typically given in Hounsfield units.

[0026] To track the above mentioned instruments in the patient 14 as well as to track the probe 16, the processing unit 26 operates a number of magnetic field generators 36, such as coils, via cables 35 using a probe tracking module 28. In one embodiment, typically applicable when the patient 14 is anesthetized and lying on a bed 40 with the head 38 immobile, the generators 36 are fixed to a frame 42 placed on the bed beside the patient's head as shown in FIG. 1. In an alternative embodiment (not shown), applicable when the patient 14 is not anesthetized, the generators 36 are fixed relative to each other and to a frame attached to the head 38 or to a chair in the physician's office. A three-axis reference coil 41 is fixed to the head 38 and connected to the processing unit 26 by a cable 43.

[0027] The generator 36 spreads alternating magnetic fields in and around the head 38 of the patient 14, and these fields generate signals in magnetic detectors in the instrument and in the probe 16. The signals are transmitted back to the processing unit 26 and probe tracking module 28 via a cable 44 that connects the probe 16 to the console 30. Together, the processing unit and module analyze the signals to derive the location and orientation coordinates of the instrument and probe 16 relative to the generator 36. The magnetic field generator 36 thus defines a reference coordinate frame 46 for the magnetic tracking system 12.

[0028] During the registration process, the processing unit 26 accesses the 3D CT image 48 and renders it into a 2D image 50 on the display screen 34, as further detailed in the flow chart of FIG. 3. The processing unit 26 further superimposes icons 54 on selected points on the 2D image 50, typically points corresponding to anatomical landmarks on the patient's face, as further detailed in FIG. 2. The physician 20 sequentially contacts the probe 16 with the surface 52 of the patient 14 (i.e., with the patient's skin) at each point corresponding to the icons 54, and the processing unit 26 records the 3D coordinates of the probe at each of these points. Using these recorded coordinates and the coordinates of the corresponding points in the reference frame of the CT image 48, the processing unit 26 aligns the reference frame of the position tracking system 12 with the reference frame of the 3D CT image 48 by calculating a transformation including the relative scaling, rotation, and translation of the two reference frames. Typically, the transformation is found by a fitting process that maximizes the correlation between the aligned 3D coordinates of the probe and the 3D coordinates of the CT image 48 corresponding to the icon 54. To maximize the correlation, the processing unit 26 may use algorithms such as a cumulative distance metric or an iterative closest point (ICP) algorithm, as will be described in further detail with reference to FIG.

[0029] Processing unit 26 may maximize the correlation after all 3D coordinate points corresponding to all icons 54 have been collected. Alternatively, processing unit 26 may begin calculating correlations with the first few tracked and recorded points (as also described in cited U.S. Patent Application Publication No. 2019 / 0046272), and then refine the correlations with all additional recorded points. In an iterative manner, processing unit 26 may also estimate whether the 3D coordinates of each next point touched by probe 16 are close enough to the expected location, and may indicate an acceptable proximity, for example, by coloring the corresponding icon green, or an unacceptable distance, for example, by coloring the corresponding icon red.

[0030] Communication between the physician 20 and the processing unit 26 is established to indicate which point on the surface 52 is to be touched. For example, the processing unit 26 may cause an icon 54 to flash on the display screen 34, thus indicating to the physician 20 the point the physician is expected to touch. When the physician 20 touches this point, the physician indicates through the control unit 32 (e.g., by pressing a key on a keypad or clicking a mouse) that the point has been touched. Alternatively, each icon 54 may be numbered using a numeric sequence, and the physician 20 indicates through the control unit 32 which of the icons the physician has touched.

[0031] 2 is a schematic detail view of a 2D image 50 presented on the display screen 34 according to an embodiment of the present invention. The image 50 has been rendered by the processing unit 26 from a 3D CT image 48 and is therefore a true and realistic image of the face of the patient 14. To render the image 50 from the 3D CT image 48, the processing unit 26 applies an algorithm, such as the marching cubes algorithm, to the CT image. The algorithm assigns a value of one to each point of the CT image 48 that has a non-zero radiodensity in Hounsfield units, and assigns a value of zero to points that have a Hounsfield value of zero (corresponding to air). The algorithm proceeds through the image 48, taking eight adjacent locations at a time (thus forming a virtual cube) and determines the polygons required to represent a portion of a so-called isosurface that passes through this cube. (An isosurface is a surface that represents, in a linear approximation, the boundary between a value of zero and one of the cube vertices.) The individual polygons are then fused into a 3D surface that is projected onto a plane that corresponds to the plane of the display screen 34.

[0032] Processing unit 26 superimposes icons 54 on points on 2D image 50 that correspond to facial landmarks. Based on the rendering process, each icon 54 is automatically linked to a corresponding 3D coordinate in the CT reference frame. Physician 20 may define the locations of icons 54 on image 50, for example, by using control unit 32 to move a cursor on display screen 34 to suitable visible locations and then indicating these locations to processing unit 26 by clicking the mouse. In this example, physician 20 has selected these locations within areas of the face that are relatively stiff, i.e., do not compress significantly under gentle pressure from probe 16. Such areas include, for example, the forehead, the tip of the nose, and prominent cheekbones. Alternatively or additionally, the locations of some or all of icons 54 may be automatically selected by processing unit 26.

[0033] Figure 3 is a flow chart 100 that generally illustrates a registration procedure between a 3D image 48 and a position tracking system 12, according to an embodiment of the present invention. The registration procedure illustrated in flow chart 100 refers to elements shown in Figures 1-2. Alternatively, the principles of this procedure may be applied in connection with other types of 3D image and tracking systems.

[0034] The procedure begins at a start step 102. At a 3D image step 104, a 3D CT image 48 of the face of the patient 14 is received by the processing unit 26. At a rendering step 106, the processing unit 26 renders a 2D image 50 based on the 3D CT image 48, as described in relation to FIG. 2. At a registration step 108, the processing unit 26 superimposes icons 54 representing facial landmarks of the patient 14 onto the image 50. At a display step 110, the processing unit 26 displays the image 50 together with the icons 54 on the display screen 34.

[0035] In a coordinate collection start step 112, the physician 20 starts the process of collecting 3D coordinates by touching the face of the patient 14 with the probe 16. The process now enters a loop 115, which includes a touch step 114, a record step 117, a decision step 116, and a next icon step 118. In the touch step 114, the physician 20 touches the face of the patient 14 with the probe 16 at a location indicated by the icon 54. The communication between the physician 20 and the processing unit 26 is described with reference to FIG. 1 above and will not be further detailed here. The 3D coordinates of the probe 16 sensed by the position tracking system 12 are recorded by the processing unit 26 in a record step 117. After recording the 3D coordinates, the processing unit 26 determines in a decision step 116 whether further locations need to be touched. If the answer is yes, the next location (icon) is selected by the physician 20 or by the processing unit 26 as described above, and the physician touches the next location in step 114.

[0036] Once all required locations (icons) have been exhausted, the process exits from decision step 116 to calculation step 120, where processing unit 26 typically calculates the relative scaling, rotation, and translation between the two reference frames so as to maximize the correlation between the 3D coordinates recorded in recording step 117 and the 3D coordinates of 3D image 48 corresponding to icon 54.

[0037] One example of an algorithm for maximizing the correlation between two sets of 3D coordinates is provided in U.S. Patent No. 7,855,723. The correlation is maximized by iteratively updating the scaling, rotation, and translation coefficients to minimize a cumulative distance metric D, where D is defined as:

[0038]

number

[0039] Alternatively or additionally, the Iterative Closest Point (ICP) algorithm cited in the above-referenced U.S. Patent Application Publication No. 2019 / 0046272 may be used. The ICP algorithm is also based on minimizing a cumulative distance metric D, with the additional option of switching the points used for pairs of 3D points to further minimize the cumulative distance. The ICP algorithm applied in the described embodiment may include the following steps: 1. Match each 3D coordinate point of the position tracking system 12 (the point recorded in the recording step 117) to the closest 3D coordinate point of the 3D CT image 48, and the proximity of a pair of points is determined by the 3D Euclidean distance d between them. i It is determined by: 2. Estimate the combination of scaling, rotation, and translation that will minimize the cumulative distance metric D. This step also weights the points (i.e., denoting non-unity values ​​by w i ) and rejecting outliers before alignment (i.e., using a pre-set threshold i This step may include, for example, computing initial estimates of scaling, rotation, and translation over a small group of point pairs, and then iteratively refining the estimates while incorporating additional point pairs. 3. Transform the 3D coordinate points of the position tracking system 12 by using the obtained scale, rotation, and translation transformations. 4. Repeat the process back to step 1 by re-correlating the 3D coordinate points of the position tracking system 12 with the 3D coordinate points of the image 48. If the re-correlation does not reduce the RMS distance metric, accept the final transformation as the coordinate transformation between the coordinate system of the position tracking system 12 and the CT system.

[0040] Because the process of maximizing correlation may be iterative, a criterion for accepting the maximized correlation may be set, for example, by accepting the correlation as a maximum value when a subsequent step of the iteration increases the correlation (or reduces the cumulative distance metric D) by less than a predetermined threshold. Once the maximum correlation is reached, the relative rotation and translation between the two reference frames is saved as the inter-frame registration in registration step 122. The process then ends in end step 124.

[0041] In an alternative embodiment, as explained above, the correlation is calculated starting from the first few recorded 3D coordinates and the calculation step 120 is moved into a loop 115 (not shown here).

[0042] Once the registration process is complete, the physician 20 may proceed to perform an interventional procedure on the patient 14 using the system 10. To this end, the physician inserts a probe (not shown) having a position sensor at or near its distal end into the patient's head, for example into a sinus passage. The processor 24 tracks the position of the probe and registers this position with respect to the CT image using the transformation found in step 122 to provide the physician with an accurate indication of the location of the probe relative to the patient's anatomy.

[0043] It will be understood that the embodiments described above are given by way of example, and that the present invention is not limited to what is specifically shown and described herein above. Rather, the scope of the present invention includes both combinations and subcombinations of the various features described herein above, as well as variations and modifications thereof not disclosed in the prior art that would occur to one skilled in the art upon reading the foregoing description.

[0044] [Embodiment] (1) A medical device comprising: an alignment tool comprising a position sensor and configured to contact a surface of a portion of a patient's body; a position tracking system configured to acquire position coordinates of the position sensor in a first frame of reference defined by the position tracking system in the vicinity of the portion of the patient's body; A display screen; A processing unit comprising: receiving three-dimensional (3D) image data relating to at least the portion of the body of the patient in a second frame of reference; generating a two-dimensional (2D) image of the surface of the portion of the patient's body based on the 3D image data; rendering the 2D image on the display screen; and superimposing on the displayed 2D image a plurality of icons indicating locations of respective landmarks on the surface of the portion of the body; receiving the position coordinates acquired by the position tracking system while the alignment tool is in contact with the location on the surface of the portion of the patient's body that corresponds to the icon on the display; aligning the first and second frames of reference by comparing the position coordinates with the corresponding locations in the three-dimensional image data; a processing unit configured to: A medical device comprising: (2) The medical device of embodiment 1, wherein the position tracking system comprises a magnetic position tracking system. (3) The medical device of embodiment 1, wherein the three-dimensional image data includes data from a computed tomography (CT) system. (4) The medical device of embodiment 1, wherein the three-dimensional image data includes data from a magnetic resonance imaging (MRI) system. (5) The medical device of embodiment 1, wherein the portion of the patient's body includes the patient's head and the 2D image shows the patient's face.

[0045] (6) The medical device of embodiment 1, wherein aligning the first reference frame and the second reference frame includes applying relative scaling, rotation, and translation between the first reference frame and the second reference frame so as to maximize correlation between the position coordinates and the corresponding location within the three-dimensional image data. (7) The medical device of embodiment 1, wherein the processing unit receives the landmark location from a user marking the location on the 2D image. (8) The device of any one of embodiments 1 to 7, wherein the processing unit is configured to use the aligned reference frame to track and display the location of an invasive probe inside the portion of the body. (9) A method for registering medical images, said method comprising: acquiring position coordinates of a position sensor in an alignment tool within a first frame of reference defined by a position tracking system in the vicinity of a portion of a patient's body when the alignment tool contacts a surface of the portion of the body; receiving three-dimensional (3D) image data relating to at least the portion of the body of the patient in a second frame of reference; generating a two-dimensional (2D) image of the surface of the portion of the patient's body based on the 3D image data; rendering said 2D image on a display screen; superimposing on the displayed 2D image a plurality of icons indicating locations of respective landmarks on the surface of the portion of the body; receiving the position coordinates acquired by the position tracking system while the alignment tool is in contact with the location on the surface of the portion of the patient's body that corresponds to the icon on the display; aligning the first and second frames of reference by comparing the position coordinates with the corresponding locations in the three-dimensional image data; A method comprising: (10) The method of claim 9, wherein the position tracking system comprises a magnetic position tracking system.

[0046] (11) The method of embodiment 9, wherein receiving the 3D image data includes receiving a computed tomography (CT) image. (12) The method of embodiment 9, wherein receiving the 3D image data includes magnetic resonance imaging (MRI) data. (13) The method of embodiment 9, wherein the portion of the patient's body includes the patient's head and generating the 2D image includes generating a 2D image of the patient's face. (14) A method according to any of embodiments 9 to 13, wherein aligning the first reference frame and the second reference frame includes applying relative scaling, rotation, and translation between the first reference frame and the second reference frame so as to maximize correlation between the position coordinates and the corresponding location within the three-dimensional image data. (15) A method according to any one of embodiments 9 to 13, wherein overlaying the icon includes receiving the landmark location from a user marking the location on the 2D image.

[0047] (16) A method according to any of embodiments 9 to 13, comprising using the aligned reference frame to track and display a location of an invasive probe inside the portion of the body.

Claims

1. 1. A medical device, comprising: an alignment tool comprising a position sensor and configured to contact a surface of a portion of a patient's body; a position tracking system configured to acquire position coordinates of the position sensor in a first frame of reference defined by the position tracking system in the vicinity of the portion of the patient's body; A display screen; A processing unit comprising: receiving three-dimensional (3D) image data relating to at least the portion of the body of the patient in a second frame of reference; generating a two-dimensional (2D) image of the surface of the portion of the patient's body based on the 3D image data; rendering the 2D image on the display screen; and superimposing on the rendered 2D image a plurality of icons indicating locations of respective landmarks on the surface of the portion of the body; receiving the position coordinates acquired by the position tracking system while the alignment tool is in contact with the location on the surface of the portion of the patient's body that corresponds to the icon on the display; aligning the first and second frames of reference by comparing the position coordinates with the corresponding locations in the three-dimensional image data; a processing unit configured to: A medical device comprising:

2. The medical device of claim 1 , wherein the position tracking system comprises a magnetic position tracking system.

3. The medical device of claim 1 , wherein the three-dimensional image data comprises data from a computed tomography (CT) system.

4. The medical device of claim 1 , wherein the three-dimensional image data comprises data from a magnetic resonance imaging (MRI) system.

5. The medical apparatus of claim 1 , wherein the portion of the patient's body includes the patient's head and the 2D image shows the patient's face.

6. 2. The medical device of claim 1, wherein aligning the first and second reference frames includes applying relative scaling, rotation, and translation between the first and second reference frames to maximize correlation between the position coordinates and the corresponding locations within the three-dimensional image data.

7. The medical device of claim 1 , wherein the processing unit receives the location of the landmark from a user marking the location on the 2D image.

8. The medical device of any one of claims 1 to 7, wherein the processing unit is configured to use the aligned reference frame to track and display a location of an invasive probe inside the portion of the body.

9. A method for operating a position tracking system having a processing unit, the method comprising: acquiring, by the processing unit, position coordinates of a position sensor in an alignment tool within a first reference frame defined by the position tracking system, in the vicinity of a portion of a patient's body, when the alignment tool contacts a surface of the portion of the body; receiving, by the processing unit, three-dimensional (3D) image data relating to at least the portion of the body of the patient in a second frame of reference; generating a two-dimensional (2D) image of the surface of the portion of the patient's body based on the 3D image data; the processing unit rendering the 2D image on a display screen; the processing unit overlaying on the rendered 2D image a plurality of icons indicating locations of respective landmarks on the surface of the portion of the body; receiving, by the processing unit, the position coordinates acquired by the position tracking system while the alignment tool is in contact with the location on the surface of the portion of the patient's body that corresponds to the icon on the display; the processing unit aligning the first and second frames of reference by comparing the position coordinates with the corresponding locations in the three-dimensional image data; A method of operating a position tracking system, comprising:

10. The method of claim 9 , wherein the position tracking system comprises a magnetic position tracking system.

11. A method of operating the position tracking system of claim 9, wherein the processing unit receiving the 3D image data includes the processing unit receiving a computed tomography (CT) image.

12. A method of operating the position tracking system of claim 9, wherein the processing unit receiving the 3D image data includes the processing unit receiving magnetic resonance imaging (MRI) data.

13. 10. The method of claim 9, wherein the portion of the patient's body includes the patient's head, and wherein the processing unit generating the 2D image includes the processing unit generating a 2D image of the patient's face.

14. A method of operating a position tracking system as described in any one of claims 9 to 13, wherein aligning the first and second reference frames by the processing unit includes applying relative scaling, rotation, and translation between the first and second reference frames such that the processing unit maximizes correlation between the position coordinates and the corresponding locations within the three-dimensional image data.

15. A method of operating a location tracking system as described in any one of claims 9 to 13, wherein the processing unit overlaying the icon includes the processing unit receiving the location of the landmark from a user marking the location on the 2D image.

16. A method of operating a position tracking system as described in any one of claims 9 to 13, comprising the processing unit using the aligned reference frame to track and display a location of an invasive probe inside the portion of the body.

Citation Information

Patent Citations

  • Apparatus and method for image guided surgery

    EP1173105B1

  • Ent bone distance color coded face maps

    JP2019107451A