Techniques for generating image of anatomical element in pose indicated by planning data
By generating images based on medical image data and planning data, using the orientation of the planned position and the image plane alignment, the problem in the prior art is solved that it is difficult to determine the posture of the medical image without segmenting the anatomical element in the medical image, and realizes the surgical planning pose orientation and image accuracy.
Patent Information
- Application Number
- CN202410564416.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-10
- Filing Date
- 2024-05-08
- Publication Date
- 2024-11-12
AI Technical Summary
The prior art is difficult to determine the posture of the anatomical element in medical images without segmenting the anatomical element, especially in surgical planning, and it is difficult to orient the anatomical element of the patient's body into a predefined posture, such as the spinous process of the vertebrae extending vertically upward.
By generating images based on medical image data and planning data, the posture of the anatomical element is defined using at least three planned positions to be in a predefined posture in the image without segmenting the anatomical element, using the orientation of the planned position and the image plane to align with the image plane Generate an image.
It realizes the determination of the posture in medical images without segmenting the anatomical elements, simplifies surgical planning, improves image accuracy and efficiency, and ensures the correct orientation and placement of medical implants.
Smart Images

Figure CN118924313A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure generally relates to a method, system, computer program, and carrier medium for generating an image including a representation of an anatomical element of a patient's body. Background Art
[0002] Medical image data of a patient (e.g., X-ray image data, magnetic resonance (MR) image data, or computed tomography (CT) image data) can be used to plan a surgical procedure. For example, before performing a surgical procedure, a surgeon can plan the placement of medical implants such as bone screws, bone plates, spinal cages, pedicle screws, etc. relative to the patient's body based on preoperative medical image data of the patient's body. During a later stage, a user may wish to be provided with an image representing a portion of the patient's body (and optionally the planned implant).
[0003] It may be desirable for the portion of the patient's body to have a predefined pose in the image. For example, in the field of spinal surgery, surgeons are primarily interested in images in which the vertebrae of the patient's body are displayed with the spinous processes extending vertically upward. In some solutions, an image including the vertebrae may be provided, and the user may change the rotation of the image to orient the vertebrae to a predefined pose. Other solutions rely on complex segmentation algorithms to determine the orientation of a specific portion of the patient's body represented in the medical image data. Summary of the invention
[0004] What is needed is a technique that addresses one or more of the above problems or other problems.
[0005] According to a first aspect, a method for generating an image including a representation of an anatomical element of a patient's body is provided. The method is performed by a computing system. The method may be referred to as a computer-implemented method or a data processing method. The method does not include a surgical step.
[0006] The method comprises obtaining medical image data of at least one anatomical element of a patient's body. The medical image data may be preoperative medical image data. The medical image data may comprise, or consist of, X-ray image data, magnetic resonance (MR) image data, or computed tomography (CT) image data.
[0007] The method further comprises obtaining planning data.The planning data may be part of a data set comprising both medical image data and planning data.
[0008] The planning data indicates at least three planned positions associated with at least one anatomical element. One or more (e.g., all) of the (e.g., at least three) planned positions are associated with at least one planned medical implant. One or more (e.g., all) of the at least three planned positions can be associated with at least one anatomical element by being associated with one or more medical implants to be implanted (e.g., according to the planning data) into the at least one anatomical element and / or to be attached to the at least one anatomical element (e.g., according to the planning data) and / or to be placed in contact with the at least one anatomical element (e.g., according to the planning data).
[0009] The method also includes generating an image based on the medical image data and the planning data, the image including a representation (e.g., a depiction or rendering) of at least one anatomical element in a pose (e.g., at least one of a position and an orientation) defined by at least three planning positions. The pose can be referred to as an alignment of the at least one anatomical element relative to a coordinate system of the generated image (e.g., relative to vertical and / or horizontal image axes of the generated image). The pose can be determined without segmenting the at least one anatomical element. The pose of the at least one anatomical element can be defined solely by the planning positions associated with the anatomical element, or determined solely based on the planning positions associated with the anatomical element.
[0010] The image may be generated such that two or more of the at least three planned positions are located in a same (eg, virtual or cross-sectional) plane corresponding to or parallel to an image plane of the generated image.
[0011] Two or more planning positions can be associated with the same planning medical implant. At least two planning positions in the planning positions associated with the same planning medical implant can be located on a straight line that defines the orientation (e.g., in at least two dimensions or in three dimensions) of the same planning medical implant. The straight line can correspond to the longitudinal axis, axis of symmetry and / or insertion trajectory of the same planning medical implant.
[0012] At least three of the planned positions associated with the same planning medical implant can be located in a plane that limits the orientation (e.g., in at least two dimensions or in three dimensions) of the same planning medical implant. The plane can correspond to the outer surface portion of the same planning medical implant, the center plane of the same planning medical implant, the symmetry plane of the same medical implant, and / or the contact surface of the same planning medical implant. The plane comprising at least three planned positions associated with the same planning medical implant can correspond to or be parallel to the image plane.
[0013] The image can be generated by orienting (e.g., rotating or aligning) or including (e.g., generating or projecting) a representation of at least one anatomical element so that (i) an angle between a line (e.g., a straight line) indicating the orientation of the same planned medical implant and (ii) a vertical or horizontal image axis of the generated image satisfies at least one predefined criterion. The at least one predefined criterion can be that the angle is within a predefined range.
[0014] The image can be generated so that multiple (e.g., all) planned positions associated with the same planned medical implant are located in a same plane corresponding to or parallel to the image plane of the generated image. The same plane can include multiple (e.g., all) planned positions associated with the same planned medical implant.
[0015] The at least three planned positions may include at least two pairs of planned positions, each pair of planned positions being associated with a different planned medical implant.
[0016] The planned positions in each pair of planned positions can be located on a (e.g., corresponding) straight line defining the orientation of the planned medical implant associated with the pair of planned positions. The straight line can correspond to a longitudinal axis, an axis of symmetry and / or an insertion trajectory of the planned medical implant associated with the pair of planned positions.
[0017] The image may be generated such that the planned positions of the at least two pairs (e.g., at least two of all pairs) of planned positions are located in a same plane corresponding to or parallel to an image plane of the generated image. The image plane may include the planned positions of the at least two pairs of planned positions.
[0018] The image can be generated by orienting (e.g., rotating or aligning) or including a representation of at least one anatomical element so that (i) an angle bisector that bisects an angle between lines (e.g., straight lines) indicating orientations of different medical implants and (ii) an angle between a vertical or horizontal image axis of the generated image satisfies at least one predefined condition. The at least one predefined condition can be different from or correspond to at least one predefined criterion.
[0019] The medical image data may include volumetric image data. The image may be generated as a two-dimensional image representing a cross-section (e.g., along an image plane) of the volumetric image data. The generated image may include a representation (e.g., an outline thereof) of at least a portion of at least one planned medical implant (e.g., intersecting the image plane) (e.g., each of which).
[0020] The medical implant may include at least one component selected from: (i) a spinal cage, (ii) a bone screw such as a pedicle screw, (iii) a pedicle fixation hook, and (iv) a pedicle fixation band. The at least one anatomical element may include a bone such as a vertebra.
[0021] The method may further comprise storing the generated image.The method may further comprise triggering display of the generated image.
[0022] The method may also include obtaining a user input indicating a selected anatomical element of the at least one anatomical element. The user input may correspond to a tracking gesture of a surgical instrument or a pointer.
[0023] The image may be generated based on (eg, only) at least three planned positions associated with (eg, only) the selected anatomical element.
[0024] For each of two or more of the at least one anatomical element, a corresponding image may be generated. Each of the images may be generated based on the medical image data and the planned positions associated with the corresponding anatomical element. Multiple images (e.g., corresponding images) may be generated based on the medical image data and the planning data (e.g., in the step of generating the images or by repeating the step of generating the images), each image being generated based on at least three of the planned positions associated with the same corresponding anatomical element. Display of only images generated based on at least three of the planned positions associated with the selected anatomical element may be triggered.
[0025] The method may include updating the image to be displayed depending on the user input. For example, display of a first generated image including a representation of a first vertebra may be triggered based on a first tracked gesture of a pointer or surgical instrument as user input. Subsequently, display of a second generated image including a representation of a different, second vertebra may be triggered based on a different, second gesture of a pointer of the surgical instrument as user input.
[0026] According to a second aspect, a system is provided. The system comprises at least one processor and may therefore generally be referred to as a processing system. The at least one processor is configured to perform the method according to the first aspect.
[0027] The system may also include at least one of the following components: a medical image acquisition unit configured to generate medical image data; a user input device configured to acquire user input (for example, defining one or more planned positions of at least three planned positions and / or indicating a subset of planned positions and / or indicating a selected anatomical element of at least one anatomical element); and a display unit configured to at least display the generated image.
[0028] According to a third aspect, a computer program is provided. The computer program comprises instructions which, when executed on at least one processor (e.g., at least one processor of the system according to the second aspect), cause the at least one processor to perform a method according to the first aspect. The computer program may be stored on or carried by a carrier medium. The carrier may be one of an electrical signal, an optical signal, a radio signal, or a (e.g., non-transitory) computer-readable storage medium.
[0029] According to a fourth aspect, a storage medium is provided. The storage medium may be a non-transitory computer storage medium. The storage medium stores the computer program according to the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] Other details, advantages and aspects of the present disclosure will become apparent from the following embodiments in conjunction with the accompanying drawings, in which:
[0031] Figure 1 A schematic diagram of a system according to the present disclosure is shown;
[0032] Figure 2 A flow chart of a method according to the present disclosure is shown;
[0033] Figure 3 A rendering based on exemplary medical image data and an indication of two planned medical implants are shown;
[0034] Figure 4 Shows Figure 3 Rendering and flat indications;
[0035] Figure 5 Shown along Figure 4 a cross-sectional image of the shown plane and an indication of the contours of the two planned medical implants;
[0036] Figure 6 Shows Figure 5 Cross-sectional images and indication of angle bisectors;
[0037] Figure 7 Shows Figure 6 Cross-sectional images based on angle bisector rotation;
[0038] Figure 8 shows a spinal cage as a medical implant intended to be placed between two adjacent vertebrae; and
[0039] Figures 9a to 9c A spinal sling and a spinal clamp are shown as planned medical implants to be attached to the vertebrae. DETAILED DESCRIPTION
[0040] In the following description, exemplary embodiments will be explained with reference to the accompanying drawings. The same reference numerals will be used to represent the same or similar structural features.
[0041] Figure 1 A schematic diagram of a system 100 according to the present disclosure is shown. The system 100 includes a computing unit 2, which includes at least one processor 4 communicatively connected to at least one memory 6, and at least one wired and / or wireless interface 8. The system 100 or computing unit 2 can generally be referred to as a "computing system". The various components of the computing unit 2 can also be part of a cloud computing platform, for example as a virtual function. The computing unit 2 can be part of a surgical navigation system.
[0042] The system 100 also includes a display unit 10, a server or data storage device 12, a tracking unit 14, and a medical image acquisition unit 16, each of which is coupled to the computing unit 2 via a wired or wireless connection. The display unit 10 can be mounted on a stand in an operating room or be part of a head-mounted augmented reality display device. The data storage device 12 can be part of a hospital's picture archiving and communication system (PACS) and can store medical image data such as X-ray images, CT image data, and / or MR image data. The tracking unit 14 can include a (e.g., stereo) camera or an electromagnetic field generator, and can be configured to track (e.g., locate) a user and / or instrument 18 (e.g., including a tracking marker) located in the field of view of the tracking unit 14. The tracking unit 14 can be configured to track a patient marker 20 having a fixed spatial relationship with a patient's body 22. This can allow the computing unit 2 to determine the relative posture between the tracked instrument 18 and the patient's body 22. The medical image acquisition unit 16 can be a fluoroscopic imaging device, a C-arm scanner, or an MR scanner, and can be configured to acquire or generate medical image data of at least a portion of the patient's body 22. The display 10 may be configured as a touch screen to obtain user input. User input may also be obtained via the tracking unit 14, for example based on the tracked posture of the instrument 18. The patient body 22 includes a plurality of anatomical elements 24, for example bones such as vertebrae.
[0043] Figure 2 A flow chart of a method according to the present disclosure is shown. The method may be performed by the system 100, for example, by at least one processor 4. The at least one memory 6 (e.g., configured as a non-transitory computer storage medium) may store a computer program including instructions that, when executed by at least one processor 4, cause the at least one processor 4 to perform the method described herein.
[0044] Figure 2 The illustrated method is a method for generating an image including a representation of an anatomical element 24 of a patient's body 22 .
[0045] The method includes a step 202 of obtaining medical image data of (eg, including) at least one anatomical element 24 of a patient's body 22 .
[0046] The medical image data may be preoperative medical image data. The medical image data may be referred to as (e.g., preoperative) patient image data. The medical image data may include or consist of X-ray image data, magnetic resonance (MR) image data, or computed tomography (CT) image data. The medical image data may include or consist of two-dimensional and / or three-dimensional image data. The medical image data may include or consist of volumetric image data.
[0047] At least one anatomical element 24 may include a limb, a bone, or an organ. Each of the at least one anatomical element 24 may have the same physical and / or biological properties. The physical properties may include one or more of the following: transmittance (e.g., for radiation used in generating medical image data), absorptivity (e.g., for radiation used in generating medical image data), water or hydrogen concentration. The biological properties may include one or more of the following: type of biological material (e.g., bone, tissue, or body fluid), type of tissue (e.g., neural tissue or muscle tissue), or biological function (e.g., vascular function or lymphatic function). In one variation, each of the at least one anatomical element 24 may include or may be a bone, e.g., a vertebra.
[0048] The medical image data may be obtained from a medical image acquisition unit 16 (eg, a C-arm scanner, an MR scanner, or an X-ray device). The medical image data may be obtained from a storage unit 12, which may be part of a PACS. Alternatively, the medical image data may be obtained from a portable storage device.
[0049] The method further comprises a step 204 of obtaining planning data.
[0050] The planning data may be obtained from at least one memory 6, a data storage device 12, a PACS system and / or from a portable storage unit. The planning data may be part of a data set comprising both medical image data and planning data. Thus, the step 202 of obtaining medical image data and the step 204 of obtaining planning data may be performed in concert. Figure 2 In comparison, the order of step 202 and step 204 may also be changed.
[0051] The planning data indicates at least three planned (eg, spatial, two-dimensional or three-dimensional) positions 25 associated with at least one anatomical element 24 .
[0052] At least three planned positions 25 can be associated with at least one anatomical element 24 by being located on or within at least one anatomical element 24, by being at a distance from at least one anatomical element 24 that is less than a predetermined maximum distance, and / or by being virtually linked to at least one anatomical element 24, the virtual link (e.g., a label) being indicated by the medical image data and / or the planning data.
[0053] One or more (eg, all) of the (eg, at least three) planned positions 25 are associated with at least one planned medical implant 26 .
[0054] In general, one or more (e.g., all) of the at least three planned positions 25 may be associated with at least one anatomical element 24 by being associated with one or more medical implants 26 to be implanted into the at least one anatomical element 24 (e.g., according to planning data) and / or attached to the at least one anatomical element 24 (e.g., according to planning data) and / or placed in contact with the at least one anatomical element 24 (e.g., according to planning data). The planned positions 25 associated with the medical implant 26 may be located on the medical implant 26, for example, at the distal end or proximal end or tip of the medical implant 26. Alternatively or additionally, the planned positions 25 associated with the medical implant 26 may be located on an axis or plane (e.g., a longitudinal axis, an axis of symmetry, a planar contact surface, or a plane of symmetry) defined by the medical implant 26.
[0055] The at least three planned positions 25 may be defined in an image coordinate system of the medical image data, or may be defined in a planning coordinate system having a known correlation with the image coordinate system. The known correlation may be referred to as a registration, and / or may be defined by a transformation (e.g., including rotational and / or translational components) between the two coordinate systems. The at least three planned positions 25 may include a plurality of subsets of the planned positions 25, each subset including three or more planned positions 25, and associated with different anatomical elements 24 of the at least one anatomical element 24.
[0056] The method also includes a step 208 of generating an image based on the medical image data and the planning data, the image including a representation (e.g., depiction or rendering) of at least one anatomical element 24 in a pose (e.g., at least one of a position and an orientation) defined by at least three planning positions 25.
[0057] The image may include an exact representation of the at least one anatomical element 24 or a representation of only one of the at least one anatomical element 24. The pose may be referred to as an alignment of the at least one anatomical element 24 relative to a coordinate system of the generated image (e.g., relative to vertical and / or horizontal image axes of the generated image). The pose may be determined without segmenting the at least one anatomical element 24. The pose of the at least one anatomical element may be defined exclusively or only by at least three planned positions 25 associated with the at least one anatomical element represented or depicted in the generated image.
[0058] The image may be generated such that two or more of the at least three planned positions 25 are located in the same (e.g., virtual) plane corresponding to or parallel to an image plane of the generated image. The image plane may correspond to a plane into which one or more objects (e.g., at least one anatomical element 24 and / or medical implant 26) are projected.
[0059] Two or more planned positions 25 may be associated with the same planned medical implant 26 .
[0060] At least two of the planned positions 25 associated with the same planned medical implant 26 may be located on a straight line defining an orientation (e.g., in at least two dimensions or in three dimensions) of the same planned medical implant 26. The straight line may correspond to a longitudinal axis, an axis of symmetry, and / or an insertion trajectory of the same planned medical implant 26. The orientation of the same planned medical implant defined by the straight line may correspond to a longitudinal orientation, a principal axis orientation, an axis of symmetry orientation, and / or an implantation direction.
[0061] At least three of the planned positions 25 associated with the same planned medical implant 26 may be located in a plane that defines an orientation (e.g., in at least two dimensions or in three dimensions) of the same planned medical implant 26. The plane may correspond to or be parallel to an outer surface portion of the same planned medical implant 26, a center plane of the same planned medical implant 26, a symmetry plane of the same medical implant, and / or a contact surface of the same planned medical implant 26. The orientation of the same planned medical implant 26 defined by the plane may correspond to an (e.g., angular or rotational) alignment or direction of the same medical implant 26 (e.g., its plane).
[0062] The image can be generated by orienting (e.g., rotating or aligning) or including (e.g., generating or projecting) a representation of at least one anatomical element 24 so that (i) a line (e.g., a straight line) indicating the orientation of the same planned medical implant 26 and (ii) an angle between the vertical or horizontal image axis of the generated image meets at least one predefined criterion. The at least one predefined criterion can be that the angle falls within a predefined range and / or is less than a predefined maximum angle (e.g., an angle of 10°, 8°, 5°, 2°, 1.5°, or 1°). The at least one predefined criterion can be that the angle is minimized and / or is zero. This can produce a generated image in which the planned medical implant has a desired orientation relative to the vertical and horizontal image axes, and the image can also depict the associated at least one anatomical element in a desired posture.
[0063] The image may be generated such that a plurality (e.g., all) of the planned positions 25 associated with the same planned medical implant 26 are located in the same plane corresponding to or parallel to the image plane of the generated image. The image plane may include a plurality (e.g., all) of the planned positions associated with the same planned medical implant.
[0064] At least three planned positions 25 may include at least two pairs of planned positions 25, each pair of planned positions 25 being associated with different planned medical implants 26. The planned positions 25 in each pair of planned positions 25 may be located on a (e.g., corresponding) straight line defining the orientation of the planned medical implant 26 associated with the pair of planned positions. The straight line may correspond to the longitudinal axis, axis of symmetry and / or insertion trajectory of the planned medical implant 26 associated with the pair of planned positions. The image may be generated so that the planned positions 25 in at least two pairs (e.g., at least two pairs of all pairs) of planned positions 25 are located in the same image plane of the generated image. The image plane may include the planned positions 25 in at least two pairs of planned positions 25.
[0065] The image can be generated by orienting (e.g., rotating or aligning) or including a representation of at least one anatomical element 24 so that (i) an angle bisector that bisects the angle between lines (e.g., straight lines) indicating the orientations of different medical implants 26 and (ii) an angle between the vertical or horizontal image axes of the generated image satisfies at least one predefined condition. The at least one predefined condition can be that the angle is less than a predefined maximum angle (e.g., an angle of 10°, 8°, 5°, 2°, 1.5°, or 1°). The at least one predefined condition can be that the angle is minimized and / or is zero. The at least one predefined condition can be different from or correspond to at least one predefined criterion. Instead of an angle bisector, an alignment line can be used, which is determined so that the distance between the alignment line and the planned position (optionally weighted with a corresponding priority value) is minimized. It can be said that the alignment line may be close to the planned position. Both methods can produce images in which multiple planned implants have a desired posture relative to the vertical and horizontal image axes, which can also depict the associated at least one anatomical element in the desired posture.
[0066] The medical image data may include volumetric image data. The image may be generated as a two-dimensional image representing a cross-section (e.g., along an image plane) of the volumetric image data. The image may be generated as a rendering representing a (e.g., virtual) plane extending through a patient's body. The image may be a digitally rendered radiograph (DRR).
[0067] The generated image may include a representation (e.g., an outline) of at least a portion (e.g., each of) at least one planned medical implant 26. The generated image may include a representation of a portion of at least one planned medical implant 26 that intersects the image plane. The generated image may include an indication of an intersection area or intersection outline of at least one planned medical implant 26 (e.g., each of) with the image plane.
[0068] The medical implant 26 may include at least one component selected from: (i) a spinal cage, (ii) a bone screw such as a pedicle screw, (iii) a pedicle fixation hook, and (iv) a pedicle fixation band or pedicle fixation sling. At least one anatomical element 24 may include a bone such as a vertebra.
[0069] The method may further include storing the generated image. The generated image may be stored in at least one memory 6, a data storage unit 12, or another storage device. The method may include sending the generated image to a receiver (e.g., a PACS system, a server, or a user device such as a mobile phone).
[0070] The method may further comprise an optional step of triggering display of the generated image 210. Display of the image may be triggered on a display unit 10 such as a screen, an augmented reality (AR) display, a head mounted (eg augmented reality) display (HMD) or a tablet computer.
[0071] The method may also include an optional step 206 of obtaining a user input indicating a selected anatomical element of at least one anatomical element. The user input may be obtained from a user interface (e.g., a touch screen, a computer mouse, a joystick, a keyboard, or a microphone). The user interface may be part of the display unit 10 or implemented with the tracking unit 14. That is, the user input may be obtained from the tracking unit 14. The user input may correspond to a tracking gesture of an instrument or pointer 18. For example, a user may use the pointer 18 to point to an anatomical element 24 to select the anatomical element 24. As another example, a user may orient a tracker instrument or pointer 18 to a gesture associated with one of the planned medical implants (e.g., a gesture aligned with the planned insertion trajectory of a pedicle screw) to select an anatomical element 24 associated with one of the planned medical implants 26.
[0072] The image may be generated based on (eg, only) at least three planned positions 25 associated with (eg, only) the selected anatomical element 24. That is, when generating the image, planned positions associated with other anatomical elements 24 may be ignored.
[0073] For each of two or more anatomical elements 24 of the at least one anatomical element 24, a corresponding image may be generated. Each of these images may be generated based on medical image data and a planned position 25 associated with the corresponding anatomical element 24. A plurality of images (e.g., corresponding images) may be generated based on the medical image data and the planning data (e.g., in the step of generating the images or by repeating the step of generating the images), wherein each image may be generated based on at least three of the planned positions 25 associated with the same corresponding anatomical element 24. Only images generated based on at least three of the planned positions 25 associated with the selected anatomical element 24 may be triggered for display. That is, the selection of an anatomical element 24 may not only result in triggering the display of the corresponding image, but may also result in the selection of one of the plurality of generated images that is triggered for display.
[0074] The method may include updating (e.g., being triggered) a displayed image depending on a user input (e.g., obtained in step 210). For example, display of a first generated image including a representation of a first vertebra may be triggered in step 210 based on a first tracked pose of a pointer or surgical instrument obtained as user input in step 206. Subsequently, display of a second generated image including a representation of a different, second vertebra may be triggered in a subsequent iteration of step 210 (e.g., in a subsequent iteration of step 206) based on a different, second pose of a pointer of the surgical instrument obtained as user input at a later point in time.
[0075] Now refer to Figures 3 to 7 , the method is explained based on a specific example.
[0076] Figure 3 A rendering of medical image data of a portion of a patient's body 22 (in this case, a portion of the patient's spine) is shown. The medical image data in this example is preoperative CT image data acquired from a CT scanner, and the rendering represents a view in the anterior-posterior direction. It can be said that Figure 3 The rendered image plane shown corresponds to the coronal or frontal plane. Figure 3 In the example of , the medical image data covers a plurality of vertebrae of a patient's body 22 as anatomical elements 24 .
[0077] Figure 3 Pre-planned positions 25a to 25d are also shown. Pre-planned positions 25a, 25b are associated with a first planned pedicle screw 26a as a first medical implant, and pre-planned positions 25c, 25d are associated with a second planned pedicle screw 26b as a second medical implant. Both implants 26a, 26b are planned to be implanted in the same vertebra 24. It can therefore be said that both implants 26a, 26b are associated with the same vertebra 24, and that pre-planned positions 25a to 25d are also associated with the same vertebra 24. Figure 3 In the example of , the planned position 25a corresponds to the head of the planned pedicle screw 26a, and the planned position 25b corresponds to the tip of the same pedicle screw 26a. Therefore, both positions 25a, 25b are located on the central longitudinal screw axis of the pedicle screw 26a. The same applies to the planned positions 25c, 25d located on the central axis of the pedicle screw 26b. The positions 25a, 25b form a first pair, and the positions 25c, 25d form a second pair.
[0078] Figure 4 Shows Figure 3 Rendering and indication of plane 28. Plane 28 is defined by pre-planned positions 25a to 25d. In the example shown, all pre-planned positions 25a to 25d are located within plane 28.
[0079] In order to define the plane 28, at least three pre-planned positions 25 may be required. In the case where two medical implants 26a, 26b are not located in the same plane, two pre-planned positions (e.g., 25a, 25b) of one of the implants (e.g., 26a) can be used together with one of the pre-planned positions (e.g., 25c) of the other (e.g., 26b) of the implant. Alternatively, two pre-planned positions associated with the same medical implant 26 can be used in combination with an additional pre-planned position 25, which is associated with an anatomical element 24, which is associated with the same medical implant 26. That is, all pre-planned positions for defining the plane 28 can be associated with the same anatomical element 24, and may or may not be associated with the medical implant 26. The one additional pre-planned position 25 can correspond to a planning point located on an anatomical landmark (e.g., a point on the spinous process of the vertebra to be implanted with the same medical implant 26), or to a point located on a planning trajectory. Other combinations of pre-planned positions are also possible. Alternatively, the plane 28 may be defined so that none of the pre-planned positions 25 or only some of the pre-planned positions 25 are located within the plane 28. For example, the plane 28 may be defined so that all pre-planned positions have a similar distance thereto. The positions may be associated with priority values and distances from the plane 28 that depend on these priority values. Other variations for determining the plane 28 are also possible.
[0080] Plane 28 defines a cross section through the volumetric CT image data of patient body 22 and corresponds to an image plane of an image to be generated. Figure 5 A DRR generated based on CT image data using plane 28 as the image plane is shown. In this example, both pedicle screws 26a, 26b and all pre-planned positions 25a to 25d associated therewith are located within the image plane. Figure 5 Also shown are the profiles 27a, 27b of the pedicle screws 26a, 26b, which correspond to the intersection lines between the respective screws 26a, 26b and the plane 28. Figure 4 The generated image shown not only represents the vertebrae, but also represents the implants 26a, 26b associated therewith, so it may be helpful to the user. However, the vertebrae in the image may not have the orientation that is usually desired by the surgeon. It may be desirable to generate or rotate the image so that the vertebrae are oriented with the spinous processes extending vertically.
[0081] Instead of manually rotating Figure 5 The present technique allows the generation of an image to be displayed such that the vertebrae are represented in a posture defined by the pre-planned positions. Figure 6As shown, for this purpose, straight lines 30, 32 can be used, each of which extends through the pair of positions 25a, 25b and one of the pairs of positions 25c, 25d. That is, an angle bisector 34 between the two lines 30, 32 can be determined. This angle bisector is also Figure 6 As shown in Figure 7 As shown, the image can then be rotated or generated so that the angle bisector 34 is aligned with the vertical image axis "y", i.e., the angle between the angle bisector 34 and the vertical image axis "y" is zero. This approach is particularly advantageous in spinal surgery involving planning pedicle screws, because such screws are typically aligned at similar angles relative to the spinous processes due to the symmetry of the vertebrae.
[0082] The final image obtained using the method described in this article can correspond to Figure 7 30,32 and the indication of the angle bisector 34 can be omitted. Instead of the angle bisector, a weighted average can be used, wherein more reliable planned positions are given more weight relative to less reliable planned positions. The reliability of a planned position (e.g., indicated as its priority value) can be defined or determined based on the type of planned position (e.g., associated with a planned implant, associated with a landmark, associated with a planned trajectory, manually planned or automatically planned).
[0083] exist Figure 8 In the example shown, the planned positions 25e to 25g are associated with the spinal cage 26c. The planned positions 25e to 25g are located in the median symmetry plane 36a of the spinal cage 26c, which is parallel to its outer contact surfaces 38, 40, which are configured to contact the adjacent vertebrae 24. The cage 26c has a given orientation in the median symmetry plane, which is defined by the longitudinal extension of the cage 26c and also by the planned positions 25e to 25g. In the example shown, one end of the planned cage 26c is associated with the position 25g, pointing in a predefined and known anatomical direction. Therefore, the orientation of the adjacent vertebrae 24 can be derived from the planned posture of the cage 26c, specifically based on the pre-planned positions 25e to 25g. This also allows the generation of an image such that the representation of the anatomical element (e.g., one of the vertebrae 24 adjacent to the cage 26c) has a desired pose in the image (e.g., spinous process pointing upward), the desired pose being defined by the known orientation of the pre-planned positions 25e to 25g and the plane 36a (i.e., a predefined and known anatomical direction). This demonstrates that the technology disclosed herein is applicable not only to pedicle screws, but also to spinal cages as medical implants 26.
[0084] exist Figures 9a to 9c , other examples of medical implants 26 are shown that may be used as medical implants with associated pre-planned positions in the technology disclosed herein.
[0085] Figure 9a A belt or sling 26d is shown that is configured to be attached to a vertebra. In this case, pre-planned locations 25h to 25j may be located on the sling and a symmetry plane 36b of the sling may be defined. The sling may extend to a predefined and known anatomical orientation, which means that the symmetry plane 36b may have a predefined alignment relative to the vertebra to which the sling is to be attached. As with the case of the spinal cage 26c, this predefined alignment may be used together with the symmetry plane 36b to define the image plane and the desired rotation of the vertebra so that the spinous processes of the vertebra to be attached are oriented vertically in the generated image. Figure 9a Also shown is a spinal rod 38 configured to be attached to the harness 26d.
[0086] Figure 9b Two pedicle hooks 26e are shown, each associated with a different vertebra. The hooks 26e are connected via a spinal rod 38. Also in this case, each hook 26e can be associated with a pre-planned position (not shown) indicating the orientation of the vertebra associated with the corresponding hook 26e. These positions can then be used to generate different images for each vertebra, wherein the corresponding vertebra is represented in the desired orientation with its spinous process pointing upwards.
[0087] Fig.9c The combination of a pedicle hook 26e and a pedicle screw 26a is shown, each associated with a different vertebra. The hook 26e is attached to the screw 26a via a rod 38. Fig.9c As shown, the technique described herein allows generating a respective image of each vertebra depending on the medical implants associated with the respective vertebra, even if these implants are of different types.
[0088] The user can move the tracking instrument 18 along the patient's spine. Based on the current position of the instrument 18, one of the vertebrae can be selected and the corresponding image can be displayed. This allows navigation of the instrument 18 relative to the vertebrae based on images in which the corresponding vertebrae always have the desired orientation, even if the patient's real vertebrae are misaligned relative to each other due to scoliosis.
[0089] Generally speaking, medical conditions such as scoliosis deform the normal curvature of the spine by twisting the spine and causing abnormal curvatures on both sides. The most common surgical procedure for scoliosis is spinal fusion. Spinal fusion involves realigning and fusing together the curved or misaligned vertebrae so that they heal into a single, solid bone. To this end, the surgeon can plan two pedicle screws 26a, 26b, pedicle slings 26d, or pedicle hooks 26e for each vertebra, which will serve as channels for rods 38, which will help restore the curvature of the spine during the healing process. Alternatively or additionally, a spinal cage 26c can be planned to be inserted between the vertebrae to be fused. Later, when using a navigation system to navigate the tracking instrument 18, the surgeon may struggle with abnormal anatomical orientations because common screw planning and placement rules are defined and planned when the vertebrae are viewed in an expected, familiar orientation. Basically, the back side of the vertebra should be shown upward in the image so that the spinous process extends vertically. This is what a healthy spine will look like when the patient lies prone on the operating table. Aligning the view of each vertebra with this ideal orientation can allow for a smoother and more efficient planning and navigation process, as the user can quickly see the anatomy of interest in a familiar alignment.
[0090] The present disclosure can reduce the complexity of this alignment step in surgery by predicting the preferred orientation based on pre-planning items (e.g., medical implants such as screws and K-wires, surgical information such as trajectories or user-defined points of interest.) Therefore, the user does not need to imagine nor spend time manually reorienting the vertebrae to their preferred anatomical orientation.
[0091] As already explained above, a set of planning items (e.g., screws, Kirschner wires, trajectories, points of interest) are planned by automated processes and / or manual user definitions. Then, planes are constructed based on the orientation and position of these planning items or a subset thereof. Rotational orientations are constructed based on the orientations of these planning items or a subset thereof. A planning system orientation is defined, which orients the world / patient to the constructed planning plane and rotation. This orientation allows the user to traverse patient data while maintaining the preferred orientation of the view oriented to the plane, and controls the rotation of the view, such as making the planning rotation oriented upward in the view. Multiple groups of these planning items can be constructed and grouped by automated processes and / or manual user definitions. For example, even if there is no anatomical information about the vertebrae, planning items can be assigned to vertebral levels. For each of these groups, a planning system orientation (e.g., plane and rotation) can be constructed. By switching between these orientations by automated processes (e.g., based on the proximity of the tracking instrument 18 to the planning items) or manually, the user can orient the view to one or another of these planning system orientations.
[0092] It is apparent from the above that the present disclosure provides a technique capable of generating an image of at least one anatomical element of a patient's body in a preferred orientation. Since the orientation is derived from the planned position indicated by the planning data, it is not necessary to employ computationally expensive segmentation or image recognition algorithms to align the anatomical elements in the preferred orientation. The images generated by the techniques disclosed herein may also indicate medical implants of interest to the user, specifically, medical implants planned for at least one anatomical element depicted in the image. By selecting the generated image based on user input (e.g., based on the current tracking posture of a pointer or surgical instrument relative to the patient's body), it is ensured that the image to be displayed is indeed of interest to the user. Other modifications and advantages of the techniques disclosed herein become apparent to those skilled in the art.
Claims
1. A method for generating an image including a representation of an anatomical element of a patient's body, the method being performed by a computing system and comprising: obtaining medical image data of at least one anatomical element of a patient's body; obtaining planning data indicating at least three planned positions associated with the at least one anatomical element, wherein one or more of the planned positions are associated with at least one planned medical implant; as well as An image is generated based on the medical image data and the planning data, the image comprising a representation of the at least one anatomical element in a pose defined by the at least three planned positions.
2. The method according to claim 1, wherein: The image is generated such that two or more of the at least three planned positions are located in a same plane corresponding to or parallel to an image plane of the generated image.
3. The method according to claim 1, wherein: Two or more of the planned positions are associated with the same planned medical implant.
4. The method according to claim 3, wherein: At least two of the planned positions associated with the same planned medical implant are located on a straight line defining the orientation of the same planned medical implant.
5. The method according to claim 3, wherein: At least three of the planned positions associated with the same planned medical implant are located in a plane defining an orientation of the same planned medical implant.
6. The method according to claim 4, wherein: The image is generated by orienting the representation of the at least one anatomical element such that an angle between: (i) a line indicating the orientation of said same planned medical implant, and (ii) The vertical or horizontal image axis of the generated image.
7. The method according to claim 3, wherein: The image is generated such that the plurality of planned positions associated with the same planned medical implant are located in a same plane corresponding to or parallel to an image plane of the generated image.
8. The method according to claim 1, wherein: The at least three planned positions include at least two pairs of planned positions, each pair of planned positions being associated with a different planned medical implant.
9. The method according to claim 8, wherein: The planned positions of each pair of planned positions are located on a straight line defining the orientation of the planned medical implant associated with the pair of planned positions.
10. The method according to claim 8, wherein: The image is generated such that the planned positions of the at least two pairs of planned positions are located in a same plane corresponding to or parallel to an image plane of the generated image.
11. The method according to claim 8, wherein: The image is generated by orienting the representation of the at least one anatomical element such that an angle between: (i) an angle bisector that bisects the angle between the lines indicating the orientations of the different medical implants, and (ii) The vertical or horizontal image axis of the generated image.
12. The method according to claim 1, wherein: The medical image data comprises volumetric image data, and the image is generated as a two-dimensional image representing a cross-section of the volumetric image data.
13. The method according to claim 1, wherein: The generated image comprises a representation of at least a portion of the at least one planned medical implant.
14. The method according to claim 1, wherein: The medical implant comprises at least one component selected from the group consisting of: (i) a spinal cage, (ii) a bone screw such as a pedicle screw, (iii) a pedicle fixation hook, and (iv) a pedicle fixation band; and / or wherein, The at least one anatomical element comprises a bone such as a vertebra.
15. The method according to claim 1, further comprising: Triggers display of the resulting image.
16. The method according to claim 1, further comprising: obtaining user input indicative of a selected anatomical element of the at least one anatomical element, Therein, the image is generated based on the at least three planned positions associated with the selected anatomical element.
17. The method according to claim 16, wherein: A plurality of images are generated based on the medical image data and the planning data, each image being generated based on at least three of the planning positions associated with the same corresponding anatomical element, and only the images generated based on at least three of the planning positions associated with the selected anatomical element are triggered for display.
18. A system comprising at least one processor configured to execute a method for generating an image comprising a representation of an anatomical element of a patient's body by: obtaining medical image data of at least one anatomical element of a patient's body; obtaining planning data indicating at least three planned positions associated with the at least one anatomical element, wherein: One or more of the planned positions are associated with at least one planned medical implant; as well as An image is generated based on the medical image data and the planning data, the image comprising a representation of the at least one anatomical element in a pose defined by the at least three planned positions.
19. The system of claim 18, further comprising at least one of the following components: A medical image acquisition unit, configured to generate the medical image data; A user input device configured to obtain user input; The display unit is configured to at least display the generated image.
20. A computer program comprising instructions which, when executed on at least one processor, cause the at least one processor to perform a method for generating an image comprising a representation of an anatomical element of a patient's body by: obtaining medical image data of at least one anatomical element of a patient's body; obtaining planning data indicating at least three planned positions associated with the at least one anatomical element, wherein: One or more of the planned positions are associated with at least one planned medical implant; as well as An image is generated based on the medical image data and the planning data, the image comprising a representation of the at least one anatomical element in a pose defined by the at least three planned positions.
