Navigation system having a 3-d surface scanner
Patent Information
- Application Number
- EP2023700757
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-01-17
- Filing Date
- 2023-01-11
- Publication Date
- 2024-11-27
AI Technical Summary
Current surgical navigation systems face challenges in accuracy and complexity, particularly in knee operations, with recording-based systems requiring time-consuming registration and providing inadequate precision, while imageless systems offer crude 3D models that lack detailed anatomical structure.
A surgical navigation system incorporating a tracking system and a 3D surface scanner to create a precise, intraoperative 3D digital model of the patient's anatomy, allowing for accurate alignment of instruments and implants without preoperative imaging, using a 3D surface scanner to generate a digital model that can be integrated with existing anatomy models for real-time navigation.
The system enables faster, more precise, and flexible navigation with improved accuracy, reducing the need for preoperative imaging and registration, while providing a detailed 3D model for optimal instrument and implant placement, enhancing surgical outcomes.
Smart Images

Figure 1.1
Abstract
Description
[0001] NAVIGATION SYSTEM WITH 3D SURFACE SCANNER
[0002] Description
[0003] Technical area
[0004] The present disclosure relates to a surgical navigation system for navigation during a surgical procedure on a patient, in particular during a knee joint operation. Furthermore, the present disclosure relates to a surgical assistance system, a navigation method, and a computer-readable storage medium according to the preambles of the independent claims.
[0005] Background of the present disclosure
[0006] Current surgical navigation systems can essentially be divided into two groups / types / classes or types of surgical navigation systems.
[0007] The first group of navigation systems is image-guided navigation and uses images such as computed tomography (CT) scans, magnetic resonance imaging (MRI) scans, X-rays, or even ultrasound images, which are created and stored preoperatively before the procedure. These images must then be compared with the patient's position before and during the procedure to enable the navigation of instruments or implants.
[0008] The second group of navigation systems is image-less or image-free navigation and works without (preoperative) images. This second group of navigation systems creates a rudimentary (geometric) virtual or digital model of the patient in real time during the procedure. This is usually done by scanning anatomical landmarks or orientation points with a navigation probe, a pointer, or through a kinematic analysis. Such a 3D anatomy model digitally recreates important anatomical points in a computer-assisted system to enable the surgeon to navigate.
[0009] However, image-based navigation systems have the disadvantage that they require complex and time-consuming registration, which often does not provide the required accuracy, especially in the case of knee surgery or craniotomy.
[0010] In contrast, the second group of imageless navigation systems does not require preoperative imaging or intraoperative registration. However, the disadvantage is that they only use a very rough, rudimentary digital 3D model of the patient's anatomy (digital 3D anatomy model) as a reference, for example, an axial model of the leg during knee surgery. The real three-dimensional (3D) structure of the leg is simplified and modeled using straight lines (two-dimensional structure) in (three-dimensional) space to obtain at least a rough 3D (overview) model of the leg. This geometric, schematic 3D model can then be viewed from different perspectives in a computer-assisted system.
[0011] Summary of Revelation
[0012] It is therefore the objects and aims of the present disclosure to avoid or at least mitigate the disadvantages of the prior art and, in particular, to provide a surgical navigation system, a surgical assistance system, a navigation method and a computer-readable storage medium which enables improved, more flexible navigation and, in particular, does not require preoperative imaging / recording with subsequent intraoperative registration, but provides a sufficiently accurate intracorporeal 3D image of the patient for an intervention area of interest as a reference for navigation in order to be able to align instruments or implants, for example.In particular, the aim is to provide even better, faster, more flexible, and more precise navigation with a navigation system that is as easy to use as possible, allowing intraoperative three-dimensional acquisition and visualization of anatomical structures of interest in a surgical area. These objects are achieved according to the invention with regard to a generic surgical navigation system by the features of claim 1, with regard to a generic surgical assistance system by the features of claim 12, with regard to a navigation method by the steps of claim 13, and with regard to a computer-readable storage medium by the features of claim 15.
[0013] A basic idea of the present disclosure is that the surgical navigation system comprises, in particular, a tracking system (with, in particular, a navigation camera) for locating or localizing (a position) of at least one body portion of the patient on which the procedure is being performed, as well as a 3D surface scanner. Furthermore, the navigation system can preferably comprise medical instruments for the procedure.The 3D surface scanner, in particular a 3D surface scanner camera, is used during a procedure to create a 3D surface image intraoperatively after the patient has been opened up and from this to create a digital 3D surface model of the patient's internal anatomy (digital 3D anatomy model of the patient) or to supplement an existing 3D anatomy model of the patient, which ultimately serves as a reference for navigation and can be used in particular by instruments or implants to guide them to their target position.
[0014] In particular, the surgical navigation system according to the present disclosure comprises a tracking system, in particular with a navigation camera, preferably one or more trackers for tracking the patient, and preferably one or more trackers for tracking instruments or implants. Furthermore, the navigation system comprises a 3D surface scanner that can be tracked by the tracking system (or whose position in space can be detected) and is in particular equipped with a tracker / marker to (indirectly) detect and localize (via the tracker) the position, in particular the position and orientation (i.e., the position), of the scanned intracorporeal anatomical 3D surface with the tracking system (the navigation camera).Since the tracking system records both the position of the patient's body section and the position of the 3D surface image, a relative transformation of the patient (or the body section of interest) to the 3D surface image can be established, and the position of the 3D surface image can be correlated to the patient. The 3D surface scanner is aimed at the anatomical region of interest or is aligned to it and acquires a 3D surface image of this region. This creates a digital 3D surface model, which it integrates into a 3D anatomical model of the patient. This 3D surface image can be expanded to include additional anatomical regions by moving the 3D surface scanner, for example, manually by hand or controlled by a robotic arm.During (i.e., simultaneously with) the capture of the real anatomical 3D surface as a (digital) 3D surface image, the 3D surface scanner, in particular a 3D scanning camera, is localized in space (position and / or orientation), and on this basis, the 3D surface image is correlated with the patient, in particular with the aid of a patient tracker provided on the patient. In particular, the position and / or orientation of the 3D surface image relative to the patient is determined. In other words, the navigation system therefore comprises, in particular, a tracking system (localization system), at least one tracker attached to the patient, and a 3D surface scanner equipped with a tracker. The 3D surface scanner, in particular as a 3D surface scanning camera, creates a 3D surface image of a targeted internal anatomy of the patient, and the 3D surface scanner is localized relative to the patient.The 3D surface image is transmitted to a control unit or computer system. The navigation system has an output device, in particular a display, and the 3D anatomical model supplemented by the 3D surface image can be used as a reference for positioning navigated instruments or implants without the need for preoperative images of the patient.
[0015] This 3D surface image (as a generated 3D surface) is provided to a control unit or transferred to an adapted computer system (as the control unit). The navigation system further comprises an output device for visual output, in particular a display (such as a surgical monitor). The control unit or the computer system creates and supplements a digital three-dimensional (3D) anatomical model of the patient (3D anatomy model of the patient), which can optionally be supplemented by palpation / feeling anatomical landmarks or in which landmarks are already present. The computer system or the control unit then enables the planning and navigation of the procedure, for example, by visually positioning an orthopedic prosthesis in a desired position.During the procedure, the navigation system of the present disclosure then displays the current position and / or orientation, in particular location, of navigated instruments or implants relative to the patient's 3D anatomical model with an optionally included and viewable procedure plan, so that a surgeon can optimally guide and position the instruments or implants to achieve the best result for the patient.
[0016] This surgical navigation system combines the advantages of image-based and image-less navigation technologies, leveraging them to their full potential. The surgical navigation system eliminates the need for preoperative imaging with subsequent intraoperative registration, yet still has an accurate 3D model (3D anatomical model) of the patient as a reference, particularly for optimally aligning instruments or implants for the best possible surgical outcome. The surgical navigation system demonstrates its advantages particularly in orthopedic navigation, where the precise shape and arrangement of bones must be captured and made available for navigation.
[0017] In still other words, a surgical navigation system for use in a surgical procedure on a patient is disclosed, comprising: a tracking system / localization system adapted to detect and track at least the patient's body portion of interest on which the procedure is performed, in particular the entire patient, and preferably at least one medical instrument, with regard to its position; a 3D surface scanner adapted to create a 3D surface image (in a sense a 2D surface structure in 3D space) of an intracorporeal anatomy of the patient of interest, wherein the 3D surface scanner is tracked by the tracking system, in particular by means of an attached tracker; and a control unit,which is adapted / configured to process the 3D surface image and the recorded and tracked position of the tracked 3D surface scanner and the tracked patient (or their body section), to determine a position and orientation (i.e., location) of the 3D surface image relative to the patient using the recorded and tracked position of the 3D surface scanner, and to supplement a virtual, digital 3D anatomical model of the patient (or at least a digital 3D anatomical model of the body section of interest), which is stored in particular in a storage unit, at the determined position and orientation (i.e., location) with the (local) 3D surface image (correlated), and to visually output a view of the supplemented digital 3D anatomical model of the patient for surgical navigation via an output device, in particular an operating room monitor,to provide a timely digital 3D anatomy model for navigation, supplemented by the patient's intracorporeal anatomy of interest.
[0018] The navigation system's 3D surface scanner can operate at high speed and high precision, is cost-effective, easy to handle, and particularly well-suited for use in medical technology. These advantages also extend to the navigation system. In particular, a 3D surface scanner with structured light can be used in spinal and neuronavigation to create a 3D surface image of a targeted patient anatomy during the procedure. This can preferably also be used to register a preoperative dataset, such as a CT scan or an MRI scan taken before the procedure. The 3D surface scanner can be used, in particular, to create a 3D point cloud and, furthermore, preferably, to overlay a color map.
[0019] This surgical navigation system can be used for various indications. In knee surgery, for example, it can be used to create a 3D surface image of the articular surface of the knee joint after opening and exposing the knee. This 3D surface image of the distal femur can be acquired relative to a femur tracker reference, while a 3D surface image of the proximal tibia can be acquired relative to a tibia tracker reference. The 3D surface image of the femur and tibia can optionally be supplemented with anatomical landmarks such as the hip, knee, and patella centers, the tibia center, and the ankle center. A 3D anatomical model of the patient with existing anatomical landmarks can be supplemented with the 3D surface image.After the at least one 3D surface image(s) and preferably anatomical landmarks have been acquired, a knee prosthesis, in particular, can be positioned in the intended alignment with the biomechanical axes. The 3D surface images of the thigh and tibia enable particularly precise positioning and sizing of the prosthesis.
[0020] In the case of hip surgery, for example, the surgical navigation system can create a 3D surface image of the acetabulum and supplement the image-free, landmark-based digital 3D anatomical model of the patient with the 3D surface image of the acetabulum. This allows not only the anatomical angles and distances to be visualized during acetabular alignment, but also the seating and alignment of the acetabular implant relative to the bone structure to be visually checked.
[0021] The term "position" refers to a geometric position in three-dimensional space, which is specified in particular using coordinates of a Cartesian coordinate system. In particular, the position can be specified by the three coordinates X, Y, and Z.
[0022] The term "orientation," in turn, indicates an alignment (e.g., position) in space. One could also say that orientation indicates an orientation with a direction or rotation specification in three-dimensional space. In particular, orientation can be specified using three angles.
[0023] The term "location" encompasses both position and orientation. In particular, the location can be specified using six coordinates: three position coordinates X, Y, and Z, as well as three angular coordinates for orientation. The term "3D" defines that the scan data is spatial, i.e., three-dimensional. The patient's body, or at least a spatially extended portion of the body, can be represented digitally as scan data in a three-dimensional space, for example, using a Cartesian coordinate system (X, Y, Z).
[0024] Advantageous embodiments are claimed in the subclaims and are explained in particular below
[0025] According to one embodiment, the 3D surface scanner of the navigation system can have a handle and preferably a wireless communication module (such as Wi-Fi, Bluetooth, or IR) for manually guiding the 3D surface scanner and creating 3D surface images in various positions. In particular, the 3D surface scanner with handle can have a battery to act as a self-sufficient module. Alternatively or additionally, the 3D surface scanner can have a mounting section, in particular a clamping module, for attachment, in particular, to a support arm of the navigation system.Alternatively or additionally, the surgical navigation system can comprise a robot with a robot arm to which the 3D surface scanner is connected as an end effector in order to automatically create the 3D surface image in at least one predefined position of the 3D surface scanner, in particular in order to create multiple 3D surface images in multiple positions of the 3D surface scanner, preferably according to a scanning algorithm or pattern. In other words, the 3D surface scanner can in particular be designed to be handheld, mounted on a static mechanical support arm of the navigation system, or held and actively moved by a robot arm. In particular, the 3D surface scanner can be attached to a robot arm of the navigation system or the assistance system, which moves the 3D surface scanner autonomously in order to (controlledly) capture the anatomical region of interest.
[0026] According to a further embodiment, the 3D surface scanner can have a radiator for structured light and a sensor, in particular an RGB sensor (for example a camera) for detecting the light and / or a stereo camera and / or a time-of-flight camera and / or a LIDAR scanner, in particular to create a 3D point cloud of the anatomical region of interest as a 3D surface image. In other words, the 3D surface scanner can create the 3D surface images using various technologies, in particular with structured light and corresponding detection, with a stereo camera (stereo vision), with a time-of-flight camera, or a LIDAR sensor / Lidar camera, in particular to create a 3D point cloud of the anatomical region of interest.
[0027] Preferably, the tracking system and / or the control unit and / or the 3D surface scanner of the navigation system are adapted to determine a position using machine vision. In particular, images from different viewing directions relative to the object or surface of interest are taken using a 2D camera, and spatial information is calculated from these images.
[0028] Preferably, the tracking system may comprise an optical tracking system and / or a machine vision-based tracking / localization system and / or an electromagnetic tracking system. In particular, the navigation system may be configured to perform electromagnetic tracking (EM navigation system) in addition to the optical tracking system.
[0029] Preferably, a virtual digital 3D anatomical model of a patient's leg section, including the knee, can be stored in a storage unit of the navigation system, and the navigation system with the 3D surface scanner can be adapted to create a 3D surface image of the knee joint. For this purpose, the navigation system has a tibia tracker and a separate femur tracker, which are adapted to be rigidly arranged on the tibia and femur for bone tracking. The control unit is adapted to correlate the 3D surface image with the tracked leg section based on the tracked tibia tracker and the femur tracker. Two bone references (the tibia and femur bone sections in the area of the knee joint) are thus tracked separately with the navigation, with two or more 3D surfaces of the anatomy being captured relative to the corresponding reference bones.In particular, the navigation system can be adapted to track two reference bones, each with attached trackers, separately with the tracking system and to create at least two intracorporeal anatomical 3D surface images relative to the reference bones.
[0030] According to one embodiment, the control unit can be adapted, in particular by means of a pointer of the navigation system, to supplement the digital 3D anatomical model of the patient with landmarks, in particular around the hip, knee, and kneecap centers, the shin center, and / or the ankle center, in order to obtain a combined digital 3D anatomical model consisting of points, (biomechanical) axes, and surfaces. In other words, the acquired 3D surface can be supplemented with further anatomical landmark points / landmarks that are acquired on the patient by scanning or by kinematic movements, creating a combined model consisting of points, (biomechanical) axes, and surfaces.
[0031] According to a further embodiment, the control unit can be adapted to process at least two 3D surface images in at least two different (detected) positions of the 3D surface scanner in order to obtain an expanded and / or more precise 3D surface image as an overall image based on these individual 3D surface images. This technique, also known as stitching technology, combines several individual 3D surface images to form an overall image. Similar to a panorama function in photos, several images are connected to one another, particularly at overlapping areas. However, due to the detected position of the 3D surface scanner, an overlapping area does not have to be present, since individual separate areas can also be supplemented. The navigation system therefore allows absolute supplementation and does not require a relative reference.Preferably, the control unit can be adapted to calculate a resulting 3D surface image for overlapping areas of 3D surface images in order to increase precision. In particular, the 3D surface image can be acquired in a single static position, in particular layer, or across multiple positions, in particular layers, thereby enlarging the scanned surface area and thus the 3D anatomical model of the patient. Preferably, the 3D surface scanner can be adapted to be inserted intracorporeally into the patient and, in particular, have a maximum width and a maximum height, particularly preferably a maximum dimension, of 10 cm. The 3D surface scanner, in particular the 3D surface scanner camera, can thus be so small that it can be inserted into the interior of the patient's anatomy in order to capture surfaces of a deep-lying region as 3D surface images.The acquired 3D surface image can be used to plan the position of an implant or instrument during surgery.
[0032] In particular, the surgical navigation system can comprise a surgical endoscope in which the 3D surface scanner is integrated, particularly in its front-end / terminal endoscope head. The 3D surface scanner can thus be a component of a surgical endoscope.
[0033] According to one embodiment, the 3D anatomical model of the patient with an implant according to the intervention plan can be stored in a storage unit of the navigation system, and the control unit can be adapted to verify the position of the actual implant compared to the position of the implant according to the intervention plan intraoperatively using a 3D surface scan with the 3D surface scanner, and to output a warning via the display device in the event of a deviation. The 3D surface scanner can therefore also be used after insertion of the implant to check the position and compare it with the intervention plan. In particular, the control unit compares a desired position of the implant in the 3D anatomical model of the patient with an actual position according to the performed 3D surface scan, and any deviation is displayed via the output device to provide the surgeon with information regarding the alignment.
[0034] In particular, the control unit can be adapted to supplement the 3D surface image in the patient's digital 3D anatomical model as a structureless surface or as a surface with a color texture or a grayscale texture. In other words, the 3D surface image can preferably be converted and stored as a structureless surface or as a surface with a color or grayscale texture.
[0035] According to one embodiment, the control unit can be adapted to detect predefined structures of interest in the 3D surface image, in particular bones, and to supplement the digital 3D anatomical model only with these predefined structures of interest. The acquired 3D surface images can thus be manipulated in particular so that only structures of interest remain in the 3D surface image. Structures that are not part of the bone, such as the skin, are automatically delimited from the 3D surface image.
[0036] With regard to a surgical assistance system, the objects are achieved in that it comprises a navigation system according to the present disclosure and a medical robot with a medical end effector. The navigation system can, in particular, be integrated into a surgical robot without requiring a preoperative image volume. Consequently, the surgical assistance system can provide the data for navigation via the navigation system, and an automated or semi-automated procedure can be performed via the robot with the end effector. In particular, during a knee operation, the robot can be controlled based on the created and supplemented 3D anatomical model of the patient such that the end effector performs a resection of the tibia and femur and, furthermore, preferably automatically inserts a knee prosthesis in the correct position.
[0037] With regard to a navigation method for use in a surgical procedure on a patient, in particular in knee endoprosthetics, preferably in a surgical navigation system of the present disclosure, the objects are achieved in that the navigation method comprises the steps:
[0038] Tracking a patient and preferably at least one medical instrument, in particular a pointer, by means of a tracking system;
[0039] Creating a 3D surface image of an intracorporeal anatomy of the patient of interest using a 3D surface scanner and tracking the 3D surface scanner using the tracking system, in particular via attached trackers,
[0040] Determining, via the recorded position of the 3D surface scanner, a position of the 3D surface image relative to the patient;
[0041] Supplementing a digital 3D anatomy model of the patient at the specific location with the 3D surface image (correlated); and
[0042] Outputting a visual view of the augmented digital 3D anatomy model of the patient for surgical navigation via an output device, in particular an operating room monitor, to provide a timely digital 3D anatomy model for navigation, augmented by the patient's intracorporeal anatomy of interest. This navigation method allows for a quick, easy, and flexible procedure, in particular knee joint surgery with a knee prosthesis, and further improves patient safety.
[0043] In particular, the navigation method can further comprise the steps of: creating a 3D surface image of a front side of a femur in a first position of the 3D surface scanner, in particular via a robot-guided 3D surface scanner; detecting the position of the 3D surface scanner and a femur via a femur tracker (on the femur) by the tracking system; creating a 3D surface image, in particular of a front side, of a tibia in a second position of the 3D surface scanner, in particular robot-guided; detecting the position of the 3D surface scanner and a tibia via a tibia tracker on the tibia by the tracking system; and supplementing the digital 3D anatomical model of the patient, by the control unit, with the 3D surface images at the determined position (positionally correct integration of the digital recording data).
[0044] With regard to a computer-readable storage medium, the objects are achieved in that it comprises instructions which, when executed by a computer, cause the computer to carry out the method steps of the navigation method according to the present disclosure.
[0045] The disclosure regarding the navigation system according to the present disclosure also applies to the navigation method according to the present disclosure and vice versa. In particular, the control unit of the navigation system can be adapted (for example, have a processor and a memory unit with instructions) to carry out the method steps according to the navigation method.
[0046] Short description of the characters
[0047] The invention is explained in more detail below using preferred embodiments with the aid of figures. They show:
[0048] Fig. 1 is a perspective, schematic view of an assistance system with a surgical navigation system according to a preferred embodiment of the present disclosure, which is adapted for a knee operation;
[0049] Fig. 2 shows a schematic 3D anatomical model of a patient with digitized anatomical landmarks and a scanned 3D surface image of the knee surgery from Fig. 1;
[0050] Fig. 3 is a schematic perspective view of a 3D surface scanner of a navigation system of another embodiment in the form of a 3D scanning camera, which captures a joint surface of a knee joint and outputs a view of a 3D anatomical model via a screen; and
[0051] Fig. 4 is a flowchart of a navigation method according to a preferred variant.
[0052] The figures are schematic in nature and are intended only to aid understanding of the invention. Like elements are designated by the same reference numerals. The features of the various embodiments may be interchanged.
[0053] Detailed description of preferred embodiments
[0054] Fig. 1 shows a schematic perspective view of a surgical assistance system 100 according to a preferred embodiment with a robot 102 and a surgical navigation system 1 according to a preferred embodiment.
[0055] The surgical navigation system 1 is used for a knee surgery on a patient P, in which a tibia is resectioned and an implant is inserted into the knee joint. Accurate and timely navigation is crucial for this surgical procedure on the patient.
[0056] The navigation system 1 has an optical tracking system 2 for detecting the position of a rigid body, which is adapted to detect and track the patient P and also a medical instrument with an attached rigid body. In this embodiment, the tracking system 2 has a stereo camera for three-dimensional detection and a downstream processing unit to determine a position in space based on the stereo image. The rigid body to be detected by the tracking system 2 is in the form of a tracker 10 with three spaced-apart spheres, so that the tracking system can indirectly determine the position of the associated section to which the tracker 10 is attached by detecting the position of the tracker 10.
[0057] The navigation system 6 further comprises a mobile, handheld 3D surface scanner 6, which is specifically adapted to create a 3D surface image 8 of an intracorporeal anatomy of the patient P of interest, namely the knee joint with the corresponding bones. The 3D surface scanner 6 itself is tracked by the tracking system 2 using an attached tracker 10, so that a position of the 3D surface scanner 6 in space can be determined by the tracking system 2. In other words, the 3D surface scanner 6 records a three-dimensional surface of a knee joint of the patient P (with color information and, to a certain extent, height information, similar to that of a three-dimensional map), whereby the position of the 3D surface scanner 6 is detected during the 3D surface image 8.Since the position of the 3D surface image 8 can be determined relative to the position of the 3D surface scanner 6, and further, the position of the 3D surface scanner relative to the stereo camera of the tracking system 2, a transformation between the 3D surface image 8 and the tracking system can also be determined. Furthermore, since the knee joint of the patient P is detected via the trackers 10 (here the femur and the tibia), the position of the leg as a body section of the patient relative to the tracking system 2 can also be determined, or a transformation from the position of the individual bones to the local coordinate system (KOS) of the tracking system 2 can be determined. Thus, by linking the two transformations, the position (of the local KOS) of the femur and the position (of the local KOS) of the tibia, and thus of the knee joint, relative to the 3D surface image 8 can be determined.
[0058] Specifically, a control unit 12 with a processor, a RAM module, and a memory is adapted to process the 3D surface image 8 and the recorded and tracked position of the 3D surface scanner 6 and of the patient P, and to determine a position of the 3D surface image 8 relative to the patient P via the position of the 3D surface scanner 6 and to supplement a virtual, digital 3D anatomy model 14 of the patient P at the determined position with the 3D surface image 8. By detecting the real leg of the patient P by the tracking system 2, a correlation of a virtual model of the leg of the patient P with the real leg can be carried out, such that the position of the 3D surface image 8 can also be determined in relation to the position of the virtual leg. It can also be said that in the virtual orA 3D anatomy model 14 of the patient P is stored in digital space, for example as a schematic biomechanical axis model (axis with start and end point as representation of a bone) with further landmark points, and this 3D anatomy model 14 of the patient P is supplemented by the scanned surface of interest, namely the intervention area, in order to provide more detailed digital information on this intervention area and to support navigation intraoperatively.
[0059] A view of the supplemented digital 3D anatomy model 14 of patient P can then be visually output for surgical navigation via a computer-assisted display as an output device 16, for example, an operating room monitor, in order to provide a time-updated digital 3D anatomy model 14 for navigation, supplemented by the intracorporeal anatomy of interest of patient P. This eliminates the need for complex registration, yet still allows a 3D anatomy model 14 of patient P to be provided that offers particularly precise anatomical structural information for navigation in the area of the procedure.
[0060] The surgical navigation system 1 provides the special possibility of creating a 3D surface image 8 in different positions and thus different viewing angles and views in order to expand the 3D anatomy model 14 of the patient P with regard to relevant recorded areas and also to further improve accuracy through redundant information and an optimization algorithm.
[0061] The 3D surface scanner 6 is designed so that a surgeon can easily hold and guide it in his or her hand. To this end, the 3D surface scanner 6 has a handle 18 for manual gripping and guiding, a battery for providing autonomous power, and a wireless communication module 20 in the form of a WLAN or Bluetooth module for data transmission to the control unit 12, ensuring a wireless design.
[0062] In another embodiment not shown, the surgical navigation system can also comprise a robot with a robot arm to which the 3D surface scanner 6 is connected as an end effector in order to automatically create the 3D surface image 8 in at least one predefined position of the 3D surface scanner 6, in particular to create multiple 3D surface images 8 in multiple positions of the 3D surface scanner 6 according to a scanning algorithm or pattern. If the 3D surface scanner 6 is robot-guided, the 3D surface scanner 6 can be automatically moved into these positions using an algorithm or with predefined positions, and a recording can be created.This configuration would also have the advantage that a position of the 3D surface scanner 6 can be detected not only via a tracker, but also via kinematics relative to a robot base, whereby a transformation between the robot base and the tracking system can be determined. In this way, the position of the 3D surface scanner 6 can be determined even if a view of the tracker is interrupted.The virtual digital 3D anatomy model 14 of a leg section of the patient P including the knee is stored in a storage unit 22 of the navigation system 1. The 3D surface scanner 6 creates the 3D surface image 8 of the knee joint, wherein the corresponding bone can be detected by the tracking system 2 via a separate tibia tracker 24 and femur tracker 26 that are rigidly screwed to the bone. The control unit 12 is adapted to correlate the 3D surface image 8 to the tracked leg section on the basis of the tracked tibia tracker 24 and the femur tracker 24.
[0063] Fig. 2 shows an example of the creation of a patient model or 3D anatomy model 14 on the basis of a scanned 3D surface image and digitized anatomical landmarks in the case of navigation during the procedure on the knee of the patient from Fig. 1. On the left side of Fig. 2 the real bones of the patient are shown schematically, while on the right side the 3D anatomy model 14 of the patient P is shown with straight biomechanical axes 28 (approximately) along a longitudinal axis of the two bones and with anatomical landmark points relevant for the procedure (in Fig. 2 supplemented with a dash for illustration with reference numerals), in particular around the centers of the knee, knee and kneecap, the center of the tibia and / or the center of the ankle.A 3D surface image 8 is created locally on the real knee joint of patient P by the 3D surface scanner 6 as a partial section of the knee joint and, as described above, this is supplemented in the 3D anatomy model 14 of patient P, indicated here with the inserted 3D surface on the right in Fig. 2.
[0064] Based on this 3D anatomy model 14 of patient P, the surgeon can then perform an operation and navigate accordingly, but also, when inserting an implant, compare a position of a target position of the implant with an actual position of the implant according to an intervention plan that reflects the target position in the 3D anatomy model 14 of patient P and, if necessary, make corrections in order to adapt the actual position to the target position intraoperatively.
[0065] Fig. 3 shows a surgical navigation system 1 according to another preferred embodiment. This system utilizes a 3D camera with a structured light emitter and multiple RGB sensors / RGB cameras as a 3D surface scanner 6. A rigid body is again arranged on the scanner as a tracker 10 to detect the position via the tracking system 2. The 3D camera creates the surface image in its field of view 32 in the form of a point cloud in three-dimensional space to obtain the geometric information, and color information is also added according to the recorded color to make navigation even more intuitive. The knee joint is scanned with the 3D surface scanner 6, and the control unit 12 is adapted to recognize the bone from the 3D surface image, to determine only this bone as the relevant part of the 3D surface image, and to add it to the 3D anatomical model 14 of the patient.
[0066] In this embodiment, the control unit 12 creates two views of the 3D anatomical model 14, one of the tibia and one of the femur, and displays them on a screen for navigation. This provides the surgeon with the information relevant to his or her procedure immediately and intraoperatively, enabling him or her to perform the operation and insert an implant even more effectively.
[0067] Fig. 4 shows a flowchart of a navigation method for use in a surgical procedure on a patient P, in particular a tibial resection.
[0068] In a first step S1, the position of the patient's P leg, including the knee joint on which the procedure is being performed, and of a medical instrument used during the procedure are recorded and tracked using a tracking system 2 of a navigation system 1. The position is stored, in particular, in the form of three position coordinates and three angle values for orientation.
[0069] In a step S2, a 3D surface image 8 of an intracorporeal anatomy of patient P of interest is created using a 3D surface scanner 6, and a position of the 3D surface scanner 6 is determined by the tracking system 2 at the time of the 3D surface image 8 via trackers 10 attached to the 3D surface scanner 6 and by tracking in space. In a subsequent step S3, a position of the 3D surface image 8 relative to the patient P is determined or calculated using the detected position of the 3D surface scanner 6. In particular, a position of the 3D surface image 8 relative to the 3D surface scanner 8 and further relative to the tracking system 2 and further relative to the patient P can first be determined.This transformation between the patient P and the 3D surface image is used by a control unit 12 to supplement a digital 3D anatomical model (14) of the patient (P) at precisely this specific position with the 3D surface image 8 in a step S4. In other words, the virtual, digital 3D model of the patient's body section is supplemented with the 3D surface image 8 in a positionally correct manner.
[0070] Finally, the control unit 12 creates a view of the virtual, augmented digital 3D anatomy model 14 of the patient P, for example a front view, a side view, a perspective view, and this visual view of the augmented digital 3D anatomy model 14 is then output or displayed for surgical navigation via an output device 16 in the form of an operating room monitor 34 in order to provide an intraoperative, up-to-date digital 3D anatomy model 14 for navigation, augmented by the intracorporeal anatomy of the patient (P) of interest.
[0071] Reference symbol list
[0072] 1 Surgical navigation system
[0073] 2 Tracking system
[0074] 4 Medical Instrument
[0075] 6 3D surface scanners
[0076] 8 3D surface imaging
[0077] 10 trackers / markers
[0078] 12 Control unit
[0079] 14 3D anatomy model
[0080] 16 Dispensing device
[0081] 18 Handle
[0082] 20 radio communication module
[0083] storage unit
[0084] 24 tibia trackers
[0085] 26 femur trackers
[0086] 28 Axis
[0087] 30 landmark points
[0088] 32 field of view
[0089] 34 monitors
[0090] 36 Light source for structured light
[0091] 38 RGB sensor 1', 2', 3', 4', 5', 6', 7', 8', 9' landmark points
[0092] 100 Surgical Assistance System
[0093] 102 robots
[0094] 104 Medical End Effector
[0095] P Patient
[0096] S1 Step Determine position of the patient's leg and an instrument
[0097] S2 Step Create 3D surface image with 3D surface scanner and
[0098] Determine the position of the 3D surface scanner S3 Step Determine a transformation between the 3D surface image and the patient
[0099] S4 Step: Positionally correct addition of a 3D anatomy model with a 3D surface image
[0100] S5 Step Output a view of the supplemented 3D anatomy model of the patient through the surgical monitor
Claims
Claims 1. Surgical navigation system (1) for use in a surgical procedure on a patient (P) comprising a tracking system (2) adapted to track at least the patient (P) and preferably at least one medical instrument (4); a 3D surface scanner (6) adapted to create a 3D surface image (8) of an intracorporeal anatomy of the patient (P) of interest, wherein the 3D surface scanner (6) is tracked by the tracking system (2), in particular by means of an attached tracker (10);and a control unit (12) adapted to process the 3D surface image (8) and the captured and tracked position of the tracked 3D surface scanner (6) and the patient (P), to determine a position of the 3D surface image (8) relative to the patient (P) via the captured and tracked position of the 3D surface scanner (6), and to augment a virtual, digital 3D anatomy model (14) of the patient (P) at the determined position around the 3D surface image (8), and to visually output a view of the augmented digital 3D anatomy model (14) of the patient (P) for surgical navigation via an output device (16), in particular an operating room monitor, in order to provide a real-time digital 3D anatomy model (14) augmented with the intracorporeal anatomy of interest of the patient (P) for navigation.
2. Surgical navigation system (1) according to claim 1, characterized in that the 3D surface scanner (6) of the navigation system (1) has a handle (18) and preferably a wireless communication module (20) for manually guiding the 3D surface scanner (6) and creating 3D surface images (8) in different positions, or the 3D surface scanner (6) has a mounting section for being attached, in particular, to a support arm of the navigation system (1), or the surgical navigation system (1) has a robot with a robot arm to which the 3D surface scanner (6) is connected as an end effector, in order to to automatically create the 3D surface image (8) in at least one predefined position of the 3D surface scanner (6), in particular to create several 3D surface images (8) in multiple positions of the 3D surface scanner (6) according to a scanning algorithm or pattern.
3. Surgical navigation system (1) according to claim 1 or 2, characterized in that the 3D surface scanner (6) has a structured light emitter and an RGB sensor for detecting the light and / or has a stereo camera and / or has a time-of-flight camera and / or has a LIDAR scanner, in particular to create a 3D point cloud of the anatomical region of interest as a 3D surface image (8).
4. Surgical navigation system (1) according to one of claims 1 to 3, characterized in that the tracking system (2) comprises an optical tracking system and / or an EM tracking system.
5. Surgical navigation system (1) according to one of the preceding claims, characterized in that a virtual digital 3D anatomical model (14) of a leg segment of the patient (P) including the knee is stored in a storage unit of the navigation system (1) and the navigation system (1) is adapted with the 3D surface scanner (6) to create a 3D surface image (8) of the knee joint, wherein the navigation system (1) for this purpose has a tibia tracker (24) and a separate femur tracker (26) which are adapted to be rigidly arranged on the tibia and on the femur for tracking the bone, and the control unit (12) is adapted to correlate the 3D surface image (8) to the tracked leg segment on the basis of the tracked tibia tracker (24) and the femur tracker (26).
6. Surgical navigation system (1) according to one of the preceding claims, characterized in that the control unit (12) is adapted, in particular by means of a pointer of the navigation system (1), to align the digital 3D anatomy model (14) of the patient (P) around landmark points (30), in particular around the centers of the hip, knee and patella, tibia and / or ankle. to obtain a combined digital 3D anatomy model (14) consisting of points (30), axes (28) and surfaces (8).
7. Surgical navigation system (1) according to one of the preceding claims, characterized in that the control unit (12) is adapted to process at least two 3D surface images (8) in at least two different positions of the 3D surface scanner (6) in order to obtain an extended and / or more precise 3D surface image (8) as a total image based on these individual 3D surface images (8).
8. Surgical navigation system (1) according to one of the preceding claims, characterized in that the 3D surface scanner (6) is adapted to be inserted intracorporeally into the patient (P), and in particular has a maximum width and a maximum height, especially preferably a maximum dimension, of 10 cm 9. Surgical navigation system (1) according to one of the preceding claims, characterized in that the surgical navigation system (1) comprises a surgical endoscope in which the 3D surface scanner (6), in particular the 3D surface scanner (6) is integrated into the endoscope head on the voice side.
10. Surgical navigation system (1) according to one of the preceding claims, characterized in that the 3D anatomy model (14) of the patient (P) with an implant according to the procedure plan is stored in a storage unit (22) of the navigation system (1), and the control unit (12) is adapted to verify intraoperatively the position of the real implant relative to the position of the implant according to the procedure plan via a 3D surface image (8) with the 3D surface scanner (6), and to output a warning or deviation information via the output device (16) in case of a deviation.
11. Surgical navigation system (1) according to one of the above Claims characterized in that the control unit (12) is adapted to recognize predefined structures of interest in the 3D surface recording (8), in particular to identify bones, and to supplement the digital 3D anatomy model (14) only with these predefined structures of interest.
12. Surgical assistance system (100) comprising a navigation system (1 ) according to one of the preceding claims and a medical robot (102) comprising a medical end effector (104).
13. Navigation method for use in a surgical procedure on a patient (P), in particular in knee endoprosthetics and preferably in a surgical navigation system (1) according to the preceding claims, characterized by the steps: Tracking a patient (P) and preferably at least one medical instrument using a tracking system (2) or a navigation system (1); Creating a 3D surface image (8) of an intracorporeal anatomy of the patient (P) of interest by means of a 3D surface scanner (6) and retouching the 3D surface scanner (6) by the tracking system (2), in particular via an attached tracker (10); Determine, via the recorded position of the 3D surface scanner (6), a position of the 3D surface recording (8) relative to the patient (P) by a control unit (12); Supplementing a digital 3D anatomical model (14) of the patient (P) at the specified location with the 3D surface image (8) by the control unit (12); and Output of a visual view of the augmented digital 3D anatomy model (14) of the patient (P) for surgical navigation via an output device (16), in particular via an operating room monitor, to provide an intraoperative, up-to-date digital 3D anatomy model (14) augmented with the intracorporeal anatomy of the patient (P) of interest for navigation.
14. Navigation method according to claim 13 characterized in that the navigation method further comprises the steps: Creating a 3D surface image (8) of an end face of a femur in a first position of the 3D surface scanner (6), in particular using a robot-guided 3D surface scanner (6); Determining the position of the 3D surface scanner (6) and a femur tracker (26) on the femur by the tracking system (2); Creating the 3D surface scan (8) of a tibia, in particular of a frontal surface, in a second position of the 3D surface scanner (6), in particular robot-guided; Determining the position of the 3D surface scanner (6) and a tibia tracker (24) on the tibia by the tracking system (2); Supplementing, by means of the control unit (12), the digital 3D anatomy model (14) of the patient (P) with the positionally correct 3D surface images (8).
15. Computer-readable storage medium comprising instructions which, when executed by a computer, cause the computer to perform the process steps of the navigation method according to claim 13 or 14.
