Video-based navigation of bone reamers

The surgical controller uses a machine-readable pattern on a reamer to monitor and adjust drilling depth in real-time, addressing the issue of thin bone walls during ACL reconstruction by ensuring adequate bone support for fixation devices.

JP2024543869AActive Publication Date: 2024-11-26SMITH & NEPHEW INC +2
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024529868
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-12-01
Filing Date
2022-11-30
Publication Date
2024-11-26
Estimated Expiration
2042-11-30

AI Technical Summary

Technical Problem

Drilling the femoral socket too deep during ACL reconstruction can result in thin bone walls, leading to potential failure of the reconstruction due to insufficient bone support for fixation devices.

Method used

A surgical controller reads a machine-readable pattern on a reamer using an arthroscopic surgical system to determine the actual depth of the reamer within the bone and displays this depth on a display, allowing for real-time adjustment of drilling parameters to prevent excessive depth.

Benefits of technology

This method ensures accurate control of reamer depth, preventing thin bone walls and enhancing the stability of ACL reconstruction by maintaining adequate bone support for fixation devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024543869000001_ABST
    Figure 2024543869000001_ABST
Patent Text Reader

Abstract

In one embodiment of the present disclosure, a method may include reading, by a surgical controller via an arthroscope, a portion of a machine-readable pattern on a reamer visible within the surgical site. The method may include determining, by the surgical controller, an actual depth of the reamer within the bone based on the portion of the machine-readable pattern. The method may include displaying, by the surgical controller, on a display device, a value indicative of the actual depth of the reamer within the bone. The method may include controlling operation of a drill associated with the reamer based on the actual depth value.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to and the benefit of U.S. Provisional Patent Application No. 63 / 284,821, filed December 1, 2021, entitled "Bone Reamer Video Based Navigation," the entire disclosure of which is incorporated herein by reference for all purposes. [Background technology]

[0002] The anterior cruciate ligament (ACL) serves as the primary mechanical restraint in the knee to resist anterior translation of the tibia relative to the femur. Similarly, the posterior cruciate ligament (PCL) serves as a mechanical restraint to resist posterior translation of the tibia relative to the femur. These cruciate ligaments contribute greatly to the stability of the knee, and ACL injuries are extremely common. Most ACL injuries are complete ruptures of the ligament.

[0003] Because ACL injuries are common in young, active patients, reconstruction of the ACL is performed to allow return to activity. The goal is to restore stability to the knee and reduce the possibility of further damage to the meniscus and articular cartilage that leads to osteoarthritis. Reconstruction may consist of placing a substitute graft (e.g., an autograft from the middle third of the patellar tendon or from the hamstring tendon). Both ends of the graft are placed into respective tunnels prepared through the femur and tibia. The ends of the graft may be attached using interference screws or a suspension fixation device such as the ENDOBUTTON® brand fixation device manufactured by Smith & Nephew, Inc., Andover, Massachusetts, USA.

[0004] One step in performing ACL reconstruction surgery involves drilling the femoral socket with a reamer. For certain types of fixation devices (e.g., adjustable loop or continuous loop), it may be desirable to achieve a specific target socket depth. Drilling the femoral socket too deep may create a thin bone wall too close to the cortex. As a result, in some cases, the thin bone wall may cause the ACL reconstruction to fail. Summary of the Invention

[0005] In some examples, the method includes reading, by a surgical controller via the arthroscope, a portion of a machine-readable pattern on the reamer visible within the surgical site, determining, by the surgical controller, an actual depth of the reamer within the bone based on the portion of the machine-readable pattern, and displaying, by the surgical controller, on a display device, a value indicative of the actual depth of the reamer within the bone.

[0006] In some embodiments, the surgical controller includes a processor configured to couple to the display device; and a memory coupled to the processor that stores instructions that, when executed by the processor, cause the processor to: receive one or more images of a visible portion of a reamer to be used at a surgical site on a bone, the one or more images including a portion of a machine-readable pattern included on the reamer; determine a value indicative of a parameter associated with the reamer based on the portion of the machine-readable pattern included on the reamer; and display, on the display device, the value indicative of the parameter.

[0007] In some examples, the intra-operative method includes displaying, by the surgical controller, on a display device, a value indicative of a parameter associated with a reamer visible within the surgical site, determining whether the value indicative of the parameter satisfies a parameter threshold, and in response to determining that the value indicative of the parameter satisfies the parameter threshold, controlling operation of a drill associated with the reamer at the surgical site by modifying an operational parameter of the drill.

[0008] In some embodiments, the surgical controller includes a processor configured to couple to the display device; and a memory coupled to the processor that stores instructions that, when executed by the processor, cause the processor to: obtain one or more images of a portion of a machine-readable pattern on a reamer at a surgical site via an arthroscope; determine coordinates of a location of the machine-readable pattern in three-dimensional coordinate space based on the images; determine an actual depth of the reamer within the bone at the surgical site based on the coordinates of the location and the bone shape information mapped to the three-dimensional coordinate space; and display, on the display device, a value indicative of the actual depth of the reamer. [Brief description of the drawings]

[0009] For a detailed description of the exemplary embodiments, reference is now made to the accompanying drawings.

[0010] [Figure 1] FIG. 1 shows an anterior or front view of the right knee with the patella removed.

[0011] [Diagram 2] FIG. 2 shows a posterior or back view of the right knee.

[0012] [Diagram 3] FIG. 3 shows a view of the femur from below, looking into the intercondylar notch.

[0013] [Figure 4] FIG. 4 illustrates a surgical system according to at least some embodiments.

[0014] [Diagram 5] FIG. 5 illustrates a conceptual diagram of a surgical site with various objects being tracked within the surgical site, according to at least some embodiments.

[0015] [Figure 6]FIG. 6 is an exemplary video display showing a portion of a femur with visible bone reference points therein, according to at least some embodiments.

[0016] [Figure 7] FIG. 7 is an exemplary video display illustrating intraoperative changes to the tunnel path, according to at least some embodiments.

[0017] [Figure 8] FIG. 8 is an exemplary reamer including a machine-readable pattern according to at least some embodiments.

[0018] [Figure 9] FIG. 9 is an exemplary video display showing a portion of a machine-readable pattern of a reamer inserted into bone according to at least some embodiments.

[0019] [Figure 10] FIG. 10 is an exemplary video display for configuring a target depth of a tunnel path according to at least some embodiments.

[0020] [Figure 11] FIG. 11 is an exemplary method for intraoperative determination of reamer depth within bone, according to at least some embodiments.

[0021] [Figure 12] FIG. 12 is an exemplary method for controlling a drill based on a determined depth of the reamer within the bone, according to at least some embodiments.

[0022] [Figure 13A] FIG. 13A is an exemplary method for determining reamer depth based on coordinate space, according to at least some embodiments.

[0023] [Figure 13B]FIG. 13B is an exemplary method for reducing the field of view to determine reamer depth based on coordinate space, according to at least some embodiments.

[0024] [Figure 14] FIG. 14 illustrates a computer system according to at least some embodiments.

[0025] definition Various terms are used to refer to particular system components. Different companies may refer to a component by different names, and this document does not intend to distinguish between components that differ in name but not function. In the following discussion and claims, the terms "including" and "comprises" are used in an open-ended manner and should therefore be interpreted to mean "including, but not limited to." Additionally, the terms "couple" or "couples" are intended to mean either an indirect or direct connection. Thus, when a first device is coupled to a second device, the connection may be by a direct connection or an indirect connection via another device or other connection.

[0026] An endoscope having a "single optical path" through the endoscope is intended to mean that the endoscope is not a stereoscopic endoscope that has two separate optical paths separated by the interocular distance at the focusing end of the endoscope. The fact that an endoscope has two or more optical elements (e.g., glass rods, optical fibers) that form a single optical path does not negate the status of a single optical path.

[0027] "Through hole" is intended to mean an opening or passageway through an underlying device. However, the term "through hole" should not be construed as implying any method of construction. Thus, through holes may be made in any suitable manner, such as by drilling, punching, laser drilling, casting, etc.

[0028] "Counterbored hole" is intended to mean an opening or passageway into an underlying device. When a counterbored hole intersects another opening (e.g., a through hole), the counterbored hole may thereby define an internal shoulder. However, the term "counterbored hole" should not be construed as implying any method of construction. Counterbored holes may be made in any suitable manner, such as drilling, punching, laser drilling, casting, etc.

[0029] The terms "input" and "output," when used as nouns, refer to connections (e.g., electrical, software) and are not to be construed as verbs requiring an action. For example, a timer circuit may define a clock output. An exemplary timer circuit may create or drive a clock signal on a clock output. In a system implemented directly in hardware (e.g., on a semiconductor substrate), these "inputs" and "outputs" define electrical connections. In a system implemented in software, these "inputs" and "outputs," respectively, define parameters that are read or written by instructions that implement a function.

[0030] "Controller" shall mean, alone or in combination, discrete circuit components, an application specific integrated circuit (ASIC), a microcontroller with control software, a reduced instruction set computing (RISC) with control software, a digital signal processor (DSP), a processor with control software, a programmable logic device (PLD), or a field programmable gate array (FPGA) configured to read inputs and drive outputs in response to the inputs.

[0031] "Real-time" may refer to an action, operation, method, function, command, etc. that is performed within two seconds. "Near real-time" may refer to an action, operation, method, function, command, etc. that is performed between two seconds and one minute. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0032] The following discussion is directed to various embodiments of the present disclosure. Although one or more of these embodiments may be preferred, the disclosed embodiments should not be construed as limiting the scope of the present disclosure, including the claims, and should not be used in other ways. In addition, those skilled in the art will understand that the following description has broad application, and that the discussion of any embodiment is intended to be merely an example of that embodiment, and is not intended to imply that the scope of the present disclosure, including the claims, is limited to that embodiment.

[0033] Various examples are directed to methods and systems for ligament reconstruction. Ligament repair (e.g., anterior cruciate ligament (ACL) repair) may be performed arthroscopically and may be computer-assisted. Some examples include methods and systems that use an endoscopic optical system that includes an arthroscope and an attached camera head. The endoscopic optical system may be used to read at least a portion of a machine-readable pattern on a reamer attached to a drill as the reamer drills a hole in the bone. A surgical controller may receive the read portion of the machine-readable pattern (e.g., one or more images) and determine one or more parameters associated with the reamer, the bone, the drill, or some combination thereof. For example, the surgical controller may determine one or more parameters including an actual depth of the reamer in the bone at the surgical site, a diameter of the reamer, an identifier of the reamer, or some combination thereof. The surgical controller may control operation of a drill associated with the reamer based on the one or more parameters. In some embodiments, a notification may be shown on a display device if a threshold depth value is about to be reached or exceeded.

[0034] Various embodiments have been developed in relation to ACL repair, and therefore the following discussion is based on the state of the art. However, the technology is applicable to many types of ligament repair, such as medial collateral ligament repair, lateral collateral ligament repair, and posterior cruciate ligament repair. Moreover, various exemplary methods and systems can also be used to plan and place anchors for soft tissue reattachment, such as hip labrum, shoulder, or meniscus root reattachment. Thus, the present specification and the state of the art should not be construed as limiting the applicability of the present teachings. To orient the reader, the present specification begins with a description of the knee.

[0035] FIG. 1 illustrates an anterior or frontal view of a right knee with the patella removed. In particular, visible in FIG. 1 is an inferior portion of a femur 100 including a lateral or lateral condyle 102 and a medial or medial condyle 104. The femur 100 and condyles 102, 104 are in operative relationship to a tibia 106 including a tibial tuberosity 108 and a Gördi tubercle 110. Disposed between the femoral condyles 102, 104 and the tibia 106 are a lateral meniscus 112 and a medial meniscus 114. Several ligaments are visible in the view of FIG. 1, such as an ACL 116 that extends from the lateral side of the femoral notch to the medial side of the tibia 106. Conversely, a posterior cruciate ligament 118 extends from the medial side of the femoral notch to the tibia 106. Also visible is a fibula 120, as well as several additional ligaments not specifically labeled.

[0036] FIG. 2 shows a posterior or back view of a right knee. In particular, visible in FIG. 2 is an inferior portion of a femur 100 including a lateral condyle 102 and a medial condyle 104. The femur 100 and femoral condyles 102, 104 are again in operative relationship to a tibia 106 with a lateral meniscus 112 and a medial meniscus 114 disposed between the femoral condyles 102, 104 and the tibia 106. FIG. 2 further shows an ACL 116 extending from the lateral side of the femoral notch to the medial side of the tibia 106, although its attachment point to the tibia 106 is not visible. A posterior cruciate ligament 118 extends from the medial side of the femoral notch to the tibia 106, although its attachment point to the femur 100 is not visible. Again, several additional ligaments are shown which are not specifically labeled.

[0037] The most common ACL injury is a complete rupture of the ligament. The procedure involves reconstructing the ACL by placing a substitute graft (e.g., an autograft from either the patellar tendon, the quadriceps tendon, or the hamstring tendon). The graft is placed inside prepared tunnels in the femur 100 and the tibia 106. The current standard of care for ACL repair is to place the tunnels so that the tunnel entry point for the graft is at the anatomical attachment location of the native ACL. This tunnel placement at the attachment location of the native ACL attempts to replicate the kinematic properties of the original knee. In arthroscopic surgery, the location of the tunnel through the tibia 106 is relatively easy to reach, especially when the knee is bent and flexed. However, the tunnel through the femur 100 resides in the intercondylar notch. Depending on the size of the patient and how the surgeon chooses the location of the port, which is a percutaneous port through which various instruments are inserted into the knee, it may be difficult to reach the attachment location of the native ACL to the femur 100.

[0038] FIG. 3 shows a view of the femur from below, looking into the intercondylar notch. Particularly visible in FIG. 3 are the lateral condyle 102 and the medial condyle 104. Defined between the femoral condyles 102, 104 is a femoral notch 200. The femoral tunnel may define a medial opening 202 in the femoral notch 200, which is proximal to the lateral condyle 102 and displaced to the posterior portion of the femoral notch 200. The femoral tunnel extends through the femur 100 and forms an outer opening on the outer or lateral surface of the femur 100 (the outer opening is not visible in FIG. 3). FIG. 3 shows an exemplary drill wire 204 that may be used to create an initial tunnel or pilot hole. Once the surgeon has verified that the drill wire 204 is precisely aligned with the planned tunnel path, the femoral tunnel is created by drilling or reaming with another instrument (e.g., a reamer) that may use the drill wire 204 as a guide. In some cases, a socket or countersink may be created on the intercondylar notch side to accommodate the width of the graft that extends into the bone, and the countersink may also be created using another instrument (e.g., a reamer) that may use the drill wire 204 as a guide.

[0039] The drilling of the tunnel may be performed from either direction. Considering again the femoral tunnel as an example, the tunnel may be drilled from the lateral portion of the femur 100 toward and into the femoral notch 200, which is referred to as an "outside-in" procedure. Conversely, the exemplary femoral tunnel may be drilled from the interior of the femoral notch 200 toward and into the lateral portion of the femur 100, which is referred to as an "inside-out" procedure. The various examples described below are equally applicable to outside-in or inside-out procedures. In an outside-in procedure, a device may additionally be used to hold the drill wire on the lateral portion and physically indicate the expected tunnel location of the internal opening inside the knee. However, the device for the outside-in procedure is difficult to use in an arthroscopic procedure, so an inside-out procedure is used in many arthroscopic repairs. Thus, the further examples described below are based on an inside-out procedure, but this should not be construed as limiting. The specification now turns to a description of an exemplary surgical system.

[0040] 4 illustrates a surgical system (not to scale) according to at least some embodiments. In particular, the exemplary surgical system 400 includes a tower or equipment cart 402, an exemplary mechanical ablation instrument 404, an exemplary plasma-based ablation instrument (hereafter simply ablation instrument 406), and an exemplary form of an endoscope consisting of an arthroscope 408 and an attached camera head 410. The equipment cart 402 may include a camera 412 (illustratively shown as a stereoscopic camera), a display device 414, an ablation controller 416, and a camera control unit (CCU), along with an endoscope light source and video controller 418. In an exemplary case, the CCU and video controller 418 not only provides light to the arthroscope 408 and displays images received from the camera head 410, but also implements various additional aspects such as, for example, determining values ​​of one or more parameters associated with the reamer (e.g., actual depth of the reamer in the bone, diameter of the reamer, reamer identifier, etc.), displaying the values ​​of the one or more parameters on the display device 414, receiving input to modify operational parameters of a drill associated with the reamer (e.g., revolutions per minute, power on / off, drill direction, etc.), and controlling operation of the drill based on the one or more parameters. Thus, hereinafter, the CCU and video controller are referred to as a surgical controller 418. However, in other cases, the CCU and video controller may be separate systems that are separate from the controller that handles aspects of intraoperative changes, although the separate devices would still be operatively coupled.

[0041] The exemplary device cart 402 further includes a pump controller 422 (e.g., a single or paired peristaltic pump). Fluid connections between the mechanical ablation instrument 404 and the ablation instrument 406 are not shown to avoid overcomplicating the drawing. Similarly, fluid connections between the pump controller 422 and the patient are not shown to avoid overcomplicating the drawing. In the exemplary system, both the mechanical ablation instrument 404 and the ablation instrument 406 are coupled to an ablation controller 416, which is a dual function controller. However, in other cases, a separate and distinct mechanical ablation controller may be provided from the ablation controller. The exemplary devices and controllers associated with the device cart 402 are merely illustrative, and other examples include vacuum pumps, patient positioning systems, robotic arms that hold various instruments, ultrasonic cutting devices and associated controllers, patient positioning controllers, and robotic surgical systems.

[0042] FIG. 4 further illustrates additional instruments that may be present during an exemplary ACL repair. In particular, FIG. 4 illustrates an exemplary guide wire or drill wire 424 and a sight 426. The drill wire 424 may be used to create an initial or pilot tunnel through the bone. In some cases, the diameter of the drill wire may be approximately 2.4 millimeters (mm), although larger or smaller diameters may be used for the drill wire 424. The exemplary drill wire 424 is illustrated with enlarged portions at both ends, one enlarged portion showing a cutting element on the distal end of the drill wire 424 and another enlarged portion showing a connector for coupling to a chuck of a drill. Once the surgeon has drilled the pilot tunnel, the surgeon and / or surgical controller 418 (described further below) may then evaluate whether the pilot tunnel matches or nearly matches the planned tunnel path. If the pilot tunnel is deemed sufficient, the drill wire 424 may be used as a guide to create a full diameter through hole for the tunnel, or alternatively, may be used as a guide to create a counterbored hole arising from the intercondylar notch to accommodate the graft. In some cases, the drill wire may be used alone when creating the pilot tunnel, while in still other cases the surgeon may use the sight 426 to help guide and place the drill wire 424 at the designed tunnel entry location.

[0043] 4 also illustrates that the exemplary system may include a calibration assembly 428. As described in more detail below, the calibration assembly 428 may be used to detect optical distortions in images received by the surgical controller 418 via the arthroscope 408 and attached camera head 410.

[0044] There will be additional tools and instruments, such as a drill 429 for drilling holes with the drill wire 424, various reamers 431 for creating the through and counterbored aspects of the tunnel, and various tools for suturing and anchoring the graft in place, some of which are not shown so as not to further clutter the drawing.

[0045] The document now turns to a description of an exemplary workflow for ACL repair. The workflows can be conceptually categorized into pre-operative planning and intra-operative repair. The intra-operative repair workflow can be conceptually further categorized into optical system calibration, model registration, intra-operative tunnel path planning, intra-operative and tunnel creation. Each will be addressed in turn.

[0046] Preoperative planning

[0047] According to various embodiments, ACL repair begins with preoperative imaging (e.g., x-ray imaging, computed tomography (CT), magnetic resonance imaging (MRI)) of the patient's knee, including the lower portion of the femur, the upper portion of the tibia, and associated anatomical structures such as articular cartilage. The following description assumes MRI imaging, although again, many different types of imaging may be used. The MRI imaging may be segmented from image slices to create a volumetric or three-dimensional model of the anatomical structures. Any suitable currently available or later developed segmentation technique may be used to create the three-dimensional model. More specifically for the ACL repair example, a three-dimensional bone model is created for the lower portion of the femur, including the femoral condyles, with a specific selection of a tunnel path through the femur.

[0048] Using the three-dimensional bone model, a surgical plan is created that includes selecting a planned tunnel path through the femur, including the location of the bone opening that defines the end of the tunnel. For an exemplary inside-out repair, the opening in the femoral notch is the entry location for the drilling, and the opening on the lateral surface of the femur is the exit location. For an outside-in repair, the entry and exit locations for the drilling are swapped. Nevertheless, assuming an inside-out repair, the entry location may be selected to be the same or close to the attachment location of the native ACL to the femur in the femoral notch. In some cases, the selection of the entry location in the femoral notch may include using Bernard & Hertel quadrants or grids placed on the fluoroscopic image, or placing the Bernard & Hertel quadrants on a simulated fluoroscopic image created from the three-dimensional bone model. The entry location of the tunnel is selected based on the use of the Bernard & Hertel quadrants. In the case of an inside-out repair, the choice of exit location is not limited not only because a portion of the tunnel proximal to the exit location is used for placement of the graft anchor, but also because the exit location is approximately in the center of the femur (considered anterior to posterior), so issues of bone wall thickness at the exit location are not of concern. In some cases, a three-dimensional bone model of the proximal end of the tibia is also created, and the surgeon may similarly select the planned tunnel path through the tibia.

[0049] The results of the pre-operative planning may include a three-dimensional bone model of the distal end of the femur, a three-dimensional bone model for the proximal end of the tibia, entry and exit locations through the femur and thus a planned tunnel path through the femur, and entry and exit locations through the tibia and thus a planned tunnel path through the tibia.

[0050] In some embodiments, using the three-dimensional bone model, the surgeon may select a planned value for the socket or countersink depth of the reamer into the bone. The surgeon may select the socket or countersink depth so that a socket that is too long is not created, thereby resulting in a thin bone wall that is too close to the cortex. A bone wall that is thin and too close to the cortex may result in a failed ACL reconstruction. Additionally, using the three-dimensional bone model, the surgeon may select a tunnel through-hole diameter, a countersink diameter, etc. One or more reamers may be selected based on the diameter of the tunnel through-hole diameter and / or the countersink diameter.

[0051] In some embodiments, the three-dimensional bone model may include a virtual representation of the patient's imaged bones mapped into a three-dimensional coordinate space (e.g., a virtual space) in which the bone's dimensions, size, density, length, width, depth, height, shape, position, configuration, orientation, etc. may be accurately represented.

[0052] Other surgical parameters, such as the desired post-restoration curvature, as well as the like, may also be selected during pre-operative planning, although those additional surgical parameters are omitted so as not to overly complicate the specification.

[0053] Intraoperative repair

[0054] The present specification now turns to a description of the intraoperative aspects. The intraoperative aspects include steps and procedures for setting up the surgical system to perform various repairs. However, it should be noted that some of the intraoperative aspects (e.g., calibration of the optical system) may be performed before any ports or incisions are made through the patient's skin, and in fact, before the patient is brought into the operating room. Nevertheless, such steps and procedures may be considered intraoperative because they are performed in a surgical setting with the surgical instruments and tools used to perform the actual repairs.

[0055] The exemplary ACL repair is performed arthroscopically and is computer-assisted in the sense that the surgical controller 418 is used for arthroscopic navigation within the surgical site. More specifically, in the exemplary system, the surgical controller 418 provides computer assistance during ligament repair by tracking the positions of various objects within the surgical site, such as the positions of bones within the three-dimensional coordinate space of the arthroscopic field of view, the position of a reamer within the three-dimensional coordinate space of the arthroscopic field of view, and the positions of various instruments (e.g., drill wire 424, sight 426) within the three-dimensional coordinate space of the arthroscopic field of view. This specification turns to a brief description of such tracking techniques.

[0056] Figure 5 shows a schematic diagram of a surgical site with various objects present within the surgical site. In particular, visible in Figure 5 are the distal end of an arthroscope 408, a portion of a bone 500 (e.g., the femur), a bone reference point 502 within the surgical site, a touch probe 504, and a probe reference point 506. Each will be addressed in turn.

[0057] The distal end of arthroscope 408 is designed and constructed to illuminate the surgical site with visible light. In the example of FIG. 5, the illumination is indicated by arrow 508. Illumination delivered to the surgical site is reflected by various objects and tissues within the surgical site, and the reflected light returning to the distal end enters arthroscope 408, propagates along optical channels within arthroscope 408, and ultimately enters a capture array within camera head 410 (FIG. 4). Images detected by the capture array within camera head 410 are electronically transmitted to surgical controller 418 (FIG. 4) and displayed on display device 414 (FIG. 4). According to an exemplary system, arthroscope 408 has a single optical path through the arthroscope for capturing images of the surgical site, although a single optical path may be constructed from two or more optical members (e.g., glass rods, optical fibers). That is, in the exemplary system and method, the computer-assisted navigation provided by the arthroscope 408, camera head 410 and surgical controller 418 is provided with an arthroscope 408 that is not a stereoscopic endoscope having two separate optical paths separated by the interocular distance at the distal end endoscope.

[0058] During a surgical procedure, the surgeon selects an arthroscope that has a viewing direction that is useful for the planned surgical procedure. The viewing direction refers to a straight line that is centered on the angle formed by the outer or peripheral edge of the endoscope's field of view. The viewing direction for some arthroscopes is aligned with the arthroscope's central longitudinal axis, and such arthroscopes are referred to as "0 degree" arthroscopes (e.g., the angle between the viewing direction and the arthroscope's central longitudinal axis is 0 degrees). The viewing direction of other arthroscopes forms a non-zero angle with respect to the arthroscope's central longitudinal axis. For example, with a 30° arthroscope, the viewing direction forms a 30° angle with respect to the arthroscope's central longitudinal axis, and this angle is measured as an obtuse angle beyond the distal end of the arthroscope. In many cases in ACL repair, the surgeon selects a 30° or 45° arthroscope based on the location of the port created through the patient's skin. In the embodiment of FIG. 5, a viewing angle 510 of the arthroscope 408 forms a non-zero angle with respect to a central longitudinal axis 512 of the arthroscope 408 .

[0059] Still referring to FIG. 5, within the field of view of the arthroscope 408 is a portion of a bone 500 along with bone reference points 502, a touch probe 504, and a probe reference point 506. Although the bone reference points 502 are shown as planar elements having a pattern disposed thereon, other shapes for the bone reference points 502 may be used (e.g., a square block having a pattern on each face of the block). The bone reference points 502 may be attached to the bone 500 in any suitable form (e.g., fasteners such as screws). The pattern of the bone reference points is designed to provide information regarding the orientation of the bone reference points 502 within the three-dimensional coordinate space of the field of view of the arthroscope 408. More specifically, the pattern is selected such that the orientation of the bone reference points 502, and therefore the orientation of the underlying bone 500, may be determined from images captured by the arthroscope 408 and attached camera head 410 (FIG. 4).

[0060] The probe reference point 506 is shown as a planar element attached to the touch probe 504. The touch probe 504 may be used to "paint" the faces of the bone 500 as part of the registration of the bone 500 to the three-dimensional bone model, as described further below, and the touch probe 504 may also be used to indicate a revised tunnel entry location if the tunnel path is changed intraoperatively. Although the probe reference point 506 is shown as a planar element having a pattern disposed thereon, other shapes for the probe reference point 506 may be used (e.g., a square block surrounding the touch probe 504 with a pattern on each face of the block). The pattern of the probe reference point 506 is designed to provide information regarding the orientation of the probe reference point 506 within the three-dimensional coordinate space of the field of view of the arthroscope 408. More specifically, the pattern is selected such that the orientation of the probe reference point 506, and therefore the location of the points of the touch probe 504, may be determined from images captured by the arthroscope 408 and attached camera head 410 (FIG. 4).

[0061] Other instruments in the field of view of the arthroscope 408, such as drill wire 424 (FIG. 4) and sight 426 (FIG. 4), may also have reference points, although the additional instruments are not shown so as not to overly complicate the drawing. Moreover, in addition to or instead of tracking the position based on the view through the arthroscope 408, the position of one or more distal ends of the instruments may be tracked by other methods and systems. For example, in the case of an instrument that extends rigidly out of the surgical site, such as sight 426 (FIG. 4), the position may be tracked by an optical array coupled to the sight and viewed by a camera 412 (FIG. 4), such as a stereoscopic camera. The position in the three-dimensional coordinate space of the camera 412 is then transformed to the three-dimensional coordinate space of the field of view of the exemplary arthroscope to determine the position of the distal end within the surgical site.

[0062] The images captured by the arthroscope 408 and attached camera head 410 are subject to optical distortion in many forms. For example, the field of view between the distal end of the arthroscope 408 and the bone 500 in the surgical site is filled with liquids, such as bodily fluids and saline used to distend the joint. Many arthroscopes have one or more lenses at the distal end that widen the field of view, which creates a "fish-eye" effect in the captured image. Additionally, the optical elements (e.g., rod lenses) within the arthroscope may have optical aberrations inherent to the manufacturing and / or assembly process. Still further, the camera head 410 may have various optical elements for focusing the received images onto the capture array, which may have aberrations inherent to the manufacturing and / or assembly process.

[0063] -Calibration of optical systems

[0064] In an exemplary system, prior to use in each surgical procedure, the endoscopic optical system is calibrated to account for various optical distortions. In particular, various embodiments include a system for calibrating an endoscopic optical system. Referring again to FIG. 4 , the exemplary system includes a surgical controller 418, an arthroscope 408, a camera head 410, and a calibration assembly 428. In particular, the calibration may include placing the arthroscope 408 in the calibration assembly 428. The calibration assembly 428 holds the arthroscope 408 in a fixed relationship to a calibration target on an inner surface of the calibration assembly 428. Once the distal end of the arthroscope 408 is placed in the calibration assembly 428, an exemplary method includes capturing multiple images of the calibration target, each image captured with a unique rotational relationship between the camera head 410 and the arthroscope 408, the unique rotational relationship being relative to a central longitudinal axis of the arthroscope 408. Using the multiple images, the example surgical controller 418 creates a characterization function that characterizes the optical distortion between the calibration target and the capture array in the camera head 410. The characterization function may include calibration to determine the orientation of fiducial markers (e.g., bone fiducials 502, probe fiducials 506) visible within the surgical site by the arthroscope 408 and attached camera head 410.

[0065] -Model registration and human-in-the-loop registration validation

[0066] The next exemplary step in the intraoperative procedure is the registration of the bone model created during preoperative planning. That is, during the preoperative planning stage, preoperative imaging (e.g., MRI) of the knee is performed, including the lower part of the femur, the upper part of the tibia, and related anatomical structures such as articular cartilage. The preoperative imaging may be segmented such that a volumetric or three-dimensional model of the anatomical structures is created. More specifically for the example of ACL repair, a three-dimensional bone model of the lower part of the femur is created at the time of preoperative planning, with a specific selection of a tunnel path through the femur. Furthermore, the depth of the tunnel path may be selected, and the diameter of the tunnel may be selected. The depth and diameter may be represented in the volumetric or three-dimensional model (e.g., a virtual space including axes and coordinates (e.g., X, Y, Z)).

[0067] During intraoperative repair, the three-dimensional bone model is provided to the surgical controller 418. Again using the example of ACL repair, specifically computer-assisted navigation for a tunnel path through the femur, the three-dimensional bone model of the lower portion of the femur is provided to the surgical controller 418. Thus, while the surgical controller 418 receives the three-dimensional bone model, assuming that the arthroscope 408 is inserted into the knee via a port through the patient's skin, the surgical controller 418 also receives a video image of the femur. In order to correlate the three-dimensional bone model to the images received via the arthroscope 408 and camera head 410, the surgical controller 418 registers the three-dimensional bone model to the images of the femur received via the arthroscope 408 and camera head 410.

[0068] According to an exemplary method, a fiducial marker or bone reference point (e.g., bone reference point 502 in FIG. 5) is attached to the femur. The placement of the bone reference point is such that it is within the field of view of the arthroscope 408, but is spaced away from the expected tunnel entrance / exit through the lateral condyle. More specifically, in the exemplary case, the bone reference point is placed in the intercondylar notch, above or superior to the expected location of the tunnel through the lateral condyle.

[0069] FIG. 6 is an exemplary video display showing a portion of a femur and a bone reference point. The display may be shown, for example, on a display device 414 (FIG. 4) associated with the equipment cart 402 (FIG. 4) or in any other suitable location. In particular, visible in FIG. 6 is a femoral or intercondylar notch 600, a portion of a lateral condyle 602, a portion of a medial condyle 604, and an exemplary bone reference point 606. The bone reference point 606 is a reference point that comprises a cubical member. Of the six exterior faces of the cubical member, the bottom face is associated with an attachment mechanism (e.g., a screw). The bottom face is adjacent or abuts the bone when the bone reference point 606 is fixed in place, and is therefore not visible in the field of view of the arthroscope 408 (FIG. 4). The exterior face opposite the bottom face includes a placement mechanism that is used to hold the bone reference point 606 prior to placement and to attach the bone reference point 606 to the underlying bone. Of the four remaining exterior faces of the cubical member (only two of the remaining faces are visible), each of the four exterior faces has a machine-readable pattern thereon, and in some cases, each machine-readable pattern is unique. Once positioned, the bone fiducials 606 represent fixed locations on the exterior surface of the bone within the field of view of the arthroscope 408, even if the position of the arthroscope 408 is moved and changed relative to the bone fiducials 606. Initially, the location of the bone fiducials 606 relative to the three-dimensional bone model is unknown to the surgical controller 418, so registration of the three-dimensional bone model is required.

[0070] For purposes of relating or registering the bone visible in the video image to the three-dimensional bone model, the surgical controller 418 (FIG. 4) is provided and therefore receives a plurality of locations of the bone's outer surface. For example, the surgeon may touch the multiple locations using a touch probe 504 (FIG. 5). As described above, the touch probe 504 includes a probe reference point 506 (FIG. 5) that is visible in the video image captured by the arthroscope 408 (FIG. 4) and camera head 410 (FIG. 4). Because the physical relationship between the distal end of the touch probe 504 and the probe reference point 506 is known by the surgical controller 418, as the surgeon touches each of the multiple locations on the bone's outer surface, the surgical controller 418 obtains additional "known" locations of the bone's outer surface relative to the bone reference point 606. Given that the touch probe 504 is a relatively rigid and inflexible instrument, in other embodiments, tracking of the touch probe 504 is by optical tracking of an optically reflective array outside the surgical site (e.g., tracking by camera 412 (FIG. 4)), but may be attached to a portion of the touch probe 504 inside the surgical site.

[0071] In some cases, receiving multiple positions of the bone's outer surface may involve the surgeon "painting" the bone's outer surface, especially if a portion of the bone's outer surface is exposed to view. "Painting" is a term of art that does not involve the application of color or pigment, but instead refers to the movement of the touch probe 504 as the distal end of the touch probe 504 touches the bone. In some embodiments, other modes of capturing the shape of the bone relative to the bone reference points 606 may include using computed tomography (CT) and / or fluoroscopy with or without contrast agents (e.g., a substance injected into an intravenous line or taken from the mouth to make the examined body part (e.g., bone tissue and structures) more clearly visible). A CT scan may use an x-ray beam that traverses the body part externally in a circular motion to obtain many different views of the same body part, and may use those images to generate a two-dimensional morphology of the body part on a video display. Fluoroscopy may refer to an imaging technique that uses fluoroscopy to obtain real-time moving images of a patient's body part. CT and / or fluoroscopy may allow for acquisition of updated images of the bone's outer surface relative to the bone reference points 606. In some embodiments, another mode of capturing the bone's shape relative to the bone reference points 606 may include using an externally tracked ultrasound probe. An external tracker may be used to identify the position and orientation of images acquired by the ultrasound probe that may be merged to identify the bone's outer surface relative to the bone reference points 606.

[0072] A video display may be displayed during the registration procedure, showing a portion of the femur, bone fiducials, and a superimposed representation of the three-dimensional bone model. The display may be shown, for example, on a display device 414 (FIG. 4) associated with the equipment cart 402 (FIG. 4) or at any other suitable location. To address potentially invalid registration between the three-dimensional bone model and the bone visible in the image, in an exemplary method and system, an initial registration between the bone visible in the video image and the three-dimensional bone model is verified using a human-in-the-loop process. More specifically, in an exemplary case, after receiving multiple locations of the outer surface of the bone visible in the image and performing an initial registration to the three-dimensional bone model, the surgical controller 418 displays a representation of the three-dimensional bone model superimposed onto the portion of the bone visible in the video image, the display and superimposition occurring on the display device 414 or at another suitable location. That is, the exemplary surgical controller 418 overlays a representation of the three-dimensional bone model (e.g., via a polygon mesh, or mesh model) onto the display of images captured by the arthroscope 408 and camera head 410, and the rotational and translational alignment of the three-dimensional bone model is correlated to the bones visible in the video image when anchored by the bone reference points 606.

[0073] The surgeon then visually inspects the superimposed representation of the three-dimensional bone model against the underlying bones visible in the video image to determine whether the registration process is correct. More specifically, the surgeon visually compares the superimposed representation of the three-dimensional bone model against the bone portions visible in the video image to determine whether the three-dimensional bone model sufficiently matches the bones visible in the video image. Much like the registration process itself, the human-in-the-loop verification of registration is a non-deterministic operation. Although slight differences between the three-dimensional bone model and the bones visible in the video image may be tolerated, the registration process may nevertheless be considered correct in the sense that the three-dimensional bone model may be reliably used to help guide the placement of a tunnel path (e.g., here, the femoral tunnel path) or in the sense that the three-dimensional bone model may be reliably used to assist the surgeon in intraoperatively modifying the planned tunnel path. In such a case, the surgeon may provide the surgical controller 418 with instructions so that the surgical controller 418 receives instructions indicating that the three-dimensional bone model is properly registered to the bones visible in the video image.

[0074] On the other hand, if the registration of the three-dimensional bone model indicates a misalignment with respect to the bone visible in the video image, the surgeon may choose to restart the registration process, such as by providing multiple positions for the bone's outer surface to the surgical controller 418, which may receive them again. The surgical controller 418 may then perform the registration procedure anew. In other cases, the surgeon may choose to provide additional positions on the bone's outer surface, and the surgical controller 418 may then perform the registration procedure using both the original positions received and the additional positions received after the registration process. This process is repeated until the surgeon approves the registration. The specification now turns to a description of intraoperative tunnel path planning.

[0075] -Tunnel route planning

[0076] Using the three-dimensional bone model, a surgical plan is created that includes a planned tunnel path through the bone, including the location of openings into the bone that define both ends of the tunnel. Additionally, a depth of the planned tunnel path is selected and a diameter of the tunnel path is selected.

[0077] However, in some cases, the surgeon may choose not to use the planned tunnel path, and thus may choose not to use the preoperatively planned entry location, exit location, or both. Such a selection may be based on any of a number of reasons. For example, during surgery, the surgeon may not be able to access the entry location for the planned tunnel path, and therefore may need to move the entry location to ensure sufficient access. As another example, during an intraoperative procedure, the surgeon may determine that the planned tunnel entry location is misaligned with respect to the attachment location of the native ACL to the femur. Still further, during an intraoperative procedure, the surgeon may determine that the tunnel entry location is too close to the posterior wall of the femur, increasing the likelihood of bone chipping, sometimes referred to as a "posterior wall blowout." Regardless of the reason for selecting a tunnel path change, the exemplary system allows the surgical controller 418 to allow the surgeon to intraoperatively select a modified tunnel entry, a modified tunnel exit (if necessary), and thus a modified tunnel path through the bone.

[0078] FIG. 7 is an exemplary video display showing intraoperative changes to a tunnel path, according to at least some embodiments. The display may be shown, for example, on a display device 414 (FIG. 4) associated with the equipment cart 402 (FIG. 4), or in any other suitable location. In particular, FIG. 7 shows a portion of a bone in a video image captured by an arthroscope 408 (FIG. 4) overlaid against a mesh model of a three-dimensional bone model and against a preoperatively selected planned tunnel path 700 including a planned tunnel entrance 702 and a planned tunnel exit 704. However, for various reasons, the surgeon may choose to modify the tunnel entrance location and / or the tunnel exit location, and thus the planned tunnel path. Thus, the surgeon may provide the modified tunnel entrance location, or simply the modified tunnel entrance 706, to the surgical controller 418 (FIG. 4), which may receive it accordingly. Providing the modified tunnel entrance 706 may include the surgeon touching a proposed location on the bone shown in the video image using a tracking tool such as touch probe 504 (FIG. 5) or sight 426 (FIG. 4). In some cases, the surgeon may select the modified tunnel entrance 706 based solely on what the surgeon sees with respect to the bone shown in the video image. As a more specific example, the surgeon may select and provide the modified tunnel entrance 706 based on a location that the sight 426 can reach. In still other cases, the surgical controller 418 may generate a simulated fluoroscopic image from the three-dimensional bone model and project a Bernard & Hertel quadrant or grid onto the simulated fluoroscopic image. The surgeon may then select the modified tunnel entrance 706 using the additional guidance provided by the Bernard & Hertel quadrant.

[0079] - Creating Tunnels

[0080] Once the modified tunnel path 710 is selected, the next step in the exemplary method is to actually create the tunnel. In most cases, creating the tunnel is a multi-step process that involves using a drill wire (e.g., drill wire 424 (FIG. 4)) to drill an initial or pilot tunnel, and then using the drill wire as a guide wire for one or more reamers to increase the diameter of the pilot tunnel to form the full diameter actual tunnel through the bone. In some cases, the actual tunnel will have a countersink hole associated with the intercondylar notch to accommodate the width of the autograft, and in such cases an additional reamer may be used to create the countersink hole.

[0081] 8 is an exemplary reamer 800 including a machine-readable pattern 802 according to at least some embodiments. The illustrated machine-readable pattern 802 includes a set of markings that are radially continuous around the reamer 800. The markings have a variable thickness. The spacing between the markings and the width of the markings may correlate to values ​​on each portion of the reamer. The values ​​may be interpreted by a processor of the surgical controller 418 as the reamer 800 spins during drilling to determine the depth of the reamer 800 within the bone. Although the markings are shown as one or more annular stripes surrounding the reamer 800, in some examples the markings may be one or more annular stripes that partially surround the reamer 800.

[0082] In some embodiments, the markings may be stamped or notched onto the reamer 800 with a diameter smaller than the diameter of the portion of the shaft of the reamer 800 that contains the cutting grooves. Such a technique may allow degradation of the markings to be minimized or reduced when the reamer 800 is drilled into the bone.

[0083] Additionally, the arthroscope and camera may view the reamer 800 while it is spinning or rotating during drilling and may transmit one or more images to the surgical controller 418. The surgical controller 418 may receive the images in real time or near real time and may determine values ​​indicative of the parameters encoded by the markings of the machine-readable pattern 802. In some embodiments, only the sides of the reamer 800 may be visible by the arthroscope and camera during drilling and the machine-readable pattern 802 may allow the depth of the reamer within the bone to be determined at a continuous or continuous pace during drilling. In some examples, the markings may resemble a bar code that is interpreted by the surgical controller 418 during drilling to determine the depth of the reamer 800 within the bone in real time or near real time. In some examples, the reamer 800 may rotate at high revolutions per minute, which may cause motion blur in the images processed. The markings may be configured to create a gradient as the reamer 800 rotates, and the gradient may vary along the length of the reamer 800. Each gradient may correlate to a particular depth value, and the surgical controller 418 may determine the depth of the reamer within the bone based on the gradient.

[0084] In some embodiments, the surgical controller 418 may limit the field of view of one or more images to a location known to include the reamer 800 inserted into the bone. For example, the surgical controller 418 may register a three-dimensional bone model to one or more images of the surgical site, as previously described herein. Thus, the surgical controller 418 may identify the central longitudinal axis of the arthroscope and drill wire and focus image processing on a smaller portion of the one or more images than is captured by the camera head. Such techniques may reduce the file size of one or more images processed by the surgical controller 418, thereby improving the use of processing and memory resources and providing a technical improvement. Based on the three-dimensional model of the arthroscope, the images, the drill wire, and / or the axis, the surgical controller 418 may crop one or more images to only include the insertion point of the reamer 800 into the bone. Other portions of the one or more images that are not proximate to the insertion point of the reamer 800 into the bone may be discarded and / or removed. The surgical controller 418 can determine the depth of the reamer 800 within the bone along an axis that is known to the surgical controller 418 (e.g., identified in a model such as a bone model and / or drill plan) and while the reamer 800 is rotating during drilling of the bone.

[0085] 9 is an exemplary video display 900 showing a portion of a machine-readable pattern 802 of a reamer 800 inserted into a bone 902, according to at least some embodiments. The video display 900 may be presented by the display device 414 of the equipment cart and / or a computing device (e.g., a smartphone, tablet, laptop, etc.) associated with the equipment cart. The video display 900 allows the surgeon to view the reamer 800 as it drills the tunnel path. Additionally, the video display 900 includes a graphical element 904 that indicates in real time or near real time the current depth of the reamer 800 within the bone 902 (e.g., an actual depth of 5 millimeters). Additionally, the graphical element 904 indicates a target depth of the socket or counterbored hole (e.g., 25 millimeters), which may be configured by the surgeon in a preoperative phase or may be defaulted. In some embodiments, the graphical element 904 may indicate the diameter of the reamer 800 as determined by the surgical controller 418 reading a portion of the machine-readable pattern 802. In some examples, the graphical element 904 may indicate an identity of the reamer 800 determined by the surgical controller 418 reading a portion of the machine-readable pattern 802 .

[0086] FIG. 10 is an exemplary video display 1000 for configuring a target depth of a tunnel path, according to at least some embodiments. The exemplary video display 1000 may be provided by a computing device (e.g., a smartphone, tablet, laptop, etc.) associated with an equipment cart. For example, the video display 1000 may be provided by a tablet that a user uses to control the target depth. The target depth may be configured during a pre-operative phase of a medical procedure. As shown, the surgeon may select various graphical elements to increase or decrease the target depth of the tunnel path. The target depth may be used as a threshold by the surgical controller 418 to determine whether to slow down the operation of the drill, stop the operation of the drill, speed up the operation of the drill, or the like. That is, the actual depth of the reamer 800 in the bone 902, as determined by the surgical controller 418 reading a portion of the machine-readable pattern 802, may be compared to the target depth, and the comparison may result in the surgical controller 418 electronically controlling the operation of the drill. The surgical controller 418 may enable the operator to continue drilling, if desired.

[0087] Software and Hardware

[0088] 11 illustrates a method of intra-operative determination of the actual depth of a reamer within a bone, according to at least some embodiments. In particular, the method begins at block 1100. The method may be performed by one or more processors, such as included in the surgical controller 418. The method may be implemented in computer instructions stored in one or more memories that are executed by the one or more processors.

[0089] At block 1102, a processor of the surgical controller 418 may use an arthroscope and a camera to read a portion of the machine-readable pattern 802 on the reamer 800 that is visible within the surgical site. The surgical controller 418 may receive one or more images of the visible portion of the reamer 800 to be used at the surgical site of the bone 902. In some embodiments, the portion of the machine-readable pattern 802 may include at least one annular stripe that surrounds the reamer 800. In some embodiments, the portion of the machine-readable pattern 802 may include a marking that only partially surrounds the reamer 800. In some embodiments, the machine-readable pattern 802 may include a set of radial markings along a central axis of the reamer 800. In some embodiments, the set of radial markings may be spaced apart by a distance that represents an actual depth value. The markings may be configured such that rotation of the reamer 800 produces a visual pattern that is interpreted by the surgical controller 418 to determine the depth of the reamer 800 within the bone 902. In one embodiment, the machine readable pattern 802, in addition to being machine readable, can be human readable (e.g., numbers) to interpret the position / depth of the reamer 800 within the bone, allowing two options for determining the position / depth of the reamer 800.

[0090] In some embodiments, a first portion of the shaft of the reamer 800 that includes the machine-readable pattern 802 may have a smaller diameter than a second portion of the shaft of the reamer 800 that includes the cutting grooves. That is, a portion of the shaft that includes the machine-readable pattern may be "necked down." Such a technique may minimize or reduce pattern erosion due to bone friction when the reamer 800 is used to drill a tunnel into the bone 902. In some embodiments, a robotic arm may assist in the positioning of the reamer 800 as the tunnel is drilled into the bone 902.

[0091] In some embodiments, prior to reading a portion of the machine-readable pattern 802 on the reamer 800, the surgical controller 418 may reduce the revolutions per minute of the reamer from a first value to a second value. For example, during a drilling operation, a drill may rotate the reamer 800 at a high revolutions per minute. The high speed rotation may cause motion blur in images captured by the camera. In some instances, the revolutions per minute of the reamer may be reduced to a threshold number so that the machine-readable pattern 802 can be clearly read.

[0092] In some embodiments, a portion of the machine-readable pattern 802 may include at least one marking including a bar code that encodes a value of the actual depth of the reamer 800 within the bone 902. The bar code may be included along the length of the reamer 800. The bar code may include one or more full or partial annular markings having a width interval and / or thickness that encodes and indicates a value of the actual depth of the reamer 800 within the bone 902. For example, the surgical controller 418 may read the last visible portion of the bar code at the entry point into the bone and determine the value of the reamer 800 within the bone 902 based on the bar code.

[0093] In some embodiments, the machine readable pattern 802 may include a set of checkmarks spaced along the length of the reamer 800. The checkmarks may refer to visual markings on the shaft of the reamer 800, where the visual markings completely or partially surround the reamer 800. The visual markings may include values, colors, shapes, letters, or some combination thereof. In some examples, the visual markings may include marks etched on the shaft of the reamer 800. In some examples, each visual marking representing each checkmark may be different or the same. Each checkmark may correlate to a particular depth of the distal end of the reamer 800 within the bone 902. In some embodiments, the checkmarks may be numbered on the reamer 800. The minimum number of checkmarks visible near the entry point into the bone 902 may be selected as the depth of the reamer 800 within the bone 902. The value of the checkmark may be looked up in a lookup table to determine the associated actual depth value of that checkmark. In some embodiments, the check marks may be counted by the surgical controller 418 as the reamer 800 is inserted into the bone 902. The number of check marks counted may indicate the depth of the reamer 800 within the bone 902.

[0094] In some embodiments, during a drilling operation, the reamer 800 may rotate at a high revolutions per minute (e.g., hundreds, thousands, hundreds of thousands, etc.), and the machine-readable pattern 802 may be affected by motion blur. The surgical controller 418 may receive images captured continuously or continuously by a camera through the arthroscope. When the reamer 800 rotates at a high revolutions per minute, the machine-readable pattern 802 may be configured to generate a gradient having a thickness, color, tone, contrast, sharpness, brightness, hue, or the like, that indicates a depth value of the reamer 800 within the bone 902. A gradient may refer to a change in intensity or color of an image or a portion of an image (e.g., corresponding to a visual marking on the reamer 800) that is identified and processed by the surgical controller 418. The surgical controller 418 may identify a gradient generated by the machine-readable pattern 802 as the reamer 800 rotates. The surgical controller 418 may determine the actual depth of the reamer 800 within the bone 902 based on the gradient and the data source. The data source may store information related to various gradients (e.g., thickness, color, hue, contrast, sharpness, brightness, hue, etc.), and the information may be associated with a particular depth value of the reamer 800 when that particular gradient is detected.

[0095] In some embodiments, a processor of the surgical controller 418 may read a portion of the machine-readable pattern 802 at a first set of coordinates in a coordinate space. The processor may receive bone geometry information mapped into the coordinate space. The bone geometry information may be represented by the three-dimensional bone model generated herein and described above. The bone geometry information may include information related to bone type, density, size, shape, length, location, orientation, configuration, condition, and the like. The processor may determine at least one of an actual depth of the reamer, an orientation of the reamer, and a trajectory of the reamer 800 based on comparing the first set of coordinates to the bone geometry information. For example, a length of a portion of the machine-readable pattern 802 and a distal end of the reamer 800 may be known by the surgical controller 418, and the coordinates of the portion of the machine-readable pattern 802 may allow a position of the reamer in the coordinate space to be determined. Additionally, a position of a desired tunnel and coordinates of an entry point to the tunnel may be known by the surgical controller 418. Based on the coordinates of the portion of the machine-readable pattern 802 and the coordinates of the entry point into the tunnel, the surgical controller 418 can determine how far the reamer 800 is inserted into the tunnel based on its length and position relative to the entry point. Additionally, based on the coordinates of the portion of the machine-readable pattern 802 and the coordinates of the entry point into the tunnel, the surgical controller 418 can determine the orientation of the reamer 800 and / or the trajectory of the reamer 800 into the bone.

[0096] At block 1104 , the processor of the surgical controller 418 may determine the actual depth of the reamer 800 within the bone 902 based on a portion of the machine-readable pattern 802 .

[0097] In some embodiments, determining the actual depth of the reamer 800 may include extracting, by the surgical controller 418, a set of depth values ​​from a portion of the machine-readable pattern 802. The surgical controller 418 may select only one of the set of depth values ​​as the actual depth.

[0098] In some embodiments, determining the actual depth of the reamer 800 within the bone may include using a chronological guide associated with a set of markings comprising the machine-readable pattern 802. The chronological guide may specify that readings of the machine-readable pattern 802 occur in a sequenced order from the distal end to the proximal end of the reamer 800, and that each portion of the machine-readable pattern 802 (e.g., markings) that is read in sequence thereafter indicates that the reamer 800 has been positioned further into the bone 902 at a particular depth. The chronological guide may be stored as a look-up table in a memory device and accessed by the surgical controller 418.

[0099] In some embodiments, in addition to the actual depth, one or more other parameters may be determined by the surgical controller 418 based on a portion of the machine-readable pattern 802. For example, the diameter of the reamer 800 may be coded in a portion of the machine-readable pattern 802. Determining the diameter of the reamer 800 to be used in real time or near real time may allow the surgeon to verify that the right size reamer 800 is being used to drill a tunnel having a desired diameter.

[0100] In some embodiments, the one or more parameters may include an identifier for the reamer 800. For example, the identifier may be encoded as a portion of the machine-readable pattern 802. The identifier may be unique for each individual reamer.

[0101] In some examples, determining the value of the parameter (e.g., actual depth, diameter, identifier) ​​may include using infrared navigation of the drill and arthroscopic camera to triangulate the position of the reamer in three-dimensional coordinate space. Triangulating the position of the reamer 800 in three-dimensional coordinate space may include identifying position coordinates of the drill and arthroscopic camera, and triangulating a point on the reamer 800 that indicates the depth of the reamer 800 within the bone 902 (e.g., using the angles from the drill and arthroscopic camera to the reamer and the distance between the camera and the arthroscopic camera).

[0102] Additionally, in another example, determining the value of the parameter may include using one or more three-dimensional positioning tools, including a fiber optic shape sensing (FOSS) system, an electromagnetic (EM) system, or some combination thereof. The three-dimensional positioning tools may be implemented at least in part as computer instructions executed by the surgical controller 418. For example, a FOSS system may include using fiber optic cables and / or fiber optic sensors to continuously track the three-dimensional shape and position of the reamer 800. Light reflected from the reamer may be received at the arthroscope and transmitted to the surgical controller 418 to determine the shape and position of the reamer in coordinate space. Based on the position of the reamer in coordinate space, the surgical controller 418 may determine the depth of the reamer within the bone (e.g., using a bone model).

[0103] At block 1106, the processor of the surgical controller 418 may display on the display device 414 a value indicative of the actual depth of the reamer 800 within the bone 902. In some embodiments, the processor of the surgical controller 418 may display on the display device 414 in real time or near real time a value indicative of the diameter of the reamer 800, an identifier of the reamer 800, the actual depth of the reamer 800 within the bone, or a combination thereof. In some embodiments, the processor of the surgical controller 418 may control the operation of the reamer 800 by modifying an operational parameter of the drill based on the parameters of the reamer 800 (e.g., the actual depth of the reamer within the bone, the diameter of the reamer, the identifier of the reamer). For example, the operational parameter may relate to a drill direction, a rotational speed (e.g., revolutions per minute), an operational state (e.g., on or off), or some combination thereof.

[0104] In some embodiments, the surgical controller 418 may receive input (e.g., via input peripherals such as a keyboard, mouse, microphone, touch screen, etc.) regarding control of operation of the reamer 800. For example, the surgeon may view the actual depth of the reamer within the bone compared to the target depth and enter input specifying slowing down or stopping drilling so as not to exceed the target depth. As a result, one or more command instructions may be sent from the surgical controller 418 to the drill to modify operational parameters. The drill and the surgical controller 418 may be communicatively coupled to one another.

[0105] In some embodiments, the surgical controller 418 may determine whether the planned depth (e.g., target depth) of the reamer 800 within the bone has been met based on the actual depth value. The surgical controller 418 may display a notification based on whether the value indicating the actual depth of the reamer within the bone is within a threshold amount from the planned depth or exceeds the planned depth. In response to determining that the planned depth has been met, the surgical controller 418 may electronically stop the drill operating the reamer 800.

[0106] 12 illustrates a method of intra-operative determination of the actual depth of a reamer 800 within a bone 902, according to at least some embodiments. In particular, the method begins at block 1100. The method may be performed by one or more processors, such as those included in the surgical controller 418. The method may be implemented in computer instructions stored in one or more memories that are executed by the one or more processors.

[0107] At block 1202, the processor of the surgical controller 418 may display on the display device 414 a value indicative of a parameter associated with the reamer 800 visible within the surgical site. The surgical controller 418 may use the arthroscope and camera to read a portion of the machine-readable pattern 802 on the reamer 800 visible within the surgical site. The surgical controller 418 may determine a value of the parameter of the reamer 800 within the bone based on the portion of the machine-readable pattern 802. In some examples, the parameter may include an actual depth of the reamer 800 within the bone 902, a diameter of the reamer 800, an identifier of the reamer 800, or some combination thereof.

[0108] At block 1204, the processor of the surgical controller 418 may determine whether the value indicative of the parameter satisfies a threshold value for the parameter. The threshold value may be configurable using the surgical controller 418. The threshold value may refer to a minimum value, a median value, a range of values, a maximum value, etc.

[0109] In response to determining at block 1206 that the value indicative of the parameter satisfies the parameter threshold, the surgical controller 418 may control operation of a drill associated with the reamer 800 at the surgical site by modifying operational parameters of the drill. The operational parameters of the drill may relate to a drilling rotation direction, a drilling rotation speed (e.g., revolutions per minute), an operational state (e.g., on or off), etc.

[0110] 13A illustrates a method 1300 of intra-operative determination of the actual depth of a reamer 800 within a bone 902, according to at least some embodiments. In particular, the method begins at block 1100. The method may be performed by one or more processors, such as included in the surgical controller 418. The method may be implemented in computer instructions stored in one or more memories that are executed by the one or more processors.

[0111] At block 1302, the processor of the surgical controller 418 may obtain one or more images of a portion of the machine-readable pattern 802 on the reamer 800 at the surgical site via the arthroscope and camera. At block 1304, the surgical controller 418 may determine coordinates of a location of the machine-readable pattern 802 in three-dimensional coordinate space based on the images. At block 1306, the surgical controller 418 may determine an actual depth of the reamer 800 within the bone 902 at the surgical site based on the coordinates of the location and bone shape information mapped into the three-dimensional coordinate space. At block 1308, the surgical controller 418 may display a value indicative of the actual depth of the reamer 800 on the display device 414.

[0112] 13B illustrates a method 1350 of reducing the field of view to determine the actual depth of the reamer 800 within the bone 902, according to at least some embodiments. In particular, the method begins at block 1100. The method may be performed by one or more processors, such as included in the surgical controller 418. The method may be implemented in computer instructions stored in one or more memories that are executed by the one or more processors.

[0113] At block 1352, the processor of the surgical controller 418 may obtain, via the arthroscope, one or more images of a portion of the machine-readable pattern on the reamer at the surgical site. At block 1354, the processor may determine coordinates of a location of the machine-readable pattern in three-dimensional coordinate space based on the one or more images and the bone model. At block 1356, the processor may reduce the field of view to an insertion region of the surgical site. The insertion region may refer to a location in coordinate space where the processor determines that the reamer has been inserted into the bone and drilled a hole in the bone. The processor may crop the region of the image considered to a small radius around the identified insertion region. Thus, the memory size of the image may be reduced since the processor has removed one or more images from consideration, thereby providing a technical improvement. At block 1358, the processor may determine, by the surgical controller, an actual depth of the reamer in the bone based on the portion of the machine-readable pattern.

[0114] FIG. 14 illustrates an exemplary computer system 1400. In one embodiment, computer system 1400 may correspond to a surgical controller 418, a tablet device in an operating room, or any other system that implements any or all of the various methods described herein. Computer system 1400 may be connected (e.g., networked) to other computer systems within a local area network (LAN), an intranet, and / or an extranet (e.g., the device cart 402 network), or at certain times, the Internet (e.g., when not being used in a surgical procedure). Computer system 1400 may be a server, a personal computer (PC), a tablet computer, or any device capable of executing a set of instructions (sequential or otherwise) that specify actions to be performed by that device. Additionally, although only a single computer system is illustrated, the term "computer" shall also be construed to include any collection of computers that individually or jointly execute a set (or sets) of instructions to perform any one or more of the methods described herein.

[0115] The computer system 1400 includes a processing unit 1402, a main memory 1404 (e.g., read only memory (ROM), flash memory, dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM)), a static memory 1406 (e.g., flash memory, static random access memory (SRAM)), and a data storage device 1408, which communicate with each other via a bus 1410.

[0116] The processing unit 1402 represents one or more general-purpose processing devices, such as a microprocessor, a central processing unit, or the like. More specifically, the processing unit 1402 may be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, or a processor implementing other instruction sets or a combination of instruction sets. The processing unit 1402 may also be one or more application-specific processing devices, such as an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), a network processor, or the like. The processing unit 1402 is configured to execute instructions to perform any of the operations and steps described herein. Once programmed with specific instructions, the processing unit 1402, and thus the entire computer system 1400, becomes an application-specific device, such as the surgical controller 418.

[0117] Computer system 1400 may further include a network interface device 1412 for communicating with any suitable network (e.g., the device cart 402 network). Computer system 1400 may also include a video display 1414 (e.g., display device 414), one or more input devices 1416 (e.g., a microphone, keyboard, and / or mouse), and one or more speakers 1418. In one exemplary embodiment, video display 1414 and input devices 1416 may be combined into a single component or device (e.g., an LCD touch screen).

[0118] The data storage device 1408 may include a computer-readable storage medium 1420 having stored thereon instructions 1422 embodying any one or more of the methodologies or functions described herein (e.g., implementing any method and any function performed by any device and / or component illustrated herein). The instructions 1422 may also reside, completely or at least partially, within the main memory 1404 and / or within the processing unit 1402 during execution thereof by the computer system 1400. Thus, the main memory 1404 and the processing unit 1402 also constitute computer-readable media. In certain cases, the instructions 1422 may further be transmitted or received over a network via the network interface device 1412.

[0119] While computer-readable storage medium 1420 is shown in the illustrated embodiment to be a single medium, the term "computer-readable storage medium" shall be interpreted to include a single medium or multiple media (e.g., a centralized or distributed database and / or associated caches or servers) that store one or more sets of instructions. The term "computer-readable storage medium" shall also be interpreted to include any medium that can store, encode, or convey a set of instructions for execution by a machine, causing the machine to perform any one or more of the methodologies of the present disclosure. Thus, the term "computer-readable storage medium" shall be interpreted to include, but is not limited to, solid-state memory, optical media, and magnetic media.

[0120] The above discussion is intended to illustrate the principles and various embodiments of the present invention. Numerous variations and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated. It is intended that the following claims be interpreted to embrace all such variations and modifications.

[0121] Terms:

[0122] 1.

[0123] reading, by a surgical controller through the arthroscope, a portion of a machine readable pattern on the reamer visible within the surgical site;

[0124] determining, by the surgical controller, an actual depth of the reamer within the bone based on a portion of the machine-readable pattern; and

[0125] displaying, by the surgical controller, on the display device a value indicative of the actual depth of the reamer within the bone.

[0126] 2. Determining the actual depth of the reamer is

[0127] extracting, by the surgical controller, a plurality of depth values ​​from a portion of the machine-readable pattern; and

[0128] The method of any clause herein, further comprising selecting only one of the plurality of depth values ​​as the actual depth.

[0129] 3. The method of any clause herein, wherein reading a portion of the machine-readable pattern further comprises reading a portion of the machine-readable pattern that includes at least one annular stripe surrounding the reamer.

[0130] 4. The method of any clause herein, wherein reading a portion of the machine-readable pattern further comprises reading a portion of the machine-readable pattern that includes at least one marking that only partially surrounds the reamer.

[0131] 5. Reading a portion of the machine readable pattern comprises:

[0132] reading a portion of the machine readable pattern at a first set of coordinates in a coordinate space;

[0133] receiving bone shape information mapped into a coordinate space; and

[0134] The method of any clause herein, further comprising determining at least one of an actual reamer depth and a reamer trajectory based on comparing the first set of coordinates to the bone shape information.

[0135] 6. The method of any one of the clauses herein, wherein reading a portion of the machine-readable pattern further comprises reading a portion of the machine-readable pattern that includes one or more checkmarks that are counted to determine an actual depth of the reamer within the bone.

[0136] 7. The method of any one of the clauses herein, wherein reading a portion of the machine-readable pattern further comprises reading a portion of the machine-readable pattern including at least one marking including a bar code encoding an actual depth value of the reamer within the bone.

[0137] 8. Reading a portion of the machine readable pattern comprises:

[0138] identifying a gradient produced by the machine readable pattern as the reamer rotates; and

[0139] 5. The method of any clause herein, further comprising determining an actual depth of the reamer within the bone based on the gradient and the data source.

[0140] 9. The method of any one of the clauses herein, wherein the machine readable pattern comprises a plurality of radial markings along a central axis of the reamer.

[0141] 10. The method of any preceding clause, wherein the multiple radial markings are spaced apart by a distance representing an actual depth value.

[0142] 11. The method of any clause herein, wherein determining an actual depth of the reamer within the bone further comprises using a time series guide associated with a plurality of markings comprising a machine readable pattern.

[0143] 12.

[0144] The method of any clause herein, further comprising decreasing the revolutions per minute of the reamer from a first value to a second value prior to reading the portion of the machine readable pattern on the reamer.

[0145] 13.

[0146] 5. The method of any clause herein, further comprising controlling operation of the reamer based on an actual depth of the reamer within the bone.

[0147] 14.

[0148] The method of any clause herein, further comprising receiving an input, the input relating to control of operation of the reamer.

[0149] 15.

[0150] determining, by the surgical controller, a diameter of the reamer based on a portion of the machine-readable pattern; and

[0151] 20. The method of any of the clauses herein, further comprising displaying, by the surgical controller, on the display device, a value indicative of the diameter of the reamer.

[0152] 16. The method of any one of the clauses herein, wherein a first portion of the reamer shaft containing the machine readable pattern has a smaller diameter than a second portion of the reamer shaft containing the cutting grooves.

[0153] 17. 13. The method of any of the clauses herein, wherein the value indicative of the actual depth of the reamer into the bone is displayed in real time or near real time.

[0154] 18.

[0155] The method of any clause herein, further comprising displaying, by the surgical controller, a notification on the display device based on whether a value indicating the actual depth of the reamer into the bone is within a threshold amount of the planned depth or exceeds the planned depth.

[0156] 19.

[0157] determining whether the planned depth of the reamer in the bone was met based on the actual depth value; and

[0158] The method of any clause herein, further comprising, in response to determining that the planned depth has been met, controlling the drill operating the reamer by at least one of electronically stopping the drill and slowing the speed of the drill.

[0159] 20. The method of any of the clauses herein, wherein the robotic arm supports positioning of the reamer.

[0160] twenty one. 1. A surgical controller comprising:

[0161] A processor configured to couple to a display device;

[0162] A memory coupled to a processor that, when executed by the processor, causes the processor to

[0163] receiving one or more images of a visible portion of a reamer to be used at a bone surgical site, the one or more images including a portion of a machine-readable pattern contained on the reamer;

[0164] determining a value indicative of a parameter associated with the reamer based on a portion of a machine-readable pattern included on the reamer;

[0165] A surgical controller comprising: a memory storing instructions to cause a value indicative of a parameter to be displayed on a display device.

[0166] twenty two. The surgical controller of any of the clauses herein, wherein the parameters include an actual depth of the reamer within the bone.

[0167] twenty three. The surgical controller of any of the clauses herein, wherein the parameter includes a diameter of the reamer.

[0168] twenty four. The instruction is to the processor:

[0169] determining whether a planned value for the parameter associated with the reamer has been met based on the value of the parameter; and

[0170] A surgical controller as described in any clause herein, further comprising: in response to determining that the planned value of the parameter has been met, electronically controlling operation of a drill associated with the reamer.

[0171] twenty five. The surgical controller of any one of the clauses herein, wherein the one or more images are received from a camera associated with an arthroscope.

[0172] 26. When the processor determines the value of the parameter, the instructions may include causing the processor to:

[0173] Identifying the gradient produced by the machine readable pattern as the reamer rotates; and

[0174] The surgical controller of any clause herein, further comprising determining a value for a parameter of the reamer in the bone based on the gradient and the data source.

[0175] 27. When the processor determines the value of the parameter, the instructions may include causing the processor to:

[0176] reading a portion of the machine readable pattern at a first set of coordinates in a coordinate space;

[0177] receiving bone shape information for a bone mapped within a coordinate space; and

[0178] The surgical controller of any of the clauses herein, further comprising: determining values ​​for a parameter of the reamer based on comparing the first set of coordinates to the bone shape information.

[0179] 28. A surgical controller as described in any clause herein, wherein if the processor determines the value of the parameter, the instructions further cause the processor to read a portion of the machine-readable pattern including one or more checkmarks that are counted to determine the value of the reamer parameter.

[0180] 29. A surgical controller as described in any clause herein, wherein if the processor determines the value of the parameter, the instructions further cause the processor to read a portion of the machine-readable pattern including at least one marking including a bar code encoding the value of the parameter of the reamer.

[0181] 30. The processor

[0182] Receives input based on the value of the parameter,

[0183] A surgical controller as described in any clause herein, for controlling operation of a drill associated with a reamer based on the input.

[0184] 31. 1. An intraoperative method comprising:

[0185] displaying, by the surgical controller, on the display device, values ​​indicative of parameters associated with the reamer visible within the surgical site;

[0186] determining whether a value indicative of the parameter satisfies a threshold value for the parameter; and

[0187] and controlling operation of a drill associated with a reamer at a surgical site by modifying an operational parameter of the drill in response to determining that a value indicative of the parameter satisfies a threshold parameter.

[0188] 32.

[0189] reading, by a surgical controller through the arthroscope, a portion of a machine readable pattern on the reamer visible within the surgical site;

[0190] 4. The intraoperative method of any of the clauses herein, further comprising determining, by the surgical controller, a value of a parameter of the reamer in the bone based on a portion of the machine-readable pattern.

[0191] 33. The intraoperative method of any of the clauses herein, wherein the parameter is an actual depth of the reamer within the bone.

[0192] 34. Determining the values ​​of the parameters of the reamer

[0193] extracting, by the surgical controller, a plurality of depth values ​​from a portion of the machine-readable pattern; and

[0194] The intraoperative method of any clause herein, further comprising selecting only one of the plurality of depth values ​​as the actual depth value.

[0195] 35. The intra-operative method of any one of the clauses herein, wherein reading a portion of the machine-readable pattern further comprises reading a portion of the machine-readable pattern that includes at least one annular stripe surrounding the reamer.

[0196] 36. The intraoperative method of any of the clauses herein, wherein reading a portion of the machine-readable pattern further comprises reading a portion of the machine-readable pattern that includes at least one marking that only partially surrounds the reamer.

[0197] 37. Reading a portion of the machine readable pattern comprises:

[0198] reading a portion of the machine readable pattern at a first set of coordinates in a coordinate space;

[0199] receiving bone shape information mapped into a coordinate space; and

[0200] 4. The intraoperative method of any of the clauses herein, further comprising determining at least one of an actual reamer depth and a reamer trajectory based on comparing the first set of coordinates to the bone shape information.

[0201] 38. The intra-operative method of any one of the clauses herein, wherein reading a portion of the machine-readable pattern further comprises reading a portion of the machine-readable pattern that includes one or more checkmarks that are counted to determine a value of a parameter of the reamer.

[0202] 39. The intraoperative method of any of the clauses herein, wherein reading a portion of the machine-readable pattern further comprises reading a portion of the machine-readable pattern including at least one marking including a barcode encoding a value of a parameter.

[0203] 40. Reading a portion of the machine readable pattern comprises:

[0204] identifying a gradient produced by the machine readable pattern as the reamer rotates; and

[0205] The intraoperative method of any clause herein, further comprising determining a value for a parameter of the reamer based on the gradient and the data source.

[0206] 41. The intraoperative method of any of the clauses herein, wherein the machine-readable pattern comprises a plurality of radial markings along a central axis of the reamer.

[0207] 42. The intraoperative method of any clause herein, wherein the multiple radial markings are spaced apart by a distance representing a value of the parameter.

[0208] 43. The intraoperative method of any one of the clauses herein, wherein determining the value of the parameter of the reamer further comprises using a time series guide associated with a plurality of markings comprising a machine-readable pattern.

[0209] 44. The intraoperative method of any of the clauses herein, further comprising determining values ​​of the parameters using infrared navigation of the drill with an arthroscopic camera to triangulate the position of the reamer in three-dimensional space.

[0210] 45. The intraoperative method of any clause herein, further comprising determining the value of the parameter using one or more three-dimensional positioning tools, including a fiber optic shape sensing (FOSS) system, an electromagnetic (EM) system, or some combination thereof.

[0211] 46. 1. A surgical controller comprising:

[0212] A processor configured to couple to a display device;

[0213] A memory coupled to a processor that, when executed by the processor, causes the processor to

[0214] obtaining, via the arthroscope, one or more images of a portion of the machine-readable pattern on the reamer at the surgical site;

[0215] determining coordinates of a location of the machine-readable pattern within three-dimensional coordinate space based on the image;

[0216] determining an actual depth of the reamer within the bone at the surgical site based on the coordinates of the location and the bone shape information mapped into the three-dimensional coordinate space; and

[0217] A surgical controller comprising: a memory storing instructions for causing a value indicative of the actual depth of the reamer to be displayed on the display device.

[0218] 47. The instruction is to the processor:

[0219] determining whether a planned actual depth value associated with the reamer has been met based on the actual depth value of the reamer; and

[0220] The surgical controller of any clause herein, further comprising: in response to determining that the planned actual depth value has been met, electronically controlling operation of a drill associated with the reamer.

[0221] 48. The surgical controller of any of the clauses herein, wherein the machine-readable pattern includes at least one annular stripe surrounding the reamer.

[0222] 49. The surgical controller of any of the clauses herein, wherein the machine-readable pattern includes at least one marking that only partially surrounds the reamer.

[0223] 50. The instruction is to the processor:

[0224] receiving input to modify operating parameters of a drill associated with the reamer based on the actual depth value of the reamer; and

[0225] The surgical controller of any clause herein, further comprising: controlling operation of the drill by modifying operational parameters of the drill.

Claims

1. reading a portion of a machine-readable pattern on a reamer visible within a surgical site by a surgical controller through an arthroscope as the reamer rotates while drilling bone; determining, by the surgical controller, an actual depth of the reamer within the bone based on the portion of the machine-readable pattern visible during the drilling; and displaying, by the surgical controller, on a display device, a value indicative of the actual depth of the reamer within the bone.

2. Determining the actual depth of the reamer comprises: extracting, by the surgical controller, a plurality of depth values ​​from the portion of the machine-readable pattern; and The method of claim 1 , further comprising selecting only one of the plurality of depth values ​​as the actual depth.

3. 2. The method of claim 1, wherein reading the portion of the machine-readable pattern further comprises reading the portion of the machine-readable pattern selected from the group consisting of at least one annular stripe surrounding the reamer and at least one marking only partially surrounding the reamer.

4. Reading the portion of the machine readable pattern comprises: reading the portion of the machine-readable pattern at a first set of coordinates in a coordinate space; receiving bone shape information mapped into said coordinate space; and 2. The method of claim 1, further comprising determining at least one of the actual depth of the reamer and the trajectory of the reamer based on comparing the first set of coordinates to the bone shape information.

5. 2. The method of claim 1, wherein reading the portion of the machine-readable pattern further comprises reading the portion of the machine-readable pattern selected from the group including one or more checkmarks that are counted to determine the actual depth of the reamer within the bone, and at least one marking including a barcode encoding a value of the actual depth of the reamer within the bone.

6. Reading the portion of the machine readable pattern comprises: identifying a gradient produced by the machine readable pattern as the reamer rotates; and The method of claim 1 , further comprising determining the actual depth of the reamer within the bone based on the gradient and a data source.

7. The method of claim 1 , wherein the machine-readable pattern comprises a plurality of radial markings along a central axis of the reamer.

8. The method of claim 7 , wherein the plurality of radial markings are spaced apart by a distance representative of the actual depth value.

9. 2. The method of claim 1, wherein determining the actual depth of the reamer within the bone further comprises using a time sequence guide associated with a plurality of markings comprising the machine readable pattern.

10. 10. The method of claim 1, further comprising decreasing a revolutions per minute of the reamer from a first value to a second value prior to reading the portion of the machine readable pattern on the reamer.

11. The method of claim 1 , further comprising controlling operation of the reamer based on the actual depth of the reamer within the bone.

12. The method of claim 11 , wherein the machine-readable pattern is also human-readable.

13. The method of claim 1 , further comprising determining, by the surgical controller, a diameter of the reamer based on the portion of the machine-readable pattern.

14. 2. The method of claim 1, wherein a first portion of the reamer shaft containing the machine readable pattern has a smaller diameter than a second portion of the reamer shaft containing cutting grooves.

15. 10. The method of claim 1, further comprising displaying, by the surgical controller, a notification on the display device based on whether the value indicating the actual depth of the reamer within the bone is within a threshold amount of a planned depth or exceeds a planned depth.

16. determining whether a planned depth of the reamer within the bone has been met based on the value of the actual depth; and 10. The method of claim 1, further comprising, in response to determining that the planned depth has been met, controlling a drill operating the reamer by at least one of electronically stopping a drill operating the reamer and slowing a speed of the drill.

17. 1. A surgical controller comprising: A processor configured to couple to a display device; a memory coupled to the processor, the memory being configured to, when executed by the processor, cause the processor to receiving one or more images of a visible portion of a reamer to be used at a surgical site on a bone, the one or more images including a portion of a machine-readable pattern contained on the reamer as the reamer rotates while drilling into the bone; determining a value indicative of a parameter associated with the reamer that is visible during the drilling based on the portion of the machine-readable pattern included on the reamer; and and a memory storing instructions to cause the controller to display, on a display device, the value indicative of the parameter.

18. The surgical controller of claim 17 , wherein the parameter is selected from a group including an actual depth of the reamer within the bone and a diameter of the reamer.

19. The instructions cause the processor to: determining whether a planned value for the parameter associated with the reamer has been met based on the value of the parameter; and 20. The surgical controller of claim 17, further comprising: in response to determining that the planned value for the parameter has been met, electronically controlling operation of a drill associated with the reamer.

20. The surgical controller of claim 17 , wherein the one or more images are received from a camera associated with an arthroscope.

21. When the processor determines the value of the parameter, the instructions cause the processor to: Identifying a gradient produced by the machine readable pattern as the reamer rotates; and The surgical controller of claim 17 , further comprising: determining the value of the parameter of the reamer in the bone based on the gradient and a data source.

22. When the processor determines the value of the parameter, the instructions cause the processor to: reading the portion of the machine readable pattern at a first set of coordinates in a coordinate space; receiving bone shape information for the bone mapped within the coordinate space; and The surgical controller of claim 17 , further comprising: determining the value of the parameter of the reamer based on comparing the first set of coordinates to the bone shape information.

23. 18. The surgical controller of claim 17, wherein when the processor determines the value of the parameter, the instructions further cause the processor to read the portion of the machine readable pattern selected from the group including: one or more checkmarks that are counted to determine the value of the parameter of the reamer, and at least one marking including a barcode encoding the value of the parameter of the reamer.

24. The processor, receiving an input based on the value of the parameter; The surgical controller of claim 17 , further comprising: a controller configured to control operation of a drill associated with the reamer based on the input.

25. 1. An intraoperative method comprising: displaying, by the surgical controller, on the display device, values ​​indicative of parameters associated with the reamer visible within the surgical site; determining whether the value indicative of the parameter satisfies a threshold value for the parameter; and responsive to determining that the value indicative of the parameter satisfies the threshold value for the parameter, controlling operation of the drill associated with the reamer at the surgical site by modifying operational parameters of the drill.

26. reading, by the surgical controller through an arthroscope, a portion of a machine readable pattern on the reamer that is visible within the surgical site; and 26. The intra-operative method of claim 25, further comprising determining, by the surgical controller, the value of the parameter of the reamer in bone based on the portion of the machine-readable pattern.

27. 27. The intraoperative method of claim 26, wherein the parameter is the actual depth of the reamer in bone.

28. Determining the value of the parameter of the reamer comprises: extracting, by the surgical controller, a plurality of depth values ​​from the portion of the machine-readable pattern; and 28. The intra-operative method of claim 27, further comprising selecting only one of the plurality of depth values ​​as the actual depth value.

29. 27. The intra-operative method of claim 26, wherein reading the portion of the machine-readable pattern further comprises reading the portion of the machine-readable pattern selected from the group consisting of at least one annular stripe circumscribing the reamer and at least one marking only partially circumscribing the reamer.

30. Reading the portion of the machine readable pattern comprises: reading the portion of the machine-readable pattern at a first set of coordinates in a coordinate space; receiving bone shape information mapped into said coordinate space; and 27. The intra-operative method of claim 26, further comprising determining at least one of the actual depth of the reamer and the trajectory of the reamer based on comparing the first set of coordinates to the bone shape information.

31. 27. The intra-operative method of claim 26, wherein reading the portion of the machine-readable pattern further comprises reading the portion of the machine-readable pattern selected from the group including one or more checkmarks that are counted to determine the value of the parameter of the reamer, and at least one marking including a barcode encoding the value of the parameter.

32. Reading the portion of the machine readable pattern comprises: identifying a gradient produced by the machine readable pattern as the reamer rotates; and 27. The intra-operative method of claim 26, further comprising determining the value of the parameter of the reamer based on the gradient and a data source.

33. 27. The intraoperative method of claim 26, wherein the machine readable pattern comprises a plurality of radial markings along a central axis of the reamer.

34. 34. The intra-operative method of claim 33, wherein the plurality of radial markings are spaced apart by a distance representative of a value of the parameter.

35. 27. The intraoperative method of claim 26, wherein determining the value of the parameter of the reamer further comprises using a time sequence guide associated with a plurality of markings comprising the machine readable pattern.

36. 27. The intraoperative method of claim 26, further comprising determining the value of the parameter using infrared navigation of a drill with an arthroscopic camera to triangulate the position of the reamer in three-dimensional space.

37. 1. A surgical controller comprising: A processor configured to couple to a display device; a memory coupled to the processor, the memory being configured to, when executed by the processor, cause the processor to acquiring, via an arthroscope, one or more images of a portion of the machine-readable pattern on the reamer at the surgical site as the reamer rotates while drilling bone; determining coordinates of a location of the machine-readable pattern in three-dimensional coordinate space based on the image; determining an actual depth of the reamer within the bone at the surgical site based on the coordinates of the location and bone shape information mapped into the three-dimensional coordinate space; and and a memory storing instructions to cause a surgical controller to display on the display device a value indicative of the actual depth of the reamer visible during the drilling.

38. The instructions cause the processor to: determining whether a planned actual depth value associated with the reamer has been met based on the value of the actual depth of the reamer; and 40. The surgical controller of claim 37, further comprising: in response to determining that the planned value for the actual depth has been met, electronically controlling operation of a drill associated with the reamer.

39. 38. The surgical controller of claim 37, wherein the machine readable pattern is selected from the group including at least one annular stripe surrounding the reamer and at least one marking only partially surrounding the reamer.

40. The instructions cause the processor to: receiving input to modify operational parameters of a drill associated with the reamer based on the value of the actual depth of the reamer; and 38. The surgical controller of claim 37, further comprising: controlling operation of the drill by modifying the operational parameters of the drill.

Citation Information

Patent Citations

  • Surgical instrument system for tracking a relative position

    EP3721826A1

  • surgical instrument system

    JP2005518245A

  • Systems and methods for non-contact determination and measurement of spatial position and / or spatial orientation of objects, in particular calibration and testing methods for medical instruments containing patterns or structures relating to medical instruments

    JP2008541966A

  • System and method for identifying a landmark

    KR1020120027252A

  • Surgical tool systems and method

    US20190314093A1