Operation method of surgical robot and surgical system
The surgical system addresses the issue of soft tissue damage in TKA by using a robotic device to identify and align implants with soft tissue attachment points, improving the safety and precision of TKA procedures.
Patent Information
- Application Number
- JP2024125791
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2018-12-27
- Filing Date
- 2024-08-01
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2039-12-19
AI Technical Summary
Traditional computer-assisted surgical systems for total knee arthroplasty (TKA) often overlook the soft tissues, leading to iatrogenic damage, ligament impingement, and other complications due to the lack of consideration for soft tissue attachment points during bone modification and implant alignment.
A surgical system incorporating a robotic device and processing circuitry that identifies soft tissue attachment points, plans implant placement based on these points, and controls surgical tools to align implants with these points, using haptic feedback to constrain tool movement and prevent collisions.
The system effectively protects soft tissues by aligning implants with their attachment points, reducing the risk of iatrogenic damage and ligament impingement, thereby enhancing the safety and precision of TKA procedures.
Smart Images

Figure 2024167212000001_ABST
Abstract
Description
[Technical field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation of U.S. Provisional Patent Application No. 62 / 785,42, filed December 27, 2018. No. 6,313,635, filed on Oct. 13, 2007. The entire disclosure of this provisional patent application is hereby incorporated by reference. will be incorporated into the subsection. [Background technology]
[0002] The present disclosure generally relates to systems and methods for computer-assisted and robotic-assisted surgery. More specifically, the present invention relates to the field of joint reconstruction surgery, e.g., total knee arthroplasty (TKA). TK is in the field of computer-assisted and robot-assisted surgical systems for KA. A is a method to treat osteoarthritis of the knee by replacing part of the knee anatomy with a prosthetic component. It is widely used to treat osteoarthritis and other injuries of the knee joint in patients with total knee arthroplasty. The patient's femur and tibia are typically prepared using a series of planar cuts to prepare the bone surfaces. The prosthetic implant is then bonded to the bone, and the artificial bone is then attached to the bone. A node is formed.
[0003] Computer-assisted surgery systems allow for bone correction and alignment of implants to the bone. However, conventional computer-assisted TKA surgery is not feasible. The surgical system of support often involves the attachment of soft tissues, such as the posterior cruciate ligament (PCL) and anterior cruciate ligament (ACL). They do not address issues related to ligaments such as the ACL and soft tissue when planning surgery. This can lead to iatrogenic damage to soft tissues and weakening of attachment points between bone and soft tissue. , impingement of ligaments by implant components, and other complications may occur. Summary of the Invention
[0004] One implementation of the present disclosure is a surgical system. The surgical system includes a robotic device, The robotic device includes a surgical tool and a processing circuit. receiving image data of the structure, generating a virtual bone model based on the image data, and Identifying soft tissue attachment points on the model and planning implant placement based on the soft tissue attachment points. A control object is generated based on the arrangement of the implant, and the robot device is controlled to control the hand. The surgical tool is configured to confine the surgical tool within the controlled object.
[0005] In some embodiments, the soft tissue attachment point is the point at which the posterior cruciate ligament or the anterior cruciate ligament attaches to the femur. In some embodiments, the processing circuitry is adapted to process the soft tissue Based on the attachment point, the axis of the implant is aligned with the medial edge of the soft tissue attachment point. The implant placement is planned using a method for planning placement of the implant.
[0006] In some embodiments, the processing circuitry further comprises a graphical user interface. The graphical user interface is configured to generate a virtual Visualization of the bone model, implant, and soft tissue attachment points. In some embodiments, The graphical user interface includes a visualization of the control object. In an embodiment, the processing circuitry is adapted to limit inclusion of the soft tissue attachment points to the control object. It is composed.
[0007] Another implementation of the present disclosure is a method, comprising receiving image data of an anatomy. generating a virtual bone model based on the image data; and soft tissue attachment of the virtual bone model. identifying soft tissue attachment points; and determining implant size and placement based on the soft tissue attachment points. generating a control object based on the size and location of the implant; The method includes constraining or controlling a surgical tool mounted on a robotic device based on the
[0008] In some embodiments, the image data comprises a computed tomography image, in which The method also includes segmenting the computed tomography image and identifying one or more bones within the image. In some embodiments, the soft tissue attachment point is the posterior cruciate ligament or the anterior cruciate ligament. The soft tissue attachment points correspond to the sites where the patellar ligament attaches to the femur or tibia. In some embodiments, the identification of the placement of the implant may correspond to the site where the implant is placed. This involves aligning the axis of the implant with the medial edge of the soft tissue attachment point.
[0009] In some embodiments, the method also includes: generating a graphical user interface for visualizing the attachment points. A graphical user interface may further visualize the control object. In an embodiment of the present invention, the method further comprises predicting a line of action of a ligament based on the soft tissue attachment points; Augmenting the virtual bone model with a virtual implant model of the implant; determining whether a line intersects with the virtual implant model and the function of the ligament; In response to identifying that a line intersects with the virtual implant model, a user is notified. The method includes limiting inclusion of the soft tissue attachment points to the control object. obtain.
[0010] Another implementation of the present disclosure, when executed by one or more processors, a non-transitory computer-readable medium storing program instructions that cause a processor of The operations include receiving image data of the anatomical structure; generating a virtual bone model; identifying soft tissue attachment points of the virtual bone model; Identifying the size and placement of the implant based on the attachment points; A control object is generated based on the size and arrangement of the control object, and a robot device is generated based on the control object. The present invention relates to a surgical instrument, and more particularly to a surgical instrument.
[0011] In some embodiments, the manipulation includes restricting inclusion of the soft tissue attachment point to the control subject. In some embodiments, the manipulation includes limiting the soft tissue attachment points based on the soft tissue attachment points. and predicting the line of action of the ligament by using the virtual bone model as a virtual implant model of the implant. augmenting the ligament with the virtual implant model; determining whether the line of action of the ligament intersects with the virtual implant model; and determining where the line of action of the ligament intersects with the virtual implant model. In some embodiments, the method further includes providing a warning to the user in response to the implant. To identify the placement of the implant, align the axis of the implant with the medial edge of the soft tissue attachment point. Included.
[0012] This summary is illustrative only and is not intended to be in any way limiting. Other aspects, inventive features, and advantages of the apparatus or process described herein may be seen in conjunction with the accompanying drawings. The above and other features of the invention will become apparent from the detailed description of the invention set forth herein. The reference numbers refer to like elements. [Brief description of the drawings]
[0013] [Figure 1] FIG. 1 is an illustration of a robotic-assisted surgery system, in accordance with an illustrative embodiment. [Diagram 2] 2 is a block diagram of a processing circuit of the surgical system of FIG. 1 in accordance with an exemplary embodiment. [Diagram 3] 1 is a flowchart of a process for facilitating arthroscopic surgery of a joint, according to an illustrative embodiment. [Figure 4] 1 is a flowchart of a process for preventing impingement in arthroscopic knee surgery, according to an illustrative embodiment. [Diagram 5] FIG. 13 illustrates the use of bone images to plan placement of implants to avoid collisions in arthroscopic knee surgery, according to an exemplary embodiment. [Figure 6] 3 is a first diagram of a graphical user interface generated by the processing circuitry of FIG. 2 in accordance with an exemplary embodiment. [Figure 7] FIG. 3 is a second diagram of a graphical user interface generated by the processing circuitry of FIG. 2 in accordance with an exemplary embodiment. [Figure 8A] FIG. 3 is a third diagram of a graphical user interface generated by the processing circuitry of FIG. 2 in accordance with an exemplary embodiment. [Figure 8B] FIG. 4 is a fourth diagram of a graphical user interface generated by the processing circuitry of FIG. 2 in accordance with an exemplary embodiment. [Figure 8C] FIG. 5 is a fifth diagram of a graphical user interface generated by the processing circuitry of FIG. 2 in accordance with an exemplary embodiment. [Figure 8D] FIG. 6 is a sixth diagram of a graphical user interface generated by the processing circuitry of FIG. 2 in accordance with an exemplary embodiment. [Figure 8E] FIG. 7 is a seventh diagram of a graphical user interface generated by the processing circuitry of FIG. 2 in accordance with an exemplary embodiment. [Figure 9] FIG. 8 is an eighth diagram of a graphical user interface generated by the processing circuitry of FIG. 2 in accordance with an exemplary embodiment. [Figure 10] 1 is a flowchart of a process for identifying the rotational alignment of an implant component according to an exemplary embodiment. [Figure 11] FIG. 11 illustrates a portion of the process of FIG. 10 in accordance with an exemplary embodiment. [Figure 12] FIG. 11 illustrates a portion of the process of FIG. 10 in accordance with an exemplary embodiment. [Figure 13] FIG. 5 is a fifth diagram of a graphical user interface generated by the processing circuitry of FIG. 2 in accordance with an exemplary embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Referring now to FIG. 1, a surgical system for orthopaedic surgery, in accordance with an exemplary embodiment, Illustrated is a surgical system 100. Generally, the surgical system 100 facilitates the planning and execution of a surgical procedure. The surgical system 100 is configured to facilitate surgical intervention based on a patient's anatomy, e.g., As shown in FIG. 1, the legs 102 of a patient 104 sitting or lying on a table 105 are supported. The leg 102 includes a femur 106 and a tibia 108, and is configured to treat a total knee joint. During arthroscopic surgery, a prosthetic knee implant is implanted. Additionally or alternatively, partial knee arthroscopy, total and / or partial hip arthroscopy , other joint surgery, spinal surgery, and any other surgical procedure (e.g., neurosurgery, orthopedic surgery, The device may be configured to facilitate the planning and execution of medical procedures (urology, gynecology, dentistry, ENT, oncology, etc.) To facilitate the surgery, the surgical system 100 includes a robotic device 120, a tracking system, and 122, and a computer system 124.
[0015] The robotic device 120, under the control of a computer system 124, performs a series of movements of the patient's anatomy ( For example, the robotic device 120 may be configured to modify the femur 106 of the patient 104. One embodiment of the present invention is a haptic device. "Haptic" refers to the sense of touch. The field of optics is, among other things, human-computer interaction, which provides feedback to the operator. Regarding interactive devices, the feedback may include tactile sensations, e.g., vibrations, etc. Feedback may also include providing a force to the user, e.g., a positive force or resistance to motion. One use of haptics can include providing feedback to the user of the device. For example, the haptic device can provide guidance or restrictions on the operation of the device. When the device is combined with a surgical tool that the surgeon can manipulate to perform a surgical procedure, The manipulation of the surgical tool by the surgeon may include providing the surgeon with a surgical tool during manipulation of the surgical tool. May be guided or limited through the use of haptics to provide feedback .
[0016] Another embodiment of the robotic device 120 is an autonomous or semi-autonomous robot. Autonomy is the ability to gather information about a situation, identify a course of action, and then By performing a series of actions automatically, it is possible to perform the actions independently or semi-independently of human control. For example, in such an embodiment, the robotic device 120 , in communication with the tracking system 122 and the computer system 124 to measure the patient's bone or soft tissue. The system may autonomously complete a series of cuts in a fabric without direct human intervention. According to the present invention, the robotic device 120 is capable of unlimited surgeon-controlled motion, haptically constrained motion, and The robot may perform various combinations of manual and / or automatic or autonomous robotic actions.
[0017] The robotic device 120 includes a base 130, a robotic arm 132, and a surgical tool 134. and is communicatively coupled to the computer system 124 and the tracking system 122. The base 130 provides a movable base for the robot arm 132. 32 and surgical tools 134 are repositioned relative to the patient 104 and table 105 as needed. The base 130 also supports a robotic arm 132 and surgical tools, as described below. 134 includes power systems, computing units, motors, and other electronic or mechanical systems necessary for the functioning of the equipment. It can be seen.
[0018] The robotic arm 132 is configured to support a surgical tool 134 and is controlled by a computer system. In some embodiments, the system 124 is configured to provide feedback indicative of the The robotic arm 132 allows a user to manipulate a surgical tool 134. In such an embodiment, the robot arm 132 provides force feedback to the joint 13. 6 and mount 138, which allow a user to mount the robotic arm 132 and the surgical tool. The ball 134 is configured to be freely movable and rotatable through the allowable positions. The motor, actuator, or other mechanism may be connected to the computer system. Some of the movements of the robotic arm 132 and surgical tool 134 are directed by the system 124. The robot provides feedback on the forces that constrain or prevent the robot from moving. The control arm 132 thereby provides force feedback (e.g., The surgeon responds by applying a force that is a force that prevents or resists the advancement of the tissue into the boundary. This allows for complete control of the surgical tools 134 within the animal. In the robot arm 132, the robot arm 132 is arranged as required and and / or a surgical tool to complete a particular surgical task, such as cutting the femur 106. The rule 134 is executed in accordance with instructions from the computer system 124 without direct user interaction. The robot is configured to automatically move to the new position.
[0019] In an alternative embodiment, the robotic device 120 may be a handheld robotic device or other In the handheld robot device, Part of the handheld robotic device (e.g., end effector, surgical tool) The user can control / actuate the handheld robot as needed. The robotic actuation portion holds, supports, and manipulates the surgical instrument while at the same time assisting the surgeon in performing the surgical procedure. For example, the handheld robotic device may be controlled to facilitate the performance of a surgical procedure. retracts the surgical cutting tool to prevent the user from operating the surgical cutting tool in an unsafe area The systems and methods described herein may be controllable to prevent various types of It should be understood that a variety of robotic device designs, configurations, etc. may be implemented.
[0020] In the embodiment shown, the surgical tools 134 are used to cut, grind, drill, and repair bone. The implant may be configured to partially resect, remodel, and / or otherwise modify the implant. The cutter 134 makes a series of cuts in the femur 106 to prepare the femur to receive the implants. The surgical tool 134 may be configured to prepare the femoral bone 106 and / or the tibia 108. The tool may be any suitable tool and may be one of a number of tools that may be interchangeably connected to the robotic device 120. For example, as shown in FIG. 1, the surgical tool 134 is a bulbous burr. The tool 134 may, for example, have blades aligned parallel to the axis of the tool or perpendicular to the axis of the tool. In other embodiments, the surgical tool 134 may be one or more of a variety of other medical devices. Therapeutic tasks (e.g., soft tissue modification, prosthetic implantation, image generation, data collection, retraction or The method may be configured to perform the steps of:
[0021] The tracking system 122 tracks the patient's anatomy (e.g., the femur 106 and the tibia 108). and the robotic device 120 (i.e., the surgical tool 134 and / or the robotic arm 13 2) and allows for control of a surgical tool 134 coupled to the robotic arm 132. , determining the location and orientation of the motion that the surgical tool 134 will perform relative to the patient's anatomy. 10, as well as the femur 106, the tibia 108, the surgical tool 134, and / or the robot. The mobile device 120 is made visible to the user on the display of the computer system 124. More specifically, the tracking system 122 is configured to track the object ( For example, the position and orientation (i.e., posture) of the surgical tool 134, femur 106, etc. , and tracking (i.e., continuously determining) the subject's pose during the surgical procedure. According to an embodiment, the tracking system 122 may be any type of navigation system, i.e. Non-mechanical tracking systems (e.g., optical tracking systems), mechanical tracking systems (e.g., , tracking based on measuring the relative angles of the joints 136 of the robot arm 132), or non-mechanical and any combination of mechanical tracking systems, etc.
[0022] In the embodiment shown in FIG. 1, the tracking system 122 comprises an optical tracking system. The tracking system 122 then tracks the first fiducial tree 14 coupled to the tibia 108. 0, a second fiducial tree 141 connected to the femur 106, and a second fiducial tree 141 connected to the base 130. a third fiducial tree 142, one or more of which are coupled to the surgical tool 134; 144 of the fiducials, and fiducials (i.e., fiducial trees A detection device 146 configured to detect the three-dimensional position of the markers 140 to 142 As shown in FIG. 1, the detection device 146 includes a pair of cameras 148 arranged in a stereoscopic configuration. The fiducial trees 140 to 142 are arranged so as to be clearly visible to the camera 148. and / or by an image processing system using data from the camera 148, e.g. For example, the reflectance of infrared radiation (e.g., emitted by the elements of the tracking system 122) A fiduciary marker that is configured to be easily detectable by being highly The stereoscopic arrangement of cameras 148 of the detector 146 captures the position of each fiducial. The location is determined in 3D space via triangulation. Each fiducial is located at the corresponding Since the fiducial has a geometric relationship with the object, tracking the fiducial allows tracking of the object. (For example, the tracking of the second fiducial tree 141 allows the tracking system 12 2 to track the femur 106), the tracking system 122 configured to perform a registration process to identify or verify geometric relationships. The specific arrangement of the fiducials in the fiducial trees 140-142 (i.e. That is, the fiducials in the first fiducial tree 140 are The fiducials are arranged in a shape different from that of the fiducials of the cal tree 141. This makes it possible to distinguish local trees, and thus tracked objects, from one another.
[0023] The tracking system 122 of FIG. 1 or some other embodiment for surgical navigation and tracking. The method of the present invention provides a method for performing a cut at or near a feature of a patient's anatomy using the above-mentioned approach. When using the surgical tool 134 to modify features of the target structure, the surgical system 100 , locating the position of the surgical tool 134 relative to the anatomical feature, e.g., the femur 106. It is possible.
[0024] The computer system 124 may generate a surgical plan based on medical images or other data. , receives data regarding the position of the surgical tool 134 and the patient's anatomy, In particular, the robotic device 120 may be configured to control the robotic device 120 in accordance with the image. According to various embodiments, the computer system 124 may perform a stenting procedure based on the location and attachment points of the soft tissue. A patient-specific surgical plan is made using the patient-specific control object that follows the surgical plan, and the locomotion is performed. The computer system 124 is configured to control the bot device 120. , communicatively coupled to the tracking system 122 and the robotic device 120 , 0, the tracking system 122, and the computer system 124. Additionally, the computer system 124 may be connected to a network, e.g. For example, accessing an electronic medical record system to obtain a patient’s medical history or other patient profiles Receive file information, medical images, surgical plans, and surgical procedure information and perform surgical procedures The computer system 124 includes a processing circuit 160 and an input In some embodiments, the first / output device 162 of the computer system 124 a computer device (e.g., located in the surgeon's office and operated by a remote server) provides preoperative characteristics and a second computer device (e.g., For example, a robotic device (located in the operating room) controls the robotic device 120 and provides intraoperative features. According to various embodiments, the features and functions attributed herein to computer system 124 include , any combination of one or more devices, servers, cloud-based computing resources, etc. It may be implemented using any combination or distribution between them.
[0025] Input / output devices 162 are connected to the user as required for the functions and processes described herein. The input / output is configured to receive input from the user and display output. The input device 162 includes a display 164 and a keyboard 166. 64 represents a graphical user interface generated by the processing circuitry 160. This may include, for example, information about surgical planning, medical images, surgical system The configuration and other options of the system 100, the tracking system 122 and the robotic device 120 Visualization of the situational information and tracking based on data provided by the tracking system 122 The keyboard 166 provides access to these graphical user interfaces. configured to receive user input and control one or more functions of the surgical system 100; can be.
[0026] The processing circuitry 160 facilitates the creation of a pre-operative surgical plan prior to a surgical procedure, The processing circuitry is configured to facilitate computer-assisted and robotic assistance in execution. An exemplary embodiment of 160 is shown in FIG. 2 and described in detail below with reference thereto. .
[0027] With further reference to FIG. 1, according to some embodiments, a “virtual bone model” is used herein. Preoperative surgical planning is patient-specific using a three-dimensional representation of the patient's anatomy, also known as a 3D representation. A "virtual bone model" is a virtual model of cartilage or other tissue in addition to bone. To obtain the virtual bone model, the processing circuitry 160 may include a virtual representation of the bone where the surgical procedure is to be performed. Receive image data of a patient's anatomy (e.g., femur 106). computed tomography (CT) and magnetic resonance imaging to image relevant anatomical features (MRI), and / or ultrasound. The image data is then segmented (i.e., images corresponding to different anatomical features are separated). A virtual bone model is obtained by dividing the bones into specific bones, ligaments, cartilage, and MRI-based scan data of the knee was segmented and imaged to distinguish other tissues. The images are processed to obtain a three-dimensional model of the anatomical structures.
[0028] Alternatively, the virtual bone model may be extracted from a database or library of bone models. In one embodiment, the user may select the dimensional model. The output device 162 may be used to select the appropriate model. 160 executes the stored instructions and determines the appropriate Select the model. The bone model(s) selected from the database are then The virtual bone model is then deformed based on the characteristics of the patient and used to plan and perform the surgery described herein. Create.
[0029] A pre-operative surgical plan can then be created based on the virtual bone model. may be generated automatically by the processing circuitry 160 or may be generated by input / output device 162. It may be entered by the user via (e.g., processing circuitry 160 may limit certain features of a user-created plan, Generate plans that can be modified by the user, etc.
[0030] The pre-operative surgical plan includes a patient's anatomy to be created using the surgical system 100. Any desired cuts, holes, or other modifications to the structure may be included. In the case of knee arthroscopic surgery, the preoperative plan includes the preparation of the femur 10 to facilitate implantation of a prosthesis. 6 and the cuts necessary to prepare the surfaces of the tibia 108. Thus, the processing circuit 160 shall have access to models of the prosthesis, if any, received to facilitate the generation of the surgical plan. The Personal Information may be collected and / or stored.
[0031] The processing circuit 160 further generates a control object for the robot device 120 according to the surgical plan. In some embodiments described herein, the controlled object is a soft tissue. The control object is patient specific based on the location and attachment point of the control object. This can take a variety of forms depending on the robotic device (e.g., haptic, autonomous, etc.). For example, In some embodiments, the control object is a space that the robotic device 120 moves through. Define instructions for the robotic device 120 to control it to follow the tracking system Autonomous cutting of one or more of the surgical plans guided by feedback from the stem 122. In some embodiments, the control object is a manual operation on the display 164. facilitating surgical navigation, including visualization of surgical planning and the robotic device 120, and to guide the robotic device 120 to follow the surgical plan (e.g., by actively (No visual control or force feedback). In an embodiment, the control object can be a haptic object, as described in the following section.
[0032] In an embodiment in which the robot 120 is a haptic device, the processing circuitry 160 may, among other things, Considering the location and attachment points of tissue, one or more haptic pairs are selected based on the preoperative surgical plan. The surgical tool 134 may be further configured to generate an image to enable constraint of the surgical tool 134 during the surgical procedure. The haptic object is a one-dimensional object that supports the surgeon in carrying out the surgical plan. The haptic device may be formed in one dimension, two dimensions, or three dimensions. Haptic objects can be lines, planes, or 3D volumes. It may be curved and / or have flat surfaces and may have any shape, e.g., a funnel shape. The haptic object may be a variety of different signals related to the movement of the surgical tool 134 during a surgical procedure. One or more of the boundaries of the three-dimensional haptic object may be created to represent a desired result. It may represent one or more modifications, e.g., cuts, to be made to the surface of the bone. The target may represent a modification, e.g., a cut, to be made to the surface of the bone (e.g., an implant). (corresponding to the creation of a surface intended to accept a
[0033] In an embodiment in which the robotic device 120 is a haptic device, the processing circuitry 160 further The surgical tool 134 may include a virtual tool representation, such as a ,contains one or more haptic interaction points (HIPs), which are the The position of the surgical tool 134 is shown in FIG. In embodiments where the HIP is 0.1 mm or less (e.g., as shown in FIG. 1), the HIP represents the center of the spherical bar. If the surgical tool 134 is an irregular shape, such as a sagittal saw, the virtual representation of the sagittal saw may be: Multiple HIPs may be included to generate haptic forces on a surgical tool. The use of IP is described in detail in US Pat. No. 6,393,311, which is incorporated by reference in its entirety herein. No. 13 / 339,369, filed on December 28, 2011, entitled "Sys tem and Method for Providing Substantial In one embodiment of the present invention, , a virtual tool representing a sagittal saw includes 11 HIPs. A reference to "one or more HIPs" is also deemed to include a reference to "one or more HIPs." As described below, The relationship between the haptic object and the surgical system 100 allows the surgical tool 134 to be constrained. You will be able to do this.
[0034] Prior to performing the surgical procedure, the patient's anatomy (e.g., femur 106) is Using known registration techniques, the bones are registered to a virtual bone model of the patient's anatomy. One possible registration technique is point-based registration. 2011, which is incorporated by reference in its entirety. U.S. Patent No. 8,010,180, issued on August 30, entitled "Haptic The Guidance System and Method is described in the "Guidance System and Method" for As a result, registration is performed using a 2D / 3D registration system using a handheld radiography device. This may be accomplished by a variety of implementations, all of which are incorporated herein by reference. Incorporated U.S. Application No. 13 / 562,163, filed July 30, 2012; The name of the device is listed under the name "Radiographic Imaging Device." The registration also involves the registration of the surgical tool 13 to the virtual tool representation of the surgical tool 134. 4, whereby the surgical system 100 is aligned with the patient (i.e. That is, the orientation of the surgical tool 134 (relative to the femur 106) can be identified and monitored. Registration allows for accurate navigation, control, and / or force feeds. Back is possible during surgery.
[0035] The processing circuitry 160 determines the real-world location of the patient's bones (e.g., femur 106), the surgical tools 102, and the position of the patient's bones (e.g., femur 106). 34, and one or more lines defined by forces generated by the robotic device 120; A virtual tool representation, a virtual bone model, and a control object (e.g. For example, a tracking system may be configured to monitor the virtual position of a virtual haptic target. If the patient's anatomy moves during the surgical procedure, the procedure may be tracked by the system 122. The circuit 160 moves the virtual bone model accordingly. the actual (i.e., physical) anatomy of the person as well as the corresponds to or is related to the location and orientation of that anatomical structure. Any cuts, modifications, etc. made to the haptic object, control object, or its anatomical structures Other planned automatic actions of the robotic device 120 that are generated during the associated surgical planning may also be performed. It also moves in accordance with the patient's anatomy. 0 is used to minimize the need to track and process the movement of the femur 106. 06 includes a clamp or brace for substantially securing the same.
[0036] In embodiments where the robotic device 120 is a haptic device, the surgical system 100 and constraining the surgical tool 134 based on the relationship between the HIP and the haptic object. That is, the processing circuitry 160 processes the data provided by the tracking system 122. The surgical tool 13 is used to allow the user to bring the HIP into virtual contact with the haptic target. When detecting that the robot arm 132 is being operated, the processing circuit 160 haptic feedback to generate control signals and convey constraints to the movement of the surgical tool 134. In general, as used herein, a "constraint" is a The term "to restrict movement" is used to indicate a tendency to restrict movement. The form of the constraint provided to tool 134 depends on the form of the associated haptic object. The haptic object may be formed in any desired shape or anatomical structure. Three exemplary embodiments include a line, a plane, or a three-dimensional volume. In one embodiment, the HIP of the surgical tool 134 is aligned along a linear haptic object. In another embodiment, the surgical tool 134 is constrained so that it is restricted to a certain movement. The haptic object is a three-dimensional volume, and the surgical tool 134 is By essentially preventing movement of the HIP outside the volume enclosed by the elephant's walls, In another embodiment, a haptic object on a plane can be constrained by a A surgical tool to substantially prevent movement of the HIP outside the boundaries of the haptic target of the surface For example, the processing circuitry 160 may be configured to constrain the planar distal aspect of the planned femur 106. To establish a planar haptic object corresponding to the cut and to perform the planned distal cut. The surgical tool 134 can be substantially confined to the plane required for the procedure.
[0037] In embodiments in which the robotic device 120 is an autonomous device, the surgical system 100 may The robot is configured to autonomously move and operate the control object 134 in accordance with the control object. For example, The control object may define an area relative to the femur 106 where the cut is to be made. In this case, one or more motors, actuators, and / or other components of the robot arm 132 may be The mechanism and surgical tool 134 may be, for example, a tracking system 136 for performing the planned cut. 22 to move the surgical tool 134 as needed within the control object. and can be controlled to operate the actuator, allowing for closed loop control.
[0038] Referring now to FIG. 2, a detailed block diagram of processing circuitry 160 in accordance with an exemplary embodiment. The processing circuit 160 includes a processor 200 and a memory 202. The processor 200 may be used as a general-purpose processor, an application-specific integrated circuit (ASIC), A set of processors as one or more Field Programmable Gate Arrays (FPGAs) The present invention may be implemented as a processing component, a logic component, or other suitable electronic processing component. Memory 202 (e.g., a memory, a memory device, a storage device, etc.) may include any of the various memory devices described herein. data and / or computers to complete or facilitate certain processes and functions; One or more devices for storing code (e.g., RAM, ROM, flash memory, hardware) The memory 202 may include a volatile memory. The memory 202 may include any of the various memory devices described herein. Database components to support operations and information structures, object code components components, script components, or any other type of information structure. According to an exemplary embodiment, the memory 202 is connected to a processor 160 via the processing circuitry 160. 200 and performing one or more of the processes described herein (e.g., The computer code for executing the program (by the processing circuit 160 and / or the processor 200) do.
[0039] As shown in FIG. 2, the processing circuitry 160 also includes a user interface circuit 204, circuit 206, attachment point identification circuit 208, implant placement circuit 210, surgical planning circuit 212 , an intraoperative control circuit 214, and a communication interface 216. 〜216 are a processor 200 and a memory 202, and a communication interface 216. Although shown as an integrated device in FIG. In the embodiment, the processing circuit 160 and its elements (i.e., the processor 200, the memory 202, The circuits 204 to 214 and the communication interface 216 are connected to a plurality of computer devices, It may also be distributed across servers, robots, cloud resources, etc.
[0040] The communication interface 216 is connected to the processing circuit 160 of FIG. The communication interface facilitates communication between the tracking system 122 and the robotic device 120. The sensor 216 also includes a processing circuit 160 and a pre-operative imaging system 218 or a patient anatomy. Other systems (e.g., Facilitates communication between the patient information database (electronic medical records, electronic medical records, and patient information databases). 216 includes encryption and cryptography capabilities to establish secure communication sessions and provide cybersecurity. Prevent or substantially reduce security risks and comply with patient record privacy laws and regulations may be complied with.
[0041] The user interface circuitry 204 provides input / output devices 16 for one or more users. 2. Generate various graphical user interfaces to provide input / configured to receive, analyze, and interpret user input to output device(s) 162. A typical graphical user interface is shown in Figures 6 to 9. As will be described in more detail below, the user interface circuitry 204 includes: Communicatively coupled to the various circuits 206-214 for displaying graphics from the circuits 206-214 The circuits 206 to 214 receive information for displaying the user interface. Provide user input.
[0042] The splitting circuit 206 receives the medical image from the preoperative imaging system 218 and divides the medical image into and generating a three-dimensional virtual bone model based on the medical image. In an embodiment, the medical image is computed tomography (CT), magnetic resonance imaging (MRI), The imaging may be captured using one or more of a variety of imaging techniques, including ultrasound, etc. In the embodiment described herein, the splitting circuit 206 primarily receives and utilizes CT images. Generally, the following description refers to CT images / imaging. However, various other embodiments are possible. In this case, the processing circuitry 160 may also generate various other images in addition to or as an alternative to the CT images. Types of medical imaging, such as magnetic resonance imaging (MRI), ultrasound, and / or two-dimensional x-rays It is understood that x-rays, including 3D reconstruction / modeling from x-ray / fluoroscopic images, may be used. I want to be understood.
[0043] The CT images received by the segmentation circuit 206 include images of the femur 106 and / or tibia 108 of the patient. A plurality of views are captured, the plurality of views being a series of slices, i.e., a series of slices of the patient's leg. Each CT image may therefore represent a cross-section at each of a number of locations along the patient's The CT images may show two-dimensional slices of a patient's leg. The location and order of the CT images may be known.
[0044] The segmentation circuit 206 separates the bone (e.g., femur 10) from the surrounding tissue, fluid, etc. shown in the CT image. 6 and tibia 108. For example, the dividing circuit 20 6 may identify the boundaries of bones shown in each CT image. 206 automatically identifies the boundary using automatic image processing techniques (automatic segmentation). In an embodiment, the segmentation circuit 206 prompts the user to input an indication of the boundaries of each image. CT images for incorporation into a graphical user interface If user input is received that completely splits all the images, In some cases, some combination of user input and automatic segmentation is used. For example, the user may be prompted to check the accuracy of the automatic segmentation and adjust it if necessary. There are also.
[0045] The segmentation circuit 206 further generates a virtual bone model (i.e., In the embodiment shown, the segmentation circuit 206 is configured to generate a three-dimensional model. The segmentation circuit 206 performs segmentation on the entire surface of the femur 106 and the tibia 108. Using the bone boundaries in each CT image slice defined in the previous step, the image slices are overlapped to The boundaries may be arranged in sequence, spaced apart at known intervals, to generate a surface that is congruent with the boundaries. The circuit 206 thereby calculates a three-dimensional surface, a set of voxels, or a vector in a given coordinate system. A virtual bone model may be generated that is defined as some other representation.
[0046] The attachment point identification circuit 208 receives the virtual bone model from the segmentation circuit 206 and Identify one or more soft tissue attachment points on the bone. A soft tissue attachment point is a point on the bone where soft tissue attaches to the bone. Representation in the coordinate system of the virtual bone model of a site, e.g., a point or area where a ligament is attached to a bone. According to various embodiments, and in various soft tissue and / or surgical cases, soft tissue An attachment point may be a point, a line, a surface, a voxel or a set of voxels, or some other representation. It can be defined as:
[0047] In the embodiment shown herein, the attachment point identification circuit 208 detects the attachment point of the patient's posterior cruciate ligament (PC L) to the patient's tibia 108. In an embodiment, the attachment point identification circuit 208 also detects whether the patient's anterior cruciate ligament (ACL) is attached to the patient's tibia. The attachment point identification circuit 208 also identifies the ACL attachment points corresponding to the sites of attachment to the 108. Ligament attachment points corresponding to the sites where the ACL and PCL attach to the femur 106 may also be identified. Various other soft tissue attachment points may also be identified.
[0048] In some embodiments, the attachment point identification circuit 208 automatically identifies the soft tissue attachment points. For example, the attachment point identification circuit 208 may identify extrema, inflection points, or other points on the surface of the virtual bone model. As another example, the attachment point identification circuit 208 may identify identifiable features through machine learning. A neural network trained on the method is then run to identify the soft tissue attachment points.
[0049] In some embodiments, the attachment point identification circuit 208 is 4, a graphic representation instructing a user to select a soft tissue attachment point of the virtual bone model. Identify the soft tissue attachment points by instructing the user to generate a calculus user interface. A user interface circuit 204 visualizes the virtual bone model and provides input / output A graph that provides a tool for selecting a point or points of the virtual bone model using a device 162. The attachment point identification circuit 208 may generate a graphical user interface. An input may be received and one or more soft tissue attachment points may be defined based on the user input.
[0050] The implant placement circuitry 210 determines the size and placement of the surgical implant based on the virtual bone model. In some embodiments, the method is configured to identify the location of the vertebrae based on the model and soft tissue attachment points. The implant placement circuit 210 is adapted to place the PCL on the tibia 108 in a total knee arthroscopic procedure. configured to identify the placement of the tibial implant and the femoral implant in the case of a surgical procedure. In such an embodiment, the implant placement circuitry 210 may be configured to compute the implant position on a virtual bone model of the tibia 108. The virtual tibial implant is superimposed and the virtual femoral implant is placed on the virtual bone model of the femur 106. The implant placement circuit 210 places the virtual bone on the implant based on the PCL attachment point. 2. Place the virtual tibial implant on the model (e.g., avoiding interference with the PCL attachment point) (To optimize rotation and coverage based on the PCL attachment point.) Figure 5 shows the impact of the ligament. To identify potential impingements, images were taken to identify the PCL attachment points on the bone model. (frames A and B) and placement of the implant model on the bone model (frame C) ), as well as to visually depict the relationship of the planned placement of the implant to the PCL. The use of an image for this purpose (frame D) is shown. The interface is shown in Figures 6-7.
[0051] In some embodiments, the implant placement circuit 210 may include a 8 and the ACL and PC based on the PCL attachment points on the PCL and ACL That is, the implant placement circuit 210 is configured to predict the line of action of the tibia. A virtual ACL model that predicts the position of the ACL and PCL between the bone 108 and the femur 106 and generating a virtual PCL model. The implant placement circuit 210 then , a virtual knee joint is moved through a full range of motion using the virtual tibial implant and the virtual femoral implant. Avoid collisions (i.e., obstruction, pinching, restriction, etc.) between the ACL model and the virtual PCL model. The virtual tibial implant and the virtual femoral implant may be positioned so as to The implant placement circuit 210 thereby determines whether the ACL or PC This can make it easier to prevent L collisions.
[0052] In some embodiments, the user interface circuitry 204 may include, for example, As shown in the figure and as described in detail with reference thereto, A graphical user interface is generated showing the placement of the virtual implant. A graphical user interface allows the user to adjust the placement of the virtual implant. In such an embodiment, the implant placement circuit 210 limits the placement options available to the user and allows the user to place the virtual implant at an attachment point. Prevent placement of the device in a manner that interferes with or impinges on the ACL or PCL. In another embodiment, the implant placement circuit 210 includes an input / output device 162 Issue a notice or warning (e.g., text message, alert) provided to the user, permitting a user to select such an arrangement while informing the user of the interference or collision; There is.
[0053] The surgical planning circuit 212 receives from the implant placement circuit 210 a surgical plan for placing a virtual implant. The surgical planning circuitry 212 receives the virtual bone model. and receiving the implant at a location specified by the implant placement circuitry 210. The apparatus is configured to plan the cuts to the femur 106 and tibia 108 required for the That is, the surgical planning circuit 212, via the implant placement circuit 210, The femoral and tibial implants are placed in the virtual bone model at the same positions as the femoral and tibial implants are placed in the virtual bone model. The femur 106 is attached to the tibia 108 so that the implant can be placed on the femur 106 and the tibia 108. and how the tibia 108 needs to be modified. The surgical planning circuit 212 , a series of planned planar cuts to be made to the femur 106 and tibia 108. The plan can be determined.
[0054] The surgical planning circuit 212 adjusts the planned cut based on one or more soft tissue attachment points. For example, the surgical planning circuit 212 may be configured to plan the planned incision based on the soft tissue attachment point. It may cross the soft tissue, weaken the soft tissue attachment points, or cross the soft tissue attached to the soft tissue attachment points. that the device will not injure the soft tissue or in any other way pose a risk of injury to the soft tissue. The implant may be configured to identify the location of the implant by the implant placement circuitry 210. If such a cut is required to place the implant, the surgical planning circuit 212 Sends an error or warning message to the plant placement circuit 210 and performs implant placement. In some cases, the placement circuitry 210 may request that the implant placement be reviewed.
[0055] Based on the planned cuts, the surgical planning circuit 212 determines a control for each of the planned cuts. haptic objects (e.g., virtual haptic objects) that are attached to the one or more soft tissues. Thus, the surgical planning circuit 212 uses the soft tissue attachment points to generate patient-specific That is, the surgical planning circuit 212 defines one or more of the control objects. to restrict the surgical tool from affecting one or more soft tissue attachment points. For example, One control object may correspond to a planar cut to be made on the distal surface of the tibia 108. The imaging circuit 212 shapes the control object so that it does not intersect with the PCL attachment point of the tibia. 8-9 show diagrams of such a controlled object, and will be described in detail below with reference to them. explain.
[0056] The intraoperative control circuitry 214 facilitates the implementation of the surgical plan generated by the surgical planning circuitry 212. The intraoperative control circuitry 214 is configured to control the tracking system 122 and the robotic device. 120 and performs registration, navigation, and tracking, e.g., As described above with reference to FIG. 1. The intraoperative control circuitry 214 controls one or more soft tissue attachments. The intraoperative control circuitry 214 may also control the surgical planning circuitry 212. 12, and configured to control the robot device 120 based on the control object generated by the In an embodiment in which the robotic device 120 is a haptic device, the intraoperative control circuitry 214 may be limited to the surgical tool 134 as described above with reference to FIG. The robot device 120 is controlled to determine whether the robot device 120 is autonomous or automatically In an embodiment that is a robotic device, the intraoperative control circuitry 214 controls the surgical tool 134 to perform cutting ( 1, for example, in a control object as described above with reference to FIG. The intraoperative control circuitry 214 thereby controls the robotic device 120 to move the The robot device 120 is controlled according to the control object generated by the surgical planning circuit 212. This may protect one or more soft tissue attachment points during the surgical procedure.
[0057] Referring now to FIG. 3, a method for determining the location of one or more soft tissue attachment points according to an exemplary embodiment is provided. 3 illustrates a flowchart of a process 300 for facilitating arthroscopic surgery of a joint using The process 300 is implemented in the surgical system 100 of FIG. 1 and the processing circuitry 160 of FIG. As described below, The process 300 facilitates total knee arthroscopic surgery. However, the process 300 It should be understood that this may also be performed on a variety of other systems, as well as in other procedures, including surgery for the spinal cord. Partial knee arthroscopic surgery, bilateral cruciate ligament-preserving total knee arthroplasty, partial hip arthroscopic surgery, and a variety of other procedures, including total hip arthroscopic surgery, and revision knee and hip surgery. Please understand that this may be the case.
[0058] In step 302, the processing circuitry 160 detects an anatomy of interest, e.g., Receive a computed tomography (CT) image of the tibia 108 and femur 106 of the leg 102. The CT images are transmitted to a pre-operative imaging system 218 (e.g., a CT scanner) in communication with the processing circuitry 160. The CT images may be captured at various positions along the leg 102. The image may include a collection of two-dimensional images showing cross-sectional slices of the leg 102.
[0059] In step 304, the CT image is processed to distinguish the various tissues and structures shown in the image. For example, the tibia 108 or femur 106 in each CT image are segmented into The area where the tibia 108 or femur 106 is to be delineated in each CT image can be identified. A boundary line may be defined and stored. In some embodiments, the processing circuitry 160 may 8 or the area corresponding to the femur 106 on the remaining images (i.e., soft tissue or other anatomy) The CT image is automatically segmented to distinguish from the portion of the image that shows the target structure. In one embodiment, the processing circuitry 160 detects the boundaries of the tibia 108 or femur 106 in each CT image. A graphical user interface that allows the user to manually enter the display In yet another embodiment, some combination of automatic segmentation and user input is used to generate The processing circuitry 160 thereby uses the shank to increase the efficiency and accuracy of the segmentation process. 1. Sections showing the shape / boundaries of the tibia 108 and / or femur 106 at various layers along the bone 108. Acquire CT images.
[0060] In step 306, the processing circuitry 160 determines the tibia 108 and / or the tibia 109 based on the segmented CT images. Or, a virtual bone model of the femur 106 is generated. That is, The boundaries of the tibia 108 and / or femur 106 are overlaid with a known separation between each CT image. The image stack is then processed to produce a 3D image representing the tibia 108 and / or femur 106. Original virtual bone models (eg, a virtual tibia model and a virtual femur model) may be generated.
[0061] In step 308, one or more soft tissue attachment points are identified on the virtual bone model. That is, one or more sites where soft tissue attaches to the tibia 108 or femur 106 are included in the virtual bone model. The coordinates of the site in the coordinate system of the virtual bone model are identified from the CT image. Landmarks are identified and defined as soft tissue attachment points, e.g., where the PCL attaches to the tibia 108. PCL attachment points corresponding to the sites can be identified and defined in this manner. In the example, processing circuitry 160 may select a position for one or more soft tissue attachment points to be displayed or adjusted by the user. It generates a graphical user interface that allows Examples of the physical user interface are shown in Figures 6-7 and are described in detail below. In some embodiments, processing circuitry 160 automatically determines one or more soft tissue attachment points. The device is configured to dynamically identify the
[0062] In some embodiments, the soft tissue attachment points are identified using bone density information present in the CT images. For example, the area of a bone that attaches to soft tissue may be denser than other areas of the bone. These high-density regions can be distinguished from CT images, e.g. In some cases, the image may appear more opaque or brighter. Using a recognition technique or automated segmentation method, one or more regions in the CT image associated with high bone density are identified. The processing circuitry 160 may then identify the regions and associate those regions with soft tissue attachment points. This allows soft tissue attachment points to be automatically determined based on bone density information captured by CT images. Can be identified.
[0063] In step 310, the size and placement of the implant is determined based on the identified soft tissue attachment points. For example, the processing circuitry 160 may determine the tibial implant and the femoral implant. The processing circuitry 160 may then generate a virtual implant model of the implant. The bone model is then overlaid on the virtual bone model, and the size, position, direction, alignment, etc. are determined. A graph showing a virtual implant model superimposed on the virtual bone model. Examples of the graphical user interface are shown in Figures 6 and 7. I will explain in detail.
[0064] The processing circuitry 160 may be configured to determine whether the implant model is attached to one or more soft tissue attachment points, the soft tissue attachment points being covered by the implant model. the need to remove or weaken the attachment point, or impact of the tendon by the implant. As an example, the processing circuit 160 may ensure that the processing circuit does not interfere with the The tibial component of the knee implant was sized based on the PCL attachment point of the tibia 108. , position, and / or rotation may be determined.
[0065] In some embodiments, the processing circuitry 160 may include a tibial component corresponding to the PCL and the patellar ligament. Identify the rotation or orientation of the component-based attachment point. More specifically, The rotation of the tibial component is set using a line connecting the attachment point and the patellar ligament attachment point. In some embodiments, one or more soft tissue attachment points may be defined or manipulated for rotation. It is used as a marker to obtain
[0066] In step 312, processing circuitry 160 determines whether the implant identified in step 310 Patient-specific based on size and placement, and based on one or more soft tissue attachment points A control object is generated based on the movement of the femur 106 and the tibia 10 by the surgical tool 134. 8 to facilitate cutting or other modifications to the femur at the location identified in step 310. and configured to prepare the femur 106 and the tibia 108 to receive the tibial implant. The control object is shaped to avoid intersection or other interference with the soft tissue attachment points. and may be arranged.
[0067] In step 314, the surgical tool 134 is controlled and / or constrained based on the control objective. In an embodiment in which the robotic device 120 is an autonomous robotic system, the surgical tool 1 34 may be used to modify the femur 106 and / or the tibia 108 via one or more control objects. The control object is controlled to move autonomously as one or more of the virtual bone models. The robotic device is shaped to avoid soft tissue attachment points so that it can be attached to the actual femur 106 or a corresponding attachment site on the tibia 108 or a ligament or other attachment site thereto. In an embodiment in which the robotic device 120 is a haptic device, the robotic device 120 is controlled so as not to come into contact with tissue. In one embodiment, the processing circuitry 160 controls the robot to constrain the surgical tool 134 within the control object. The surgical tool 134 controls the surgical device 120 so that the ligament or other tissue is A series of surgical cuts restricts contact with the attachment site. This protects ligaments and other soft tissues from iatrogenic injury and complications associated with weakened attachment points. This can be done while limiting the risk of
[0068] Referring now to FIG. 4, an exemplary embodiment of an implant component 1 illustrates a process 400 for preventing ACL and / or PCL impingement in a patient. The process 400 is implemented by the surgical system 100 of FIG. 1 in the processing circuitry 160 shown in FIG. Although application to total knee arthroplasty is described herein, process 400 may be , partial knee arthroplasty, early intervention knee surgery, etc. The process 400 may be adapted for bicruciate-sparing knee arthroplasty. This may be an example of step 310 of 0.
[0069] In step 402, the processing circuitry 160 calculates the line of action of the ACL / PCL based on the CT image. The CT image, the virtual bone model, and / or the identified femur 106 and tibia are used to predict. Based on the attachment points of the ACL and PCL to the bone 108, the processing circuit 160 determines the attachment points of the ACL and PCL. For example, processing circuitry 160 may be configured to estimate the space that L will span over the full range of motion of the knee. Alternatively, a model of the PCL may be generated and added to the virtual bone model.
[0070] In step 404, processing circuitry 160 determines whether the implant is causing an ACL or PCL injury. The processing circuitry 160 generates a virtual implant model and performs the steps shown in FIG. As described above with reference to the above, the virtual implant model is superimposed on the virtual bone model. The ACL / PCL model may also be included. The virtual models, including the virtual bone model, the virtual implant model, and the virtual ligament model, were obtained. The processing circuitry 160 may then examine the virtual model over the full range of motion to assess the likelihood of a collision. Any overlap between the virtual implant model and the virtual ligament model may be detected. The overlap between the virtual implant model and the virtual ligament model indicates that the implant is This shows that a collision can occur if the axial displacement sensor is attached to the model as shown in FIG.
[0071] In step 406, processing circuitry 160 determines whether the implant is The processing circuitry 160 selects the size and location of the Select the size and location of the implant to minimize the risk of injury or impingement. For example, the processing circuitry 160 may determine that the virtual model includes the virtual implant model and the virtual ligament model. The implant is designed so that it can be examined over a full range of motion without creating overlap between implants. The processing circuitry 160 may change the size and position of the object as described above with reference to FIG. and using images to identify the appropriate size and location of the implant to avoid collisions. A graphical user interface is provided that allows the user to easily visualize the planned implantation. In an embodiment that allows the user to change the size and position of the Path 160 indicates that the proposed planned implant location is predicted to cause a collision. The processing circuitry 160 may also generate a warning or alert to indicate to the user that a collision is predicted. Prevent users from selecting options that are too complex or that pose a collision risk above a threshold. In some cases.
[0072] In step 408, the processing circuitry 160 uses the MRI images to calculate the virtual model and the collision The processing circuitry 160 receives the MRI images from the pre-operative imaging system 218. The MRI images are obtained by imaging the femur, tibia, patella, cartilage, and ligaments (e.g., A The ligament may be divided to distinguish between the ligaments (CL, PCL, patellar ligament). The three-dimensional model above can be analyzed, for example, using the same method as described for the CT images above. A virtual model of the planned implant may be generated using the MRI-based 3D model. These models can then be used to accurately measure the impact of the CT-based model. For example, the MRI-based model may be used to verify that the vehicle has predicted a collision or non-collision. If the CT-based model predicts non-crash, the MRI-based model predicts non-crash. The CT-based model can be verified and the planned location of the implant can be approved. The process may be performed by removing the soft tissue as described above with respect to steps 312 and 314 of process 300. The implant size and location were chosen to prevent potential tissue collisions. To this end, the generation of patient-specific control targets can be continued.
[0073] 6-9, in accordance with an exemplary embodiment, processing circuitry 160 (e.g., For example, by the user interface circuitry 204) and input / output device 162 The graphical user interface 164 displays the Various views of the interface 500 are shown. In each of FIGS. The user interface 500 includes a virtual bone model of the femur 106 (virtual femur model 55 0) and a virtual bone model of the tibia 108 (virtual tibia model 552) The graphical user interface 500 also includes a bottom section 504 showing a visualization of the , and also includes three columns corresponding to the visualization of three sets of virtual femur models 550 and virtual tibia models 552. The first row 506 shows a front view of a virtual femur model 550 and a virtual tibia model 552; The second row 508 shows a distal view of a virtual femur model 550 and a virtual tibia model 552. The third row 510 shows a side view of a virtual femur model 550 and a virtual tibia model 552. 6, 7, 8A, and 9 show visualization of a virtual femoral implant 554 and a virtual tibial implant 555. The graphical user interface 500 includes a visualization of the plant 556. This displays the planned implant placement to the user.
[0074] In the configuration shown in FIG. 6, the graphical user interface 500 includes a virtual thigh. A bone model 550, a virtual femoral implant 554, a virtual tibia model 552, and a virtual tibia A cross-sectional view of the implant 556 is shown. Circle 558 represents the PCL attachment point of the virtual tibia model 552. In some embodiments, the location of the circle 558 is , which can be adjusted by the user to change the definition of the location of the PCL attachment point. 60 indicates the height or plane associated with the PCL attachment point. Line 560 is adjustable by the user to move the location of the PCL attachment point. As shown in FIG. 6, a virtual tibial implant 556 is positioned so as not to interfere with the PCL attachment point. It will be placed.
[0075] In the configuration shown in FIG. 6, the graphical user interface 500 includes a virtual thigh. A bone model 550, a virtual femoral implant 554, a virtual tibia model 552, and a virtual tibia A three-dimensional rendering of the implant 556 is shown. Model 552 is designed to show the effect of planned cuts on the femur 106 and tibia 108. That is, the portions of the femur 106 and tibia 108 that are to be removed during surgery are , are also removed from the virtual femur model 550 and the virtual tibia model 552. Thereafter, the planned amputation was altered, damaged, crossed, interfered with, or disrupted one or more soft tissue attachments. You may want to check if there are other ways to affect it. The face 500 includes arrow buttons 600 that allow the user to move the virtual femur interface. Adjusting the position, size, rotation, etc. of the plant 554 and the virtual tibial implant 556 You will be able to do this.
[0076] In the configuration shown in FIG. 8A, the graphical user interface 500 is a virtual large A femur model 550, a virtual femoral implant 554, a virtual tibia model 552, and a virtual tibia A cross-sectional view of a bone implant 556 is shown. In FIG. 8A, the virtual boundary 700 is a boundary of interest. The virtual boundary 700 shows how the surgical tool 134 is manipulated by the control object and the robotic device 120. As shown in FIG. 8, the virtual boundary 700 defines a boundary that is restricted from crossing. The imaginary boundary 700 includes a concave notch 702 where the PCL attachment is indicated by highlighting 704. The virtual boundary 700 bends along the points. 4 shows that the PCL is configured to restrict the PCL from reaching the attachment point.
[0077] In the configuration shown in FIGS. 8B-C, the graphical user interface 500 A virtual femur model 550 including a virtual boundary 700 corresponding to the defined tibial cut and a virtual tibia model 551. A cross-sectional view of the bone model 552 is shown. FIG. 8B shows a view of the right knee, and FIG. 8C shows a view of the left knee. As shown in FIGS. 8B-C, a virtual femur model 550 and a virtual tibia model 552 are CT images and / or other medical images showing bone density in various regions of the femur and tibia This may be visualized as a convenience for the user in identifying one or more soft tissue attachment points. , in identifying areas of strong bone suitable for implant engagement, and / or in other planned or anticipated conditions. As shown in FIGS. 8B-C, a virtual femoral implant 55 4 and a virtual tibial implant 556 are displayed from the graphical user interface 500. These are not visible and provide a simplified view, allowing for easier identification of the virtual boundary 700. This allows the user to clearly see the planned cuts that will be made.
[0078] As shown in Figures 8D-E, areas of denser bone are indicated by colored, shaded, or or other divisions of the graphical user interface 500. In the example shown, section 750 represents a dense region of bone. The center of mass of the dense region of bone is shown. Region 754 is the center of mass of the PCL and / or PCL attachment point. The segments 750, points 752, and / or regions 754 may be used to facilitate implant planning. For example, the surgeon (user) may align the groove of the virtual tibial implant 556 with the point 752. As another example, the surgical procedure can be performed using a combination of the lateral and medial collateral collateral ligaments (as shown in FIG. 8E) to optimize internal / external rotation. The surgeon can adjust the varus / valgus rotation of the tibial resection to optimize the density of the cut. Various further advantageous alignments and plans may be used to define segments 750, points 752, and / or regions. 754 in the graphical user interface 500. obtain.
[0079] In the configuration shown in FIG. 9, the graphical user interface 500 includes a virtual thigh. A bone model 550, a virtual femoral implant 554, a virtual tibia model 552, and a virtual tibia 9 shows a three-dimensional rendering of the implant 556. FIG. In the embodiment shown, the control object is a planar control object, with a virtual boundary 700 in the second column 5 08. Graphical User Interface 500 includes an arrow button 600 that allows the user to select the virtual femoral implant. 554 and the virtual tibial implant 556 can be adjusted in position, size, rotation, etc. A user interface is provided to adjust the position, size, rotation, etc. of the virtual tibial implant 556. In response to the user's input, the processing circuit 160 adjusts the control object appropriately. The virtual boundary 700 of the interface 500 is updated accordingly. The position, size, rotation, etc. of the virtual tibial implant 556 can be adjusted as necessary. The virtual boundary 700 may be adjusted accordingly.
[0080] 10-12, an exemplary embodiment of an attachment of the patellar tendon to the tibia is shown. 10 illustrates a process 1000 for determining rotational alignment of an implant based on FIG. 10 shows a flow chart of the process 1000. FIGS. 10. The process 1000 is performed by the processing circuit 160 of FIG. The process 1000 may be part of an embodiment of the process 300 of FIG. For example, these steps may be included as steps 304 to 310 in FIG.
[0081] In step 1002, the tibia and patellar ligament are scanned to identify the patellar ligament attachment point (tibial tubercle). A band is identified from a CT image, i.e., the CT image includes the tibial tubercle and / or the patellar ligament. The image is segmented to define pixels or coordinates of the CT image that correspond to the bands. By identifying the patellar ligament and the tibia using In some embodiments, the processing step facilitates identification of adjacent regions. The circuit 160 automatically identifies the tibial tubercle and / or patellar ligament in the CT image. (i.e., automatic segmentation). In another embodiment, the processing circuitry 160 may Generate an interface that allows a user to display a table of the location of the patellar ligament and / or the tibial tubercle. The processing circuitry 160 receives user input and prompts the user to input a display (e.g., a contour, a region). Based on the user input, the location of the tibial tubercle and / or the patellar ligament may be identified. For example, FIG. 10 shows a segmentation boundary 1008 identified as the lateral boundary of the patellar ligament at the tibial tubercle. .
[0082] In step 1004, the medial edge of the patellar ligament at the tibial tubercle is identified. The logic circuit 160 is connected to the medial-most point of the patellar ligament at the tibial tubercle where the patellar ligament attaches to the tibia (i.e. 11, identify the medial most point 1110 in FIG. 11. To identify this point, A "slice" of the CT image at the level of the tibial tubercle showing the inter-tibial attachment is selected (e.g., CT image 1101 in Figure 11). At that level, the medial most point of the tibial tubercle and / or patellar ligament Based on the segmentation data from step 1002, for example, a segmented portion corresponding to the patellar ligament is obtained. The region is identified by selecting the point from the region that is closest to the inner boundary of the CT image. The processing circuitry 160 thereby determines coordinates associated with the medial edge of the tibial tubercle and / or the patellar ligament. Identify.
[0083] In step 1006, rotation of the tibial component of the prosthetic implant is The axis of the component and the medial edge of the tibial tubercle and / or patellar ligament (i.e., the patellar ligament on the tibia) The processing circuit 160 determines the location of the virtual bone by matching the innermost part of the attachment area of the band. A virtual implant model of the tibial component (e.g., , virtual tibial implant 556) (e.g., step 306 of process 300) In some representations of the virtual implant model, e.g. As shown in FIG. 11, the virtual implant model may include one or more More specifically, the representation 1100 may include a representation of two or more axes defining the upper rotation. 00 shows the rotation alignment of a virtual tibial implant superimposed on a CT image 1001 of the tibia 108. Indicates an instance.
[0084] As shown in FIG. 11, a first axis 1102 of the representation 1100 is substantially end-to-end (i.e., The second axis 1004 may extend from the plane of the CT image (i.e., from the inside to the outside). i.e., a plane defined by a normal vector substantially parallel to the length of the tibia) The rotational alignment of the virtual implant model may be perpendicular to the axis 1102. is the circumference of the intersection 1106 of the first axis 1102 and the second axis 1104 in the plane of the CT image. 11. The rotation of the first shaft 1102 and the second shaft 1104 can be adjusted accordingly.
[0085] In step 1006, the processing circuit 160 determines whether the second axis 1104 is between the patellar ligament and the tibia. Define the rotation of the virtual tibia model so that it intersects with the medial edge of the patellar ligament at the attachment point / region of As shown in FIG. 11, the second axis 1104 is aligned with the apex of the dividing boundary 1108 corresponding to the patellar ligament. 1. The virtual tibial implant extends through the medial point 1110. In other words, the rotation of the virtual tibial implant is 1, a second axis 1104 is aligned in such a way that it passes through the innermost coordinates identified in step 1004. It is set to pass.
[0086] In step 1008, the rotational alignment of the virtual tibial implant is Rotation of a virtual model of a femoral component (e.g., virtual femoral implant 554) For example, the rotational alignment of the virtual tibial implant is used to determine the alignment. The rotational alignment of the virtual femoral implant and the virtual femoral implant is determined by a preset geometric The virtual tibial implant may have a relationship to the tibial bone. To determine the rotational alignment of the virtual femoral implant based on the rotational alignment FIG. 12 illustrates the placement of a virtual femoral implant on a femur (i.e., 12 shows a representation 1200 of the femur (superimposed on a CT image 1202 of the femur). The representation 1200 of the alignment of the virtual femoral implant is This corresponds to alignment representation 1100.
[0087] The processing circuitry 160 thereby determines the rotational alignment of the implant relative to the patellar tendon of the tibia. Identify based on the attachment point of the band.
[0088] As noted above, the process 1000 may be implemented as a sub-portion of the process 300 . Thus, after step 1008, processing circuitry 160 may perform other sizing or or placement characteristics are identified (i.e., step 310), and the identified implant placement characteristics are and generating a control object based on the attachment point of the patellar ligament to the tibia (i.e., step 312 ), the surgical tool 134 may be constrained or controlled based on the control object (i.e., step P314).
[0089] In some embodiments, the process 1000 further comprises measuring groove density in an axial plane, a coronal plane, and The neutral implant alignment is used to identify the orientation of the tibial baseplate in the sagittal and sagittal planes. In some embodiments, the method includes the steps of: obtaining a coronal and sagittal density profile; Use the file to ensure good bone stock for optimal implant fixation. stock) can be identified.
[0090] With reference now to FIG. 13, a graphical user interface (GUI) is provided in accordance with an exemplary embodiment. 13 is a block diagram of a graphical user interface 1300. Generated by the processing circuitry 160 (e.g., by the user interface circuitry 204); Displayed by the input / output device 162 (i.e., shown on the display 164) In some embodiments, the graphical user interface 1300 includes a graph A portion of the physical user interface 500, such as the second row 508 and the bottom row 509 of FIG. This corresponds to the part seen in 04.
[0091] In the embodiment of FIG. 13, a tool visualization 1302 of the surgical tool 134 is performed on the virtual tibia model 552 (e.g., on the tibia as shown by the CT image). The position of the tool visualization 1302 is updated in real time to show the actual position of the surgical tool relative to the tibia 108. The actual position of the tool 134 can be determined, for example, by the tracking / navigation generated by the tracking system 122. Based on the navigation data, the graphical user interface 130 0 also displays an indicator 130 that highlights the virtual boundary 700 and the location of the PCL attachment point. 4. A user (e.g., a surgeon) can thereby control the surgical tool 13 during a surgical procedure. 4, the virtual boundary 700 and the indication on the graphical user interface 1300 The user may then see the relative position of the attachment point indicated by the data 1304. This allows for proper placement of the cuts made using the surgical tool 134 relative to the attachment points and / or Orientation may be assisted.
[0092] While this disclosure focuses on PCLs and ACLs, the systems and The method may be adapted to identify and protect other soft tissues, such as the medial collateral ligament (MCL). Such possibilities are contemplated in this disclosure.
[0093] As used herein, the term "circuitry" refers to a device configured to perform the functions described herein. In some embodiments, each "circuit" may include hardware structured as a machine-readable medium for configuring the hardware to perform the functions described herein; The circuitry may include processing, electrical circuits, network interfaces, peripherals, One or more electrical circuits, including but not limited to input devices, output devices, sensors, etc. In some embodiments, the circuit may be embodied as one or more Analog circuits, electronic circuits (e.g., integrated circuits (ICs), discrete circuits, system On-chip (SOC) circuits, telecommunications circuits, hybrid circuits, and any other types of circuits. In this regard, the "circuit" may take the form of a "circuit" of any type that performs the operations described herein. Any type of component for accomplishing or facilitating accomplishment may be included. For example, the circuits described herein may include one or more transistors, logic gates (e.g., NAs, ND, AND, NOR, OR, XOR, NOT, XNOR, etc.), resistors, multiplexers , resistors, capacitors, inductors, diodes, wiring, etc.
[0094] The "circuitry" may also refer to one or more memory or storage devices communicatively coupled to the one or more In this regard, the one or more processors may include a processor stored in the memory. The processor may execute instructions that are otherwise accessible to the processor or processors. In some embodiments, the one or more processors may execute various instructions. The one or more processors may be embodied in at least one of the methods described herein. In some embodiments, the one or more processors may be configured in a manner sufficient to perform , may be shared by multiple circuits (e.g., Circuit A and Circuit B are shown in some exemplary In an embodiment, the data may be stored or otherwise accessed by different regions of memory. (They may contain or share the same processor that can execute the same instructions.) In addition, the one or more processors may be independent of the one or more coprocessors. It may be structured to perform or otherwise carry out certain operations. In an embodiment, two or more processors are coupled via a bus and can be independently, parallel, pipelined, etc. Each processor may support one or more general-purpose Processors, Application Specific Integrated Circuits (ASICs), Field Programmable Gates - FPGA arrays, digital signal processors, or memory or any other suitable electronic data processing component structured to execute instructions provided therein. The one or more processors may be implemented as a single-core processor, a multi-core processor, or a Chip-core processor (e.g. dual-core processor, triple-core processor, The processor may take the form of a quad-core processor, a microprocessor, etc. In some embodiments, the one or more processors may be external to the device, e.g., the one or more The above processor may be a remote processor (e.g., a cloud-based processor). Alternatively or in addition, the one or more processors may be internal and / or local to the device. In this regard, a given circuit or component thereof may be For example, it may be deployed as part of a local server, local computer system, etc. Remotely, if available (e.g. as part of a remote server, such as a cloud-based server) For this purpose, a "circuit" as described herein may be located in one or more locations. The system may include components distributed across multiple systems.
[0095] The construction and arrangement of the systems and methods illustrated in these various exemplary embodiments are for illustrative purposes only. Although only a few embodiments have been described in detail in this disclosure, many modifications are possible. (e.g., the size, dimensions, shapes and proportions of various elements, parameter values, use of materials, etc.) (variations in layout, color, orientation, etc.). For example, the positions of elements may be reversed or changed in other ways. The nature or number of individual elements or locations may be modified or varied. All such modifications are intended to be within the scope of this disclosure. The order or sequence of steps of the method may be varied or arranged according to alternative embodiments. Other substitutions, modifications, variations, and omissions may be made without departing from the scope of this disclosure. These and other objects may be achieved in the design, operating conditions, and configuration of the exemplary embodiments.
Claims
1. Robotic devices, a surgical tool mounted on the robotic device; and 1. A surgical system comprising a processing circuit, The processing circuitry includes: receiving image data of the anatomy; generating a virtual bone model based on the image data; identifying soft tissue attachment points of said virtual bone model; planning implant placement based on said soft tissue attachment points; generating a control object based on the placement of the implant; controlling the robotic device to confine the surgical tool within the controlled object; The surgical system is configured as follows.
2. The soft tissue attachment point is the site where the posterior cruciate ligament or anterior cruciate ligament attaches to the femur or tibia. The surgical system of claim 1 .
3. 2. The hand of claim 1, wherein the soft tissue attachment point corresponds to the site where the patellar tendon attaches to the tibia. Art system.
4. The processing circuitry aligns the axis of the implant with the soft tissue attachment point based on the soft tissue attachment point. The implant is configured to be positioned by aligning the inner edge of the landing point. The surgical system of claim 3 .
5. The processing circuitry is further configured to generate a graphical user interface. It was made, The graphical user interface includes a virtual bone model, an implant, 10. The surgical system of claim 1, further comprising:
6. the graphical user interface further comprising a visualization of the control object. The surgical system of claim 5 .
7. The processing circuitry may further be adapted to limit inclusion of the soft tissue attachment points to the control object. The surgical system of claim 1 , configured as follows:
8. receiving image data of the anatomy; generating a virtual bone model based on the image data; identifying soft tissue attachment points of said virtual bone model; determining an implant size and location based on said soft tissue attachment points; generating a control object based on the size and the location of the implant; And and restricting or controlling a surgical tool mounted on a robot device based on the control object. and, The method includes:
9. the image data includes a computed tomography image; Segmenting the computed tomography image and identifying one or more bones in the image. The method of claim 8 further comprising:
10. The soft tissue attachment point is the site where the posterior cruciate ligament or anterior cruciate ligament attaches to the femur or tibia. The method of claim 8, which corresponds to
11. 9. The method of claim 8, wherein the soft tissue attachment point corresponds to the site where the patellar tendon attaches to the tibia. Law.
12. The determining the location of the implant includes aligning the axis of the implant with the soft tissue. The method of claim 11 including mating with an inside edge of the woven attachment point.
13. A graphic visualization of the virtual bone model, the implant, and the soft tissue attachment points. The method of claim 8 , further comprising generating a rule user interface.
14. the graphical user interface further comprises: The method of claim 13.
15. predicting a line of action of a ligament based on said soft tissue attachment points; augmenting the virtual bone model with a virtual implant model of the implant; determining whether the line of action of the ligament intersects with the virtual implant model; and, In response to identifying the line of action of the ligament intersecting the virtual implant model, To alert the user, The method of claim 8 further comprising:
16. 9. The method of claim 8, further comprising: limiting inclusion of the soft tissue attachment points to the control object. The method described above.
17. When executed by one or more processors, the one or more processors are caused to perform operations. A non-transitory computer readable medium storing program instructions for performing operations , receiving image data of the anatomy; generating a virtual bone model based on the image data; identifying soft tissue attachment points of said virtual bone model; determining an implant size and location based on said soft tissue attachment points; generating a control object based on the size and the location of the implant; And and restricting or controlling a surgical tool mounted on a robot device based on the control object. and, The computer-readable medium comprising:
18. The manipulation includes restricting inclusion of the soft tissue attachment points to the control object.
20. The computer-readable medium of claim 17.
19. The operation is predicting a line of action of a ligament based on said soft tissue attachment points; augmenting the virtual bone model with a virtual implant model of the implant; determining whether the line of action of the ligament intersects with the virtual implant model; and, In response to identifying the line of action of the ligament intersecting the virtual implant model, To alert the user, 20. The computer readable medium of claim 17, comprising:
20. The determining of the location of the implant includes aligning the axis of the implant with the soft tissue attachment point. The computer readable medium of claim 17 , comprising mating with an inner edge of the
Citation Information
Patent Citations
Implant order acceptance production system, implant order acceptance delivery system and management server
JP2012033161A
System and method for optimizing parameters of orthopedic procedures
JP2013539379A
Method and apparatus for force redistribution within joints in articular motion
JP2015057165A
Systems and methods for adjusting the proximal tibia
JP2017500964A
Systems and methods for customizing interactive haptic boundaries
WO2013101753A1
