Systems and methods for spinal surgery - Patents.com

Abstract

A method including capturing a pose of a surgical tool at a surgical site on a patient, the method including determining a range of motion of the surgical tool at the surgical site responsive to the captured pose, the method including displaying a representation of the determined range of motion on an image associated with the surgical site, and the method including providing one or more commands to constrain movement of a robotic device according to the determined range of motion. [Selected figure] Figure 1

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of and priority to U.S. Provisional Application No. 62 / 727,537, filed September 5, 2018, the entire disclosure of which is incorporated herein by reference. [Background technology]

[0002] Field The present disclosure describes motion programming of robotic devices based on tracked surgical tools. Summary of the Invention [Problem to be solved by the invention]

[0003] background Minimally invasive surgery typically limits the size of incisions made into the body, resulting in quicker recovery from surgery and less chance of infection. However, only a few tools can be used simultaneously by the same surgeon during minimally invasive surgery. Tool changes may occur to place the appropriate tools in the surgical suite. Tool changes may extend beyond the time of the minimally invasive surgical procedure. Additionally, minimally invasive surgery can be taxing for the surgeon, especially when it comes to manually operating surgical controls for extended periods of time.

[0004] In one embodiment, a method includes capturing a pose of a surgical tool at a surgical site on a patient. The method also includes determining a range of motion of the surgical tool at the surgical site responsive to the captured pose. The method also includes displaying a representation of the determined range of motion on an image associated with the surgical site. The method also includes providing one or more instructions to constrain movement of a robotic device according to the determined range of motion. [Means for solving the problem]

[0005] In another embodiment, a system includes a tracking device, a robotic device, and a processing device. The processing device includes a processor and a non-transitory computer-readable medium having stored thereon instructions that, when executed by the processor, cause the system to capture a pose of a surgical tool at a surgical site of a patient via the tracking device. The instructions stored thereon, when executed by the processor, cause the system to determine, by the processor, a range of motion of the surgical tool at the surgical site in response to the captured pose. The instructions stored thereon, when executed by the processor, cause the system to display a representation of the determined range of motion on an image associated with the surgical site. The instructions stored thereon, when executed by the processor, also cause the system to provide one or more instructions for restricting movement of the robotic device according to the determined range of motion.

[0006] In another embodiment, a method includes capturing a pose of a surgical tool at a surgical site on a patient, where the surgical tool is coupled to a robotic device. The method also includes determining an axis about which to pivot the surgical tool and a range of angles in one or more planes about which to pivot the surgical tool about the axis in response to the captured pose. The method also includes displaying at least one representation of the axis and a range of angles in degrees on a display. The method also includes providing one or more commands to constrain movement of the robotic device according to the axis and the range of angles in the one or more planes. [Brief description of the drawings]

[0007] BRIEF DESCRIPTION OF THE DRAWINGS Many advantages of the present invention will become apparent to those skilled in the art upon reading this specification in conjunction with the accompanying drawings, in which like reference numerals apply to like elements and in which: [Figure 1] FIG. 1 illustrates an exemplary system for performing a surgical procedure, according to an embodiment of the present disclosure. [Diagram 2]FIG. 2 illustrates an exemplary robotic device that may be used during a surgical procedure, according to one embodiment of the present disclosure. [Diagram 3] FIG. 3 illustrates an exemplary block diagram of a computing device according to one embodiment of the present disclosure. [Figure 4] FIG. 4 illustrates an exemplary computer medium according to one embodiment of the disclosure. [Diagram 5] FIG. 5 illustrates a flow diagram of an exemplary method during a surgical procedure, according to one embodiment of the present disclosure. [Figure 6] FIG. 6 illustrates another flow diagram of an exemplary method during a surgical procedure, according to one embodiment of the present disclosure. [Figure 7] FIG. 7 shows exemplary images that may be displayed during a surgical procedure, according to one embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Detailed Description Exemplary embodiments of the present invention are described below. For the sake of clarity, not all features of an actual implementation are described in this specification. Of course, it will be understood that in the development of such an actual embodiment, numerous decisions must be made for each implementation to activate the developer's particular goals, such as compliance with system-related and business-related constraints, which will vary from implementation to implementation. Moreover, it will be understood that such development efforts may be complex and time-consuming, but are nevertheless routine for those of ordinary skill in the art having the benefit of this disclosure. Moreover, although described below primarily in the context of spinal surgery, it should be readily understood that the systems and methods of the present invention can be used in any number of anatomical settings to provide access to any number of different surgical target sites throughout the body.

[0009] Examples described herein include systems and methods for performing a surgical procedure. In one example, the method includes capturing a pose of a surgical tool at a surgical site on a patient. In one scenario, the surgical tool is coupled to a robotic device. In this scenario, a user (e.g., a surgeon) can guide the surgical tool to the surgical site with the aid of the robotic device.

[0010] The method also includes determining a range of motion of a surgical tool at the surgical site in response to the captured pose. In one example, the determined range of motion can be based on a cone shape according to a determined axis of the surgical tool. In another example, the determined range of motion can be determined along an edge of a surgical tool, such as a retractor. In this example, the range of motion can be limited to one or more arms of the retractor.

[0011] The method also includes displaying a representation of the determined range of motion on an image associated with the surgical site. In one example, the image may be a two-dimensional or three-dimensional image of the surgical site. In another example, the image associated with the surgical site may be a pre-operative or intra-operative image of the patient.

[0012] The method also includes providing one or more instructions to restrict movement of the robotic device according to the determined range of movement. For example, the robotic device may be configured to assist in a surgical procedure including the use of one or more pedicle screws. In this example, a surgeon may guide a surgical tool coupled to the robotic device to one or more pedicles associated with one or more vertebrae. Based on the captured pose of the surgical tool, the one or more instructions may further restrict movement of the robotic device to avoid tearing around the pedicle when inserting the one or more pedicle screws into the one or more vertebrae.

[0013] Referring now to the figures, FIG. 1 is a diagram of an exemplary system 1 for performing a surgical procedure. The exemplary system 100 includes a base unit 102 that supports a C-arm imaging device 103. The C-arm 103 is positioned below a patient P and includes a radiation source 104 that directs a radiation beam upward to a receiver 105. The receiver 105 of the C-arm 103 transmits image data to a processing device 122. The processing device 122 can communicate with a tracking device 130 to obtain position and orientation information of various instruments (e.g., instrument T) used during a surgical procedure. The tracking device 130 can communicate with a robotic device 140 to provide position information of various tracking elements, such as markers 150. The robotic device 140 and the processing device 122 can communicate via one or more communication channels.

[0014] The base unit 102 contains a control panel 110 that allows the user to control the position of the C-arm 103, as well as the radiation exposure. Thus, the control panel 110 allows the radiologist to "take pictures" of the surgical site at the surgeon's direction, control the radiation dose, and initiate radiation pulse images.

[0015] The C-arm 103 can be rotated around the patient P in the direction of the arrow 108 for different viewing angles of the surgical site. In some cases, an implant or instrument T may be placed at the surgical site, requiring a change in viewing angle for an unobstructed view of the site. Thus, the position of the receiver relative to the patient P, and more specifically relative to the surgical site of interest, may change during the procedure as required by the surgeon or radiologist. As a result, the receiver 105 can include a tracking target 106 attached thereto that allows tracking of the position of the C-arm 103 using a tracking device 130. By way of example only, the tracking target 106 can include multiple infrared (IR) reflectors or emitters spaced around the target, while the tracking device 130 is configured to triangulate the position of the receiver 105 from IR signals reflected or emitted by the tracking target 106.

[0016] The processing device 122 may include a digital memory associated therewith and a processor for executing digital and software instructions. The processing device 122 may also incorporate a frame grabber that uses frame grabber technology to create digital images for projection as displays 123 and 124 on the display device 126. The displays 123 and 124 are positioned for interactive viewing by the surgeon during surgery. The two displays 123 and 124 may be used to display images from two views, such as lateral and A / P, or may show a baseline scan and a current scan of the surgical site, or a current scan and a "merged" scan based on a previous baseline scan and a low radiation current scan. An input device 125, such as a keyboard or touch screen, may allow the surgeon to select and manipulate images on the screen. It will be appreciated that the input device may incorporate an array of keys or touch screen icons corresponding to various tasks and functions implemented by the processing device 122. The processing device 122 includes a processor that converts image data acquired from the receiver 105 into a digital format. In some cases, the C-arm 103 may be operating in a cinematic exposure mode and may be generating many images per second, in which case multiple images may be averaged into a single image over a short period of time to reduce motion artifacts and noise.

[0017] Tracking device 130 includes sensors 131 and 132 for determining position data associated with various elements (e.g., infrared reflectors or emitters) used in a surgical procedure. In one example, sensors 131 and 132 may be charge-coupled device (CCD) image sensors. In another example, sensors 131 and 132 may be complementary metal oxide semiconductor (CMOS) image sensors. It is also envisioned that a different number of other image sensors may be used to achieve the described functions.

[0018] In one embodiment, the robotic device 140 can assist in holding an instrument T against a patient P during a surgical procedure. In one scenario, The robotic device 140 can be configured to maintain the instrument T in a relative position with respect to the patient P as the patient P moves (e.g., due to breathing) or is moved (e.g., due to manipulation of the patient's body) during the surgical procedure.

[0019] The robotic device 140 may include a robotic arm 141, pedals 142, and a movable housing 143. The robotic device 140 may also be in communication with a display, such as display 126. The robotic device 140 may also include a fixation device for securing the robotic device 140 to a surgical table.

[0020] The robotic arm 141 may be configured to accept one or more end effectors depending on the surgical procedure and the number of joints involved. In one example, the robotic arm 141 may be a six-jointed arm. In this example, each joint includes an encoder that measures its angular value. The motion data provided by the one or more encoders combined with the known geometry of the six joints may allow for the determination of the position of the robotic arm 141 and the position of an instrument T coupled to the robotic arm 141. It was also envisioned that a different number of joints could be used to accomplish the functionality described herein.

[0021] The movable housing 143 ensures easy handling of the robotic device 140 by using wheels and / or handles. In one embodiment, the movable housing 143 may include immobilization pads or an equivalent device. The movable housing 143 may also include a control unit that provides one or more commands to the robotic arm 141 and allows the surgeon to manually input data using an interface, such as a touch screen, mouse, joystick, keyboard, or similar device.

[0022] In one example, the processing device 122 is configured to capture a pose of the instrument T via the tracking device 130. The captured pose of the instrument includes a combination of positional and orientation information. In this example, the pose of the instrument T is based on a user-defined positioning at a surgical site of the patient P. The user-defined positioning is based on a movement of the instrument T by the surgeon or the robotic device 140, or both. In one scenario, the instrument includes one or more infrared reflectors or emitters. Continuing with this example, the processing device 122 is configured to determine a range of motion of the instrument T corresponding to the captured pose of the instrument T. The range of motion is associated with the actuation of one or more components (e.g., one or more links and joints) of the robotic device 140. The processing device 122 is configured to determine one or more instructions for actuating one or more components of the robotic device 140 according to the determined range of motion. Further, the processing device 122 is configured to provide the one or more instructions to the robotic device 140.

[0023] In another example, in response to the captured pose of the instrument T, the processing device 122 is configured to determine an axis for pivoting the instrument T and a range of degrees in one or more planes for pivoting the instrument T about the determined axis. In this example, the processing device 122 is configured to provide one or more instructions to the robotic device 140 for constraining movement to pivot the instrument T coupled to the robotic device 140. As described herein, the robotic device 140 is configured to translate the one or more instructions to enable the instrument T to pivot according to the determined axis and range of degrees in one or more planes.

[0024] 2 shows an example of a robotic device 200 that may be used during a surgical procedure. The robotic device 200 may house hardware such as a processor, memory or storage, and sensors that enable the robotic device 200 to be used in a surgical procedure. The robotic device 200 may be powered by a variety of means, such as an electric motor, a pneumatic motor, or a hydraulic motor. The robotic device 200 includes a base 202, links 206, 210, 214, 218, 222, and 226, joints 204, 208, 212, 216, 220, 224, and 230, and a manipulator 228.

[0025] The base 202 can provide a platform to provide support for the robotic device 200. The base 202 can be stationary or coupled to wheels to provide movement for the robotic device 200. The base 202 can include any number of materials, such as aluminum, steel, stainless steel, etc., that may be suitable for a given environment associated with the robotic device 200.

[0026] Links 206, 210, 214, 218, 222, and 226 may be configured to move according to a set of programmable instructions. For example, links may be configured to follow a predetermined sequence of motions (e.g., a limited range of motions based on a captured pose of the instrument) to accomplish a task under user supervision. By way of example, links 206, 210, 214, 218, 222, and 226 may form a kinematic chain that defines the relative movement of a given one of links 206, 210, 214, 218, 222, and 226 at a given one of joints 204, 208, 212, 216, 220, 224, and 230.

[0027] The joints 204, 208, 212, 216, 220, 224, and 230 can be configured to rotate using a mechanical gear system. In one example, the mechanical gear system is driven by a strain wave gear, a cycloidal drive, or the like. The mechanical gear system selected will depend on several factors related to the operation of the robotic device 200, such as the length of a given one of the links 206, 210, 214, 218, 222, and 226, the rotational speed, the desired gear reduction, etc. Providing power to the joints 204, 208, 212, 216, 220, 224, and 230 allows the links 206, 210, 214, 218, 222, and 226 to move in a manner that allows the manipulator 228 to interact with the environment.

[0028] In one example, the manipulator 228 is configured to enable the robotic device 200 to interact with an environment according to one or more constraints. In one example, the manipulator 228 performs proper placement of an element through various manipulations, such as grasping a surgical tool. As an example, the manipulator 228 can be replaced with another end effector that provides different functionality to the robotic device 200.

[0029] In one example, the robotic device 200 is configured to operate according to a robot operating system (e.g., an operating system designed for a particular function of a robot), which may provide libraries and tools (hardware abstraction, device drivers, visualizers, message passing, package management, etc.) to enable robotic applications.

[0030] FIG. 3 is a block diagram of a computing device 300 according to an exemplary embodiment. In some examples, some components shown in FIG. 3 may be distributed across multiple computing devices (desktop computers, servers, handheld devices, etc.). However, for the sake of example, the components are shown and described as part of one sample device. The computing device 300 may include an interface 302, a mobile unit 304, a control unit 306, a communication system 308, a data storage 310, and a processor 314. The components shown in FIG. 3 may be linked together by a communication link 316. In some examples, the computing device 300 may include hardware that enables communication within the computing device 300 and another computing device (not shown). In one embodiment, the robotic device 140 or the robotic device 200 may include the computing device 300.

[0031] The interface 302 may be configured to enable the computing device 300 to communicate with another computing device (not shown). Thus, the interface 302 may be configured to receive input data from one or more devices. In some examples, the interface 302 may also maintain and manage a record of data transmitted and received by the computing device 300. In other examples, the record of data may be maintained and managed by other components of the computing device 300. The interface 302 may also include a receiver and a transmitter for transmitting and receiving data. In some examples, the interface 302 may also include a user interface, such as a keyboard, microphone, touch screen, etc., for receiving input as well. Additionally, in some examples, the interface 302 may also interface with an output device, such as a display, speaker, etc.

[0032] In one example, the interface 302 can receive input indicative of position information corresponding to one or more elements of an environment in which a robotic device (e.g., robotic device 140, robotic device 200) resides. In this example, the environment can be an operating room in a hospital that includes a robotic device configured to function during a surgical procedure. The interface 302 can also be configured to receive information related to the robotic device. For example, the information related to the robotic device can include motion characteristics of the robotic device and a range of motion involving one or more components (e.g., joints 204, 208, 212, 216, 220, 224, and 230) of the robotic device (e.g., robotic device 140, robotic device 200).

[0033] The control unit 306 of the computing device 300 may be configured to execute control software that exchanges data with components (e.g., robotic arm 141, robotic pedals 142, joints 204, 208, 212, 216, 220, 224, and 230, manipulator 228) of the robotic device (e.g., robotic device 140, robotic device 200) and one or more other devices (e.g., processing device 122, tracking device 130, etc.). In communicating with the robotic device, the control software may communicate with a user via a user interface and a display monitor (e.g., display 126). The control software may also communicate with the tracking device 130 and processing device 122 via a wired communication interface (e.g., parallel port, USB, etc.) and / or a wireless communication interface (e.g., antenna, transceiver, etc.). The control software may communicate with one or more sensors to measure the effort exerted by the user with an instrument T attached to the robotic arm (e.g., robotic arm 141, link 226). The control software can communicate with the robotic arm to control the position of the robotic arm relative to the marker 150.

[0034] As described above, the control software may be in communication with the tracking device 130. In one scenario, the tracking device 130 may be configured to track a marker 150 attached to the patient P. By way of example, the marker 150 may be attached to the spinous processes of the vertebrae of the patient P. In this example, the marker 150 may include one or more infrared reflectors visible to the tracking device 130 to determine the position of the marker 150. In another example, multiple markers may be attached to one or more vertebrae and used to determine the position of the instrument T.

[0035] In one example, the tracking device 130 can provide updates to the position information of the markers 150 in near real-time to the control software of the robotic device 140. The robotic device 140 can be configured to receive updates to the position information of the markers 150 from the tracking device 130 via a wired and / or wireless interface. Based on the received updates to the position information of the markers 150, the robotic device 140 can be configured to determine one or more adjustments to the first position of the instrument T to maintain a desired position of the instrument T relative to the patient P.

[0036] In one embodiment, the control software may include independent modules. In an exemplary embodiment, these independent modules run simultaneously in a real-time environment and use a shared memory to ensure management of the various tasks of the control software. The modules may have different priorities, such as, for example, a safety module having the highest priority. The safety module may monitor the status of the robotic device 140. In one scenario, the safety module may send a command to the control unit 306 to stop the robotic arm 141 when a critical situation is detected, such as, for example, an emergency stop, a software failure, or a collision with an obstacle.

[0037] In one example, the interface 302 is configured to enable the robotic device 140 to communicate with other devices (e.g., the processing device 122, the tracking device 130). Thus, the interface 302 is configured to receive input data from one or more devices. In some examples, the interface 302 can also maintain and manage records of data sent and received by other devices. In other examples, the interface 302 can send and receive data using a receiver and a transmitter.

[0038] The interface 302 may be configured to manage communications between the user and the control software via a user interface and a display screen (e.g., via displays 123 and 124). The display screen may display a graphical interface that guides the user through different modes associated with the robotic device 140. The user interface may allow the user to control the movements of the robotic arm 141 associated with the initiation of a surgical procedure, to activate a given mode used during a surgical procedure, and to stop the robotic arm 141, for example, as needed.

[0039] The movement unit 304 may be configured to determine movements associated with one or more components of the robotic arm 141 to perform a given procedure. In one embodiment, the movement unit 304 may be configured to determine a trajectory of the robotic arm 141 using forward and reverse kinematics. In one scenario, the movement unit 304 may access one or more software libraries to determine the trajectory of the robotic arm 141. In another example, the movement unit 304 is configured to receive one or more instructions from the processing device 122 to actuate one or more components of the robotic device 140 according to a determined range of movement of a surgical tool at a surgical site.

[0040] The mobile unit 304 may include a force module to monitor forces and torques measured by one or more sensors coupled to the robotic arm 141. In one scenario, the force module may detect a collision with an obstacle and be able to alert a safety module.

[0041] The control unit 306 may be configured to manage functions associated with various components of the robotic device 140 (e.g., the robotic arm 141, the pedals 142, etc.). For example, the control unit 306 may send one or more commands to maintain a desired position of the robotic arm 141 relative to the marker 150. The control unit 306 may be configured to receive movement data from the movement unit 304.

[0042] In one scenario, the control unit 306 can instruct the robot arm 141 to function according to a collaborative mode. In the collaborative mode, a user can manually move the robot arm 141 by holding a tool T coupled to the robot arm 141 and moving the tool T to a desired position. In one example, the robotic device 140 can include one or more force sensors coupled to an end effector of the robot arm 141. As an example, when a user grabs the tool T and begins to move it in a direction, the control unit 306 receives the forces measured by the force sensors and combines them with the position of the robot arm 141 to generate the movement desired by the user.

[0043] In one scenario, the control unit 306 can instruct the robotic arm 141 to function according to a given mode that causes the robotic device 140 to maintain a relative position of the instrument T with respect to a given IR reflector or emitter (e.g., marker 150). In one example, the robotic device 140 can receive updated position information of the marker 150 from the tracking device 130 and adjust as necessary. In this example, the movement unit 304 can determine, based on the received updated position information of the marker 150, which joint(s) of the robotic arm 141 need to move to maintain the relative position of the instrument T with the marker 150.

[0044] In another scenario, a restrictive cooperative mode can be user-defined to restrict the movement of the robotic device 140. For example, the control unit 306 can restrict the movement of the robotic arm 141 to a plane or axis depending on the user's preference. In another example, the robotic device 140 can receive information regarding one or more predefined boundaries within a surgical site that must not be intersected by a surgical tool or implant based on user-guided movement of the robotic arm 141.

[0045] In one embodiment, the robotic device 140 may be in communication with the processing device 122. In one example, the robotic device 140 may provide position and orientation data of the instrument T to the processing device 122. In this example, the processing device 122 may be configured to store the position and orientation data of the instrument T for further processing. In one scenario, the image processing device 122 may overlay a virtual representation of the instrument T on the display 126 using the received position and orientation data of the instrument T.

[0046] In one embodiment, a sensor configured to detect pressure or force may be coupled to the last joint of the robotic arm (e.g., link 226). Based on a particular movement of the robotic arm, the sensor may provide a reading of the pressure applied to the last joint of the robotic arm to a computing device (e.g., a control unit of the robotic device). In one example, the robotic device may be configured to communicate the force or pressure data to a computing device (e.g., processing device 122). In another embodiment, the sensor may be coupled to an instrument such as a retractor. In this embodiment, the force or pressure applied to the retractor and detected by the sensor may be provided to the robotic device (e.g., robotic device 140, robotic device 200) or a computing device (e.g., processing device 122), or both, for further analysis.

[0047] In one scenario, the robotic device can access motion data stored in the robotic device's memory to retrace motion along the determined motion path. In one example, the robotic device can be configured to move a surgical tool along the determined motion path to or from a surgical site.

[0048] In another scenario, once an instrument coupled to a robotic arm of a robotic device (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226) reaches a desired pedicle screw trajectory, The robotic device can be configured to receive input from the surgeon and move along the desired pedicle screw trajectory. In one example, the surgeon can provide input to the robotic device (e.g., pressing pedal 142) to confirm the surgeon's decision to allow the robotic device to move along the desired pedicle screw trajectory. In another example, a user can provide another form of input to either the robotic device or a computing device to assist in the movement of the instrument along the determined path of motion.

[0049] In one scenario, once confirmation is received that the robotic device will move along the desired pedicle screw trajectory, the robotic device can receive instructions from the movement unit 304 to pivot from the current trajectory to the desired pedicle screw trajectory. The movement unit 304 can provide the necessary movement data to the control unit 306 to enable the robotic device to move along the desired pedicle screw trajectory.

[0050] In another aspect, the robotic device (e.g., robotic device 140, robotic device 200) can be configured to pivot about critical areas based on the captured pose of the surgical tool (e.g., instrument T). For example, the robotic device can be configured to rotate the retractor about the retractor tip so that all steps associated with retracting the soft tissue do not have to be repeated. In one example, the movement unit 304 can determine the trajectory required to pivot the retractor.

[0051] In one example, the robotic device can be coupled to a retractor that holds soft tissue away from the surgical site. In this example, the surgeon may need to slightly reposition the retractor due to patient movement. To do so, the surgeon can activate a mode of the robotic device that pivots the retractor by moving the robotic arm (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226) according to a trajectory determined by the movement unit 304. In one example, a user can input a direction and amount of a desired movement via a computing device (e.g., processing device 122, computing device 300). After inputting the direction and amount of movement, the user (e.g., the surgeon) can interface with the robotic device (e.g., by stepping on pedal 142) to initiate the movement of an instrument coupled to the robotic arm. In one example, the robotic device allows the user to view different lateral aspects of an anatomical structure without leaving the docking point.

[0052] In another example, the movement unit 304 may provide one or more trajectories for moving the surgical tool (e.g., instrument T) based on the captured pose of the surgical tool to a computing device (e.g., processing device 122) for display on the display 126. In this example, a user may select from one or more restricted movements associated with a given step of a surgical procedure. For example, the one or more restricted movements may be associated with a particular direction and amount of movement to be performed by an individual through use of one or more buttons coupled to the robotic device 140 and applying a force to a portion of the robotic device 140.

[0053] In one scenario, a robotic arm of a robotic device can be coupled to an instrument such as an expander. In this scenario, the robotic device can receive one or more commands to pivot about the distal end of the expander by predetermined degrees. The movement unit 304 can be configured to determine a trajectory required to perform the pivot and provide the determined trajectory information to the control unit 306 for moving the robotic device.

[0054] In another aspect, one or more infrared (IR) reflectors or emitters may be coupled to a robotic arm (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226) of a robotic device (e.g., robotic device 140, robotic device 200). In one scenario, tracking device 130 may be configured to determine the location of one or more IR reflectors or emitters before initiating an operation of the robotic device. In this scenario, tracking device 130 may provide location information of one or more IR reflectors or emitters to a computing device (e.g., processing device 122, computing device 300) for further processing.

[0055] In one example, the processing device 122 or the computing device 300 may be configured to compare position information of one or more IR reflectors or emitters coupled to the robot arm with data stored in a local or remote database containing information about the robot device (e.g., a geometric model of the robot device) to assist in determining the position or location of the robot arm. In one example, the processing device 122 may determine a first position of the robot arm from information provided by the tracking device 130. In this example, the processing device 122 may provide the determined first position of the robot arm to the robot device or a computing device (e.g., the computing device 300). In one example, the robot device may use the received first position data to perform a calibration of one or more elements (e.g., encoders, actuators) associated with one or more joints of the robot arm.

[0056] In one scenario, an instrument coupled to a robotic arm of a robotic device can be used to determine the difference between an expected tip position of the instrument and an actual tip position of the instrument. In this scenario, the robotic device can proceed to move the instrument to a known location via the tracking device 130 such that the tip of the tool comes into contact with the known location. The tracking device 130 can capture position information corresponding to one or more IR reflectors or emitters coupled to the robotic arm and provide the information to the robotic device or a computing device (e.g., the processing device 122, the computing device 300). Additionally, either the robotic device or the computing device can be configured to adjust the coordinate system offset between the robotic device and the tracking device 130 based on the expected tip position of the tool and the actual tip position of the tool.

[0057] In another aspect, the force or pressure sensor may be coupled to a robotic arm (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226) of a robotic device (e.g., robotic device 140, robotic device 200). In one example, the force or pressure sensor may be located at an end effector of the robotic arm. In another example, the force or pressure sensor may be coupled to a particular joint of the robotic arm. The force or pressure sensor may be configured to determine when a force or pressure reading exceeds a rest threshold. The rest threshold may be based on a force or pressure experienced at the sensor when the end effector is holding the instrument without applying any additional force or pressure to the instrument (e.g., a user attempting to move the instrument). In one example, when the force or pressure reading is at or below the rest threshold, movement of the robotic arm may be stopped.

[0058] In one example, the movement of the robotic arm 141 can be controlled by pressing the pedal 142. For example, while the pedal 142 is being pressed, the control unit 306 and the movement unit 304 can be configured to receive either force or pressure measurements from one or more force sensors and use the received information to determine the trajectory of the robotic arm 141.

[0059] In another example, the movement of the robotic arm 141 may be adjusted depending on how far the pedal 142 is depressed. For example, if the user presses the pedal 142 all the way down, the robotic arm 141 may move faster compared to when the pedal 142 is pressed down half way. In another example, the movement of the robotic arm 141 may be controlled by a user interface located on the robotic device.

[0060] In one example, a robotic device (e.g., robotic device 140, robotic device 200) may be configured to store in a local or remote memory motion data corresponding to a determined range of motion associated with a surgical tool. In this example, the robotic device may be configured to move only in one or more directions as defined by the determined range of motion.

[0061] In another example, an instrument coupled to the robotic arm may include a switch in communication with the robotic device. The switch may be in the form of a button that provides a signal to the robotic device to move the robotic arm according to forces detected by a force or pressure sensor associated with the end effector or one or more joints of the robotic arm. In this example, when the surgeon releases the switch, the robotic device interprets the movement as a stop command and maintains the position of the instrument.

[0062] In one example, the surgeon can incorporate the use of a three-dimensional image of the spine to define one or more planes that the instrument should not cross. In this example, the robotic arm does not allow the surgeon to move the instrument beyond the defined one or more planes according to constraints associated with a predefined plan, even though force or pressure sensors detect the force to move the instrument. As an example, the robotic device can be configured to provide a warning to the surgeon when the instrument approaches one or more restricted planes.

[0063] In another aspect, a robotic device (e.g., robotic device 140, robotic device 200) can be used to navigate one or more surgical instruments and provide navigation information to a computing device (e.g., processing device 122, computing device 300) for further processing. In one example, the computing device can be configured to determine a virtual representation of the surgical tool. Additionally, the computing device can be configured to overlay the virtual representation of the surgical tool onto a two-dimensional or three-dimensional image of the surgical site.

[0064] In one example, the robotic device can perform a calibration procedure between the tracking device 130 to remove reliance on the tracking device 130 for position information when line of sight between the robotic device and the tracking device 130 is interrupted. In one example, using a robotic device registered to a navigation system as described herein and a three-dimensional image of the patient corresponding to the surgical site can allow the robotic device to be independent of the distance-related degradation of accuracy associated with the tracking device 130.

[0065] The communications system 308 may include a wired communications interface (e.g., parallel port, USB, etc.) and / or a wireless communications interface (e.g., antenna, transceiver, etc.) to receive and / or provide signals to and from external devices. In some examples, the communications system 308 may receive instructions for operation of the processing device 122. Additionally or alternatively, in some examples, the communications system 308 may provide output data.

[0066] The data storage 310 can store program logic 312 that can be accessed and executed by the processor(s) 314. The program logic 312 can include instructions that provide control to one or more components of the processing device 122, the robotic device 140, the robotic device 200, etc. For example, the program logic 312 can provide instructions to coordinate the operation of the robotic device 200 based on one or more user-defined trajectories associated with the portable device. The data storage 310 can include one or more volatile and / or one or more non-volatile storage components, e.g., optical, magnetic, and / or organic storage, and the data storage can be integrated in whole or in part with the processor(s) 314.

[0067] The processor 314 may include one or more general purpose processors and / or one or more special purpose processors. To the extent the processor 314 includes more than one processor, such processors may operate separately or in combination. For example, a first processor may be configured to operate the mobile unit 304, and a second processor of the processor 314 may operate the control unit 306.

[0068] Additionally, while each of the components is shown as being integrated into the processing device 122, the robotic device 140, or the robotic device 200, in some embodiments, one or more components may be removably attached to be otherwise connected (e.g., mechanically or electrically) to the processing device 122, the robotic device 140, or the robotic device 200 using a wired or wireless connection.

[0069] In another example, the robotic device may assist in tracking an instrument coupled to a robotic arm at one or more locations during a surgical procedure. Tracking the instrument via the movement of the robotic device may allow the instrument to be placed in a location that is difficult for the surgeon to see. For example, an instrument may be placed behind a drape but tracked via the robotic device and a computing device (e.g., processing device 122, computing device 300). In another example, the robotic device may assist in tracking the movement of a patient under a sterile barrier. In this example, the robotic device may be used to reposition a bed to keep the patient in a known orientation during a surgical procedure.

[0070] In another aspect, a robotic device (e.g., robotic device 140, robotic device 200) may be configured to receive one or more constraints corresponding to movements associated with a robotic arm (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226). For example, a surgeon may want to define an area in which the robotic device can move around during a surgical procedure. In one scenario, the surgeon may view a three-dimensional representation of the patient's anatomy on the display 126 and input one or more boundaries associated with the movements of the robotic arm. In another scenario, the surgeon may view a two-dimensional representation of the patient's anatomy on the display and define one or more boundaries via a touch screen associated with the display 126.

[0071] In one example, a surgeon can input a path for a surgical procedure before starting the surgical procedure. For example, the surgeon may use a two-dimensional or three-dimensional image of the patient's anatomy to determine a path to reach the surgical site. In one example, a computing device (e.g., processing device 122, computing device 300) can store information corresponding to a predetermined path and provide the information to the robotic device before starting the surgical procedure. Once the robotic device knows its position relative to the patient, the mobile unit 304 can use the information corresponding to the predetermined path to determine one or more allowable trajectories.

[0072] In another example, the path to reach the surgical site may include a constraint corresponding to a particular penetration depth during a single pass of the robotic arm. For example, the movement of the robotic arm may be limited by a maximum amount selected by the surgeon. In one scenario, the limit may be signaled by another sensor associated with detecting electromyographic (EMG) responses.

[0073] In one scenario, a robotic arm may be coupled to an instrument used to remove bone. In this scenario, the robotic device may receive one or more commands related to removing a particular amount of bone, for example, removing 1 millimeter of bone. The robotic device may be configured to provide notification to the surgeon when the bone removal procedure is complete via an audible or visual signal. In another scenario, the robotic device may receive one or more commands related to continuing to remove bone until 2 millimeters of bone remain.

[0074] In another example, the path to restrict the movement of the robotic arm may correspond to one or more inputs corresponding to an anatomical segmentation. For example, the surgeon may select a particular vertebra to restrict the movement of the robotic arm to that particular vertebra. By way of example, the robotic device may be further instructed to restrict the movement of the robotic arm to a particular portion of a vertebra (e.g., a spinous process, etc.).

[0075] In another aspect, a robotic device (e.g., robotic device 140, robotic device 200) can be coupled to an end effector that assists in the retraction of soft tissue and the insertion of fasteners into the patient's vertebrae. As an example, plates used in spinal surgery have a known shape that fasteners can properly engage and lock into their final position. Plates typically require screw / drill guides to control the placement of the threaded fasteners. The guides often protrude and interfere with the soft tissue that cannot support prolonged retraction.

[0076] In one embodiment, the end effector can be coupled to a robotic arm (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226) and can assist in the placement of fasteners. In one scenario, the robotic device can receive three-dimensional geometric information about a plate being used in a surgical procedure from a computing device (e.g., processing device 122, computing device 300).

[0077] In one example, a particular plate may require four fasteners to be installed during a surgical procedure. In this example, the robotic device may use the end effector to retract soft tissue corresponding to a first fastener location of a given plate based on a trajectory determined by the movement unit 304. Additionally, the movement unit 304 may also be configured to determine an optimal trajectory for placing fasteners through a given plate. Following placement of the first fastener, the robotic device may be configured to move the end effector in a manner that allows the soft tissue to return to its original position and move to retract soft tissue corresponding to a second fastener location of the given plate. In this example, the robotic device may minimize the time the soft tissue is retracted, thereby reducing the risk of damaging the soft tissue when installing each of the fasteners in a given plate.

[0078] In one example, the movement unit 304 can be configured to determine the amount of angulation associated with a given plate to further facilitate placement of fasteners. As an example, the surgeon can guide the robotic arm (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226) until the robotic device detects an intersection of a predetermined optimal path as described above. In this example, the robotic device can be configured to pivot at the intersection of the predetermined optimal path and continue along the path to install the fasteners in the given plate. In one example, the end effector used to install the fasteners can incorporate additional sensors that are used to detect problems that may occur during the surgical procedure while retracting the soft tissue.

[0079] In another aspect, a robotic device (e.g., robotic device 140, robotic device 200) can use position information captured by tracking device 130 to determine a position of an instrument coupled to a robotic arm (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226) relative to a patient. In one embodiment, the robotic device can use motion information determined by encoders associated with one or more joints (e.g., joints 204, 208, 212, 216, 220, and 224) of the robotic device to determine a position of a surgical tool after a calibration procedure between the robotic device and tracking device 130. In another embodiment, tracking device 130 can provide position information to a computing device (e.g., processing device 122, computing device 300) to assist in tracking the robotic device during a surgical procedure.

[0080] In one example, the tracking device 130 can track a position of an instrument coupled to a robotic arm based on one or more IR reflectors or emitters. For example, the tracking device 130 can detect an IR reflector or emitter coupled to a tool and provide position information to the processing device 122. The processing device 122 can be configured to compare the last known position information of the IR reflector or emitter coupled to the instrument with the most recent position information to determine a change in position associated with the instrument.

[0081] In one embodiment, based on the determined change in the position of the instrument, the processing device 122 may be configured to determine image data related to one or more changes in the volume of the disc or bone corresponding to the position of the instrument. In one example, based on the determined image data, the amount of the disc or bone removed may be virtually represented via the display 126. For example, the amount of the disc or bone may be shown by removing data corresponding to the path traveled by the instrument based on the position information of an IR reflector or emitter coupled to the instrument. In another example, in a procedure involving using a drill on bone in one or more passes, each pass is expected to remove a portion of the patient's anatomy. In this example, each time the surgical tool passes through the disc, the image data (e.g., pixels) representing the amount of disc removed may be changed to a different color (e.g., red) to indicate that the corresponding volume of disc has been removed.

[0082] In another example, a virtual representation of a path associated with an instrument coupled to a robotic arm can be overlaid on a corresponding location of the patient's anatomy. The virtual representation of the path can be displayed with various visual effects to indicate multiple passes by the instrument over a particular region of the spine. Additionally, as described above, the robotic device can be configured to prevent the user from continuing to remove disk space based on one or more predetermined boundaries corresponding to the movement of the surgical tool.

[0083] In another aspect, a robotic device (e.g., robotic device 140, robotic device 200) may include multiple robotic arms (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226). In one scenario, as described above, the robotic device and tracking device 130 may have completed a registration process to correct for offsets between each of their coordinate systems. In this scenario, in addition to completing the registration process, the processing device 122 may be configured to receive a 3D scan of the patient's spine. In one embodiment, the robotic device may be configured to maintain the patient's spinal alignment according to a preoperative plan of spinal alignment.

[0084] In one example, the robotic device can use end effectors configured to grip key elements of the surgical procedure. For example, the robotic device can grip a first pedicle screw using a first gripper coupled to a robotic arm and grip a second pedicle screw using a second gripper coupled to a second robotic arm. The robotic device can be configured to provide position information associated with each of the first and second robotic arms to a computing device (e.g., processing device 122, computing device 300). Based on the received position information, the computing device can determine a current spinal alignment. Additionally, the computing device can analyze the current spinal alignment to determine spinal corrections required during the surgical procedure.

[0085] For example, the analysis of the current spinal alignment may include comparing the current spinal alignment to a preoperative plan of spinal alignment. In one scenario, the processing computing device may determine an offset between the current spinal alignment and the preoperative plan of spinal alignment. Further, the computing device may be configured to determine an amount of movement required to bring the current spinal alignment to the preoperative plan of spinal alignment.

[0086] In one scenario, the computing device may determine that a rotation of two degrees by the first robotic arm would be helpful in restoring the current spinal alignment to the pre-operative plan. In this scenario, the computing device may provide the necessary rotation information to the robotic device. As an example, the mobile unit 304 may determine a trajectory required to achieve the two degrees rotation by the robotic arm. Based on the determined trajectory, The control unit 306 can provide one or more commands to actuate one or more joints of the robotic arm.

[0087] In another scenario, the processing device 122 can determine that a two degree rotation by the first robotic arm and one degree rotation by the second robotic arm will restore the current spinal alignment to the pre-operative plan. In this scenario, the processing device 122 can provide the required rotations to the robotic device 140. As described above, the computational module of the robotic device 140 can determine the trajectories required to achieve the required movements by the first and second robotic arms.

[0088] In another scenario, the robotic device may support a surgical table on which a patient rests. In this scenario, the robotic device may also be configured to adjust the surgical table in addition to performing one or more spinal movements to achieve spinal alignment.

[0089] In another aspect, a robotic arm (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226) of a robotic device (e.g., robotic device 140, robotic device 200) may be configured to receive an ultrasound probe. In one scenario, the ultrasound probe is held by the robotic arm in a known orientation, so that either the robotic arm or a co-registered navigation system is used to register the position of the anatomical structures in the image for subsequent measurements on the image (e.g., robot-to-robot registration device 140 or robotic device 200 and tracking device 130).

[0090] In one example, one or more IR emitters or reflectors can be coupled to the ultrasound probe. The tracking device 130 can capture position information of the one or more IR emitters or reflectors coupled to the ultrasound probe. In this example, the position of the robot arm 141 can be tracked using the one or more IR emitters or reflectors to co-register the robot arm and ultrasound probe with an image captured by the ultrasound probe.

[0091] In another aspect, a robotic arm (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226) of a robotic device (e.g., robotic device 140, robotic device 200) may be coupled to a pressure sensing endplate pusher. The pressure sensing endplate pusher may include two plates that may be actuated separately. In one scenario, a first plate of the pressure sensing endplate pusher may be applied to a lower endplate of an upper vertebra. In this scenario, a second plate of the pressure sensing endplate pusher may be applied to an upper endplate of a lower vertebra. In one embodiment, the pressure sensing endplate pusher may include one or more sensors to detect a force on each of the first and second plates.

[0092] In one embodiment, The plates of the pressure-sensing endplate pusher are coupled to actuators that can move each plate individually. In one scenario, the robotic device can provide a feedback force (pressure since the area of ​​the plates is known) to a computing device (e.g., processing device 122) for further analysis. Each of the plates is sized significantly to cover the same area as the implant used when fully inserted between the two vertebrae. This allows for realistic biomechanical forces to be applied to the anatomical structure and provides feedback to ensure the patient is not loaded to a level that would cause subsequent decompression between the two vertebrae.

[0093] The plate acts on each endplate to provide the proper height and angle, allowing the surgeon to properly size the implant height and angle to maximize indirect decompression and minimize stress on the endplate that would cause subsidence. In one scenario, the robotic device could be provided with patient demographic information in addition to bone density to determine the level of force to be applied through the use of a pressure-sensing endplate pusher.

[0094] In another aspect, a robotic arm (e.g., robotic arm 141, links 206, 210, 214, 218, 222, and 226) of a robotic device (e.g., robotic device 140, robotic device 200) may be coupled to a retractor. In one embodiment, the retractor may include one or more sensors to detect pressure applied to the retractor. As the retractor is controlled by the robotic device, the robotic device may be configured to provide pressure information to a computing device (e.g., processing device 122, processing device 300).

[0095] In one example, the computing device can analyze the pressure data to determine whether one or more soft tissues are associated with pressures that exceed a safety threshold. In this example, the computing device can instruct the robotic device to reduce the amount of contraction associated with the soft tissues as well as communicate this information to the user via the display 126.

[0096] Since the force on the robot is known and the retractor area is also known, the computing device can be configured to convert both into pressure. In one example, the display 126 can be configured to display a graphical user interface (GUI) that can provide a graduated indicator of how much pressure is applied relative to the maximum amount of pressure allowed. In one embodiment, the robotic device can be configured to hold the load at any spot along its relative gauge. In another example, according to the preoperative plan, the robotic device can be configured to only retract to a certain pressure.

[0097] 4 illustrates an exemplary computer-readable medium configured in accordance with an exemplary embodiment. In an exemplary embodiment, an exemplary system may include one or more processors, one or more types of memory, one or more input devices / interfaces, one or more output devices / interfaces, and machine-readable instructions that, when executed by the one or more processors, cause the system to perform the various functional tasks, functions, etc. described above.

[0098] As noted above, in some embodiments, the disclosed techniques (e.g., functionality of robotic device 140, robotic device 200, processing device 122, computing device 300, etc.) may be implemented by computer program instructions encoded on a machine-readable form of a computer-readable storage medium, or other medium or article of manufacture. Figure 4 is a schematic diagram illustrating a conceptual partial view of an exemplary computer program product including a computer program for executing a computer process on a computing device, arranged in accordance with at least some embodiments disclosed herein.

[0099] In one embodiment, the exemplary computer program product 400 is provided using a signal bearing medium 402. The signal bearing medium 402 can include one or more programming instructions 404 that, when executed by one or more processors, can provide the functionality or a portion of the functionality described above with respect to FIGS. 1-3. In some examples, the signal bearing medium 402 can be a computer readable medium 406, such as, but not limited to, a hard disk drive, a compact disc (CD), a digital video disc (DVD), digital tape, a memory, etc. In some implementations, the signal bearing medium 402 can be a computer recordable medium 408, such as, but not limited to, a memory, a read / write (R / W) CD, a R / W DVD, etc. In some implementations, the signal bearing medium 402 can be a communication medium 410 (e.g., fiber optic cable, a wave guide, a wired communication link, etc.). Thus, for example, the signal bearing medium 402 can be conveyed by a wireless form of the communication medium 410.

[0100] The one or more programming instructions 404 may be, for example, computer-executable and / or logic-implemented instructions. In some examples, a computing device may be configured to provide various operations, functions, or actions in response to the programming instructions 404 communicated to the computing device by one or more of the computer-readable medium 406, the computer-recordable medium 408, and / or the communication medium 410.

[0101] The computer-readable medium 406 may also be distributed across multiple data storage elements that may be located remotely from each other. The computing device that executes some or all of the stored instructions may be an external computer or a mobile computing platform such as a smart phone, tablet device, personal computer, wearable device, etc. Alternatively, the computing device that executes some or all of the stored instructions may be a remotely located computer system such as a server.

[0102] 5 and 6 are flow diagrams of an exemplary method during a surgical procedure, according to at least one or more embodiments described herein. Although the blocks in each diagram are shown in sequence, in some cases the blocks may be performed in parallel and / or in a different order than that described therein. Also, various blocks may be combined into fewer blocks, split into additional blocks, and / or eliminated based on the desired implementation.

[0103] Further, the flow diagrams of Figures 5 and 6 illustrate the functions and operations of possible implementations of the present embodiment. In this regard, each block may represent a module, segment, or portion of program code, and includes one or more instructions executable by a processor to implement a particular logical function or step in a process. The program code may be stored in any type of computer-readable medium, such as a storage device including, for example, a disk or a hard drive. The computer-readable medium may include a non-transitory computer-readable medium that stores data for a short period of time, such as a register memory, a processor cache, or a random access memory (RAM), and / or a persistent long-term memory, such as a read-only memory (ROM), an optical or magnetic disk, a compact disk read-only memory (CD-ROM), and the like. The computer-readable medium may be or include any volatile or non-volatile storage system. The computer-readable medium may be considered, for example, as a computer-readable storage medium, a tangible storage device, or other article of manufacture.

[0104] Alternatively, each block in Figures 5 and 6 may represent a circuit that is hardwired to perform a particular logical function in a process. The exemplary method as illustrated in Figures 5 and 6 may be performed in whole or in part by one or more components in the cloud and / or system 100 of Figure 1. However, it should be understood that the exemplary method may instead be performed by other entities or combinations of entities (i.e., by other computing devices and / or combinations of computer devices) without departing from the scope of the present invention. For example, the functions of the methods in Figures 5 and 6 may be performed entirely by a computing device (or a component of a computing device, such as one or more processors), or may be distributed across multiple components of a computing device, multiple computing devices (e.g., control unit 118 and image processing device 122 of Figure 1), and / or servers.

[0105] 5, an exemplary method 500 during a surgical procedure may include one or more operations, functions, or actions as illustrated by blocks 502 through 508. In one embodiment, method 500 is performed in whole or in part by system 100 of FIG.

[0106] As shown at block 502, the method 500 includes capturing a pose of a surgical tool at a surgical site of a patient. In one example, the tracking device 130 may be configured to capture one or more images of the instrument T as it is used in a surgical procedure. The captured one or more images are processed to determine orientation and position data associated with one or more IR markers coupled to the instrument T. The determined orientation and position data associated with the one or more IR markers are then used to determine three-dimensional pose data of the instrument T over a given period of time. In one example, the instrument T may be placed at a known location in the operating room to indicate a trigger to capture motion data. Continuing with this example, the processing device 122 may be configured to determine that the instrument T has not moved within a predetermined time as an indicator to terminate the capture of motion data. In another example, a button may be pressed on a user interface, such as the display device 126 or the interface 125, to toggle between starting and stopping the capture of motion data associated with the instrument T.

[0107] As indicated by block 504, the method 500 includes determining a range of motion of a surgical tool at the surgical site in response to the captured pose. In one example, the determined range of motion is based on a pivot of the surgical tool within a critical region of the surgical site. In one example, the critical region is based on a 5 millimeter diameter.

[0108] In one example, the method 500 also includes determining a second range of motion corresponding to the captured pose. In this example, the method can also compare the range of motion to the second range of motion. Based on the comparison, the method can also include providing instructions to adjust a position of the surgical tool. For example, the processing device 122 can be configured to determine the second range of motion based on an offset of a current position of the surgical tool. In this example, the second range of motion can allow for additional degrees of rotation of the surgical tool by adjusting the current position of the surgical tool to an offset position.

[0109] In another example, the surgical site includes a vertebra. In this example, the method may include determining the range of motion based on detection of one or more edges corresponding to the vertebra. For example, the processing device 122 may include computer executable instructions configured to perform a segmentation step. As used herein, "segmentation" describes the process of identifying individual vertebrae in the three-dimensional image data so that the vertebrae can be processed, manipulated, and displayed separately from one another. The segmentation step may employ a segmentation algorithm that uses image processing and image recognition software to automate the spinal level segmentation process. In one embodiment, the computer executable instructions automatically identify and extract the curves of the spine, detecting and identifying the individual vertebrae until they are segmented from one another. One or more adaptive meshes may be applied to generate a segmented three-dimensional model of the spine. Each vertebra or other anatomical feature may be colored separately to visually highlight the bone-soft tissue interface, or only the margins may be colored.

[0110] As indicated by block 506, the method 500 includes displaying a representation of the determined range of motion in an image associated with the surgical site. With reference to FIG. 7, FIG. 7 illustrates an exemplary two-dimensional image 700 of a surgical site including vertebrae 702 and a surgical tool 704. In one example, a pose of the surgical tool 704 is captured and used to determine the range of motion of the surgical tool 704. In one example, a processing device (e.g., processing device 122) may be configured to determine an axis 706 for pivoting the surgical tool 704. The processing device may also be configured to determine a range of angles 708 in one or more planes for pivoting the surgical tool 704 about the axis 706. In one example, the image 700 may be displayed on a display (e.g., display 126). This allows a user (e.g., a surgeon) to view at least one representation of the axis 706 and the range of degrees 708 to make an informed decision before proceeding to the next step of the surgical procedure.

[0111] 5, as indicated at block 508, the method 500 includes providing one or more instructions to restrict a movement of the robotic device according to the determined range of movement. In one example, the one or more instructions include a robot movement that restricts an end effector of the robotic device to a particular position in space based on the determined range of movement. In one example, the method also includes providing instructions to stop any movement associated with the robotic device. In one example, the one or more instructions may be provided via a wireless or wired communication interface between the processing device 122 and the robotic device 140.

[0112] 6, an exemplary method 600 during a surgical procedure may include one or more operations, functions, or actions as illustrated by blocks 602 through 608. In one embodiment, method 600 is performed in whole or in part by system 100 of FIG.

[0113] As indicated by block 602, method 600 includes capturing a pose of a surgical tool at a surgical site on a patient, the surgical tool being coupled to a robotic device. Block 602 may be functionally similar to block 502 of method 500.

[0114] As indicated by block 604, method 600 includes determining, in response to the captured pose, (i) an axis for pivoting the surgical tool and (ii) a range of degrees in one or more planes for pivoting the surgical tool about the axis.

[0115] As indicated by block 606, method 600 includes displaying a representation of at least one of the axis and the extent range on the display. Block 606 may be functionally similar to block 506 of method 500. In one example, with the assistance of the robotic device 140, an instrument T is advanced by a surgeon to a pedicle target site where a pilot hole is to be formed to form a pilot hole for placing a pedicle screw in a vertebral pedicle. In this example, the tracking device 130 is configured to capture a position and orientation of the instrument T and provide the position and orientation information to the processing device 122. Continuing with this example, the processing device 122 is configured to provide an image of the surgical site for display and at least one of the representations of the axis and the extent range on the display.

[0116] As indicated by block 608, method 600 also includes providing one or more instructions to limit the movement of the robotic device according to an axis and a range of degrees in one or more planes. Block 608 may be functionally similar to block 508 of method 500. In one example, a set of robot joint parameters including joint angles, velocities, and / or accelerations may be determined to limit the movement of the robotic device according to an axis and a range of degrees in one or more planes. In one embodiment, the robotic movement may be modified to smooth the motion curve of the robot and / or robotic tool to avoid jerking or disconnected movements while the user is rotating the surgical tool.

[0117] It should be understood that the arrangements described herein are for illustrative purposes only. Thus, one of ordinary skill in the art will recognize that other arrangements and other elements (e.g., machines, interfaces, functions, orders, and groupings of functions, etc.) can be used instead, and that some elements may be omitted entirely depending on the desired results. Furthermore, many of the described elements are functional entities that can be implemented in any suitable combination and location, as separate or distributed components, or in combination with other components, or can be combined with other structural elements described as independent structures. [Explanation of symbols]

[0118] 100 Systems 102 Base Unit 103 C-Arm 104 Radiation source 105 Receiver 108 Arrow 110 Control Panel 122 Processing Device 123, 124 Display 125 Input devices and interfaces 126 Display 130 Tracking Devices 131, 132 Sensors 140 Robot Device 142 Pedals 143 Movable Housing

Claims

1. 1. A system comprising: Tracking devices; Robotic devices; A force or pressure sensor; and 1. A processing device comprising: A processor; and A non-transitory computer-readable medium having instructions stored thereon that, when executed by the processor, can: causing the system to capture, via the tracking device, a pose of a surgical tool at a surgical site on a patient, the captured pose including position and orientation information of the surgical tool, the surgical tool being coupled to a robotic device; causing the system to determine, by the processor, in response to the captured pose, an axis about which to pivot the surgical tool and a range of motion of the surgical tool at a surgical site, the range of motion including a predetermined angular range for pivoting the surgical tool about the axis; causing the system to display a representation of the determined range of motion on an image associated with the surgical site by displaying how many degrees the surgical tool can be angled from a current position of the surgical tool; and causing the system to provide one or more instructions to the robotic device to restrict movement of the robotic device according to the determined range of movement; non-transitory computer readable medium; a processing device including: the force or pressure sensor is coupled to the robotic device and configured to determine when a force or pressure reading is equal to or less than a rest threshold, the rest threshold being determined based on a force or pressure experienced at the force or pressure sensor when the robotic device is holding the surgical tool without applying any additional force or pressure to the surgical tool to move the surgical tool, and further configured to indicate that the robotic device should stop moving in the determined range of motion when the force or pressure reading is equal to or less than the rest threshold.

2. 2. The system of claim 1, wherein an axis for pivoting the surgical tool is within a predetermined critical area at the surgical site, the predetermined critical area being an area predetermined to reduce a risk of damaging tissue surrounding the surgical site caused by pivoting the surgical tool.

3. The non-transitory computer readable medium stores instructions that, when executed by the processor, further: causing the system to determine a second range of motion corresponding to the captured pose, the second range of motion being determined by the processor in response to the captured pose by determining an axis for pivoting the surgical tool at an offset position, the second range of motion comprising a predetermined range of angles for pivoting the surgical tool about the determined axis at the offset position, and thus comprising a degree of rotation of the surgical tool at the offset position; causing the system to compare the range of motion to the second range of motion; and causing the system to evaluate a position of the surgical tool based on the comparison and provide instructions to the robotic device to adjust a position of the surgical tool based on the evaluation; The system of claim 1 .

4. 2. The system of claim 1, wherein the surgical site includes a vertebra, and wherein the range of motion is determined based on detection of one or more edges corresponding to the vertebra.

5. The system of claim 1 , wherein providing instructions to limit movement of the robotic device according to the determined range of movement includes instructions to stop any movement of the robotic device.

6. The system of claim 2 , wherein a portion of the robotic device pivots about a distal end of the surgical tool.

7. The system of claim 1 , wherein the range of motion of the surgical tool at the surgical site is determined based on a particular vertebra selected.

8. 2. The system of claim 1, wherein providing instructions to limit movement of a robotic device according to the determined range of movement includes instructions to limit movement of the robotic device to an angular range for pivoting the surgical tool about the axis.

Images