Method for planning and performing robotic dental procedures
The method of using a tracking arm to establish a reference frame for dental procedures without prior imaging addresses the inefficiencies of existing robot-assisted methods, enabling timely and cost-effective planning and execution.
Patent Information
- Application Number
- JP2024528526
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-11-15
- Filing Date
- 2022-11-14
- Publication Date
- 2024-11-21
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing robot-assisted dental and maxillofacial procedures require time-consuming and expensive imaging processes to create a 3D virtual representation of jaw or maxillofacial bone structures, necessitating the use of a splint instrument with fiducial markers that must be worn by the patient throughout the procedure, causing inconvenience.
A method that allows for planning and performing procedures without prior imaging by using a tracking arm to establish a reference frame in three-dimensional space, aligning a treatment tool with physical points on the patient's site, and forming a treatment plan based on these points, eliminating the need for separate imaging and reducing instrument changes.
Enables efficient and convenient planning and execution of dental procedures by minimizing imaging requirements, reducing time and expense, and streamlining the process for dental professionals while maintaining accuracy through real-time adjustments.
Smart Images

Figure 2024543487000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to dental robotic systems and, more particularly, to methods for planning and performing robotic dental procedures. [Background technology]
[0002] Certain dental or maxillofacial procedures, particularly robotic-assisted procedures, generally require imaging of one or more forms of the jaw or maxillofacial bone structures to evaluate the bone structures and form an effective plan for the treatment. For example, one robotic-assisted dental / maxillofacial procedure first requires that a splint appliance with fiducial markers is securely attached to the patient, generally in close proximity to the intended site for the treatment. The patient then undergoes a 2D or 3D imaging procedure (e.g., an X-ray or CT scan), with the splint appliance, fiducial markers, and site displayed in the resulting image. A plan for the treatment is then formed from the acquired images with respect to the 3D virtual representation of the site and with respect to the imaged fiducial markers via appropriate software. Once the plan for the treatment is formed via the software, a tracking system for the robot is attached to the patient via the splint appliance in a known relationship to the fiducial markers. The tracking system assists in guiding the robot according to the software plan relative to the fiducial markers. Because the positions of the fiducial markers are known and monitored by the tracking system, the robotic guidance by the software planning is updated in real time to account for patient movement (i.e., the software planning is performed relative to the fiducial markers, and the real-time positions of the fiducial markers are tracked and provided by the tracking system).
[0003] However, in such robotic-assisted procedures, the imaging procedures required to create a 3D virtual representation of the site often result in increased time and expense, as well as potential inconvenience to the patient. The splint device must also remain attached to the patient from prior to the imaging procedures through the creation of the software plan and through the completion of the actual procedure to ensure that the fiducial markers remain fixed as reliable reference points. If the splint device is removable between the imaging phase and the performance of the procedure, great care must be taken to ensure that the splint device can be refixed in the same manner and in the same positions where the fiducial markers were originally established. Summary of the Invention [Problem to be solved by the invention]
[0004] Thus, there is a need for a method of planning and performing a procedure (e.g., a dental or maxillofacial procedure), particularly a robotically assisted or robotically implemented procedure, that can be accomplished without the need for imaging one or more morphologies of the site (e.g., the jaw or maxillofacial bone structures). In some cases, it is desirable for such a method to be accomplished while the site is established in a reference frame known to the robotic system, so that planning and performing the treatment at the site can be performed in a compact time frame, at additional time and expense, and without the need to subject the site to a separate imaging system in advance. Furthermore, such a method should be ergonomically friendly, convenient, and convenient for the dental professional, for example, by minimizing the steps required to accomplish the plan and eliminating the need to exchange instruments between planning and performing the treatment. [Means for solving the problem]
[0005] The above and other needs are met by aspects of the present disclosure, which in one aspect provides a method of creating a plan for performing a procedure, including positioning a distal end of a tracked arm in communication with a reference location at or adjacent to a site or an object received at the site, the reference location being positioned relative to a proximal end of the tracked arm in three-dimensional space. Each of a plurality of physical points at or adjacent to the site or object is contacted with a distal end of a treatment tool engaged with a distal end of a robotic arm, the proximal end of the robotic arm being positioned in a known relationship relative to the proximal end of the tracked arm. A position of the distal end of the end effector in three-dimensional space is determined simultaneously with contacting each of the physical points with the distal end of the end effector. A reference frame is formed in the three-dimensional space to include the location of the site or object in the reference frame from the locations of the physical points relative to the reference locations. A plan is formed of a procedure to be performed by the end effector on the site or object relative to a reference position within the reference frame, the procedure including a path the end effector travels to and from the site or object and during the procedure performed by the end effector on the site or object, and a trajectory of the end effector during the procedure.
[0006] Another aspect of the disclosure provides a method of performing a procedure, such method including positioning a distal end of a tracked arm in communication with a reference location at or adjacent to a site or object received at the site, the reference location being positioned in three-dimensional space relative to a proximal end of the tracked arm. Each of a plurality of physical points at or adjacent to the site or object is contacted with a distal end of an end effector of a treatment tool engaged with a distal end of a robotic arm, the proximal end of the robotic arm being positioned in a known relationship relative to the proximal end of the tracked arm. A position of the distal end of the end effector in three-dimensional space is determined simultaneously with contacting each of the physical points with the distal end of the end effector. A reference frame is formed in the three-dimensional space to include the location of the site or object in the reference frame from the locations of the physical points in relation to the reference locations. A plan is formed of a procedure to be performed by the end effector on the site or object relative to a reference position in the reference frame, the procedure including a path the end effector travels during a procedure performed to and from the site or object by the end effector, and a trajectory of the end effector during the procedure. The procedure on the site or object is performed according to the plan, including traversing the path using an end effector of a treatment tool engaged to a distal end of the robotic arm.
[0007] Yet another aspect of the present disclosure provides a method of performing a procedure, such method including positioning a distal end of a tracked arm at or adjacent a site or object received at the site in communication with a reference location, the reference location being located in three-dimensional space relative to a proximal end of the tracked arm. A physical point on the site or object is contacted with a distal end of an end effector of a treatment tool engaged with a distal end of a robotic arm, the proximal end of the robotic arm being located in a known relationship relative to the proximal end of the tracked arm. A position of the distal end of the end effector in three-dimensional space is determined simultaneously with contacting the physical point with the distal end of the end effector. A trajectory of the end effector is established relative to the physical point on the site or object to perform the procedure on the site or object. A plan is formed for a procedure to be performed by the end effector at locations of physical points on the site or object, the procedure including a path that the end effector will travel to and from the site or object and during the procedure to be performed by the end effector at the locations of physical points on the site or object and the established trajectory. The procedure at the site or object is performed according to the plan, which includes traveling the path using an end effector of a treatment tool engaged with a distal end of the robotic arm.
[0008] Yet another aspect of the present disclosure provides a method of performing a procedure. Such method includes positioning a distal end of a tracked arm in communication with a reference location at or near a location of a site or an object received at the site, the reference location being located in three-dimensional space relative to a proximal end of the tracked arm. A location of a distal end of an end effector of a treatment tool is determined in three-dimensional space, the treatment tool is engaged with a distal end of a robotic arm, the proximal end of the robotic arm being located in a known relationship relative to the proximal end of the tracked arm. A trajectory of the end effector is established relative to the location of its distal end. A plan is formed for a procedure to be performed by the end effector at a location of a physical point on the site or object, the procedure including a path the end effector travels between and at the site or object and at the physical point on the site or object, the location of the end effector and the established trajectory during the procedure to be performed by the end effector. The procedure is performed on the site or object using an end effector of a treatment tool engaged with the distal end of the robotic arm according to a plan that includes moving a path and orienting the end effector to an established trajectory.
[0009] Accordingly, the present disclosure includes, but is not limited to, the following embodiments.
[0010] Embodiment 1: A method of forming a plan for performing a procedure comprising: positioning a distal end of a tracked arm in communication with a reference location at or on an object received at the site, or adjacent to the site or object received at the site, the reference location being positioned relative to a proximal end of the tracked arm in three dimensional space; and contacting each of a plurality of physical points at or adjacent to the site or object with a distal end of an end effector of a treatment tool engaged with the distal end of the robotic arm, the proximal end of the robotic arm being positioned in a known relationship to the proximal end of the tracked arm. determining a position of the distal end of the end effector in three dimensional space simultaneously with contacting each of the physical points with the distal end of the end effector; forming a reference frame in the three dimensional space to include a position of the site or object in the reference frame from the positions of the physical points relative to a reference position; and forming, within the reference frame, a plan of a procedure to be performed by the end effector on the site or object relative to the reference position, the procedure including a path the end effector travels during a procedure performed on the site or object by the end effector to and from the site or object, and a trajectory of the end effector during the procedure.
[0011] Embodiment 2: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein contacting each of the physical points with a distal end of an end effector of a treatment tool includes contacting each of the physical points with a distal end of the end effector, the end effector comprising a drill or abrasive bit of the treatment tool, and the treatment tool comprising a punching device.
[0012] Embodiment 3: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein the robotic arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, and determining a position of the distal end of the end effector includes determining a position of the distal end of the end effector relative to a proximal end of the robotic arm from position data from the one or more position sensors.
[0013] Embodiment 4: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein the tracking arm comprises a plurality of interconnected arm segments engaging one or more position sensors, and the method includes determining a position of a distal end of the tracking arm relative to a proximal end of the tracking arm from position data from the one or more position sensors.
[0014] Embodiment 5: A method of any preceding embodiment, or any combination of preceding embodiments, wherein determining the position of the distal end of the end effector in three dimensional space includes determining the position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position physically engaging the distal end of the tracking arm.
[0015] Embodiment 6: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein a distal end of the tracking arm is spaced from the site or object and includes a detector device engaged with the distal end, the detector device being positioned in communication with the site or object, and determining a position of the distal end of the end effector includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position being detected by the detector device engaged with the distal end of the tracking arm.
[0016] Embodiment 7: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein determining the position of the distal end of the end effector includes determining the position of the distal end of the end effector in three dimensional space relative to a reference position determined via the tracking arm.
[0017] Embodiment 8: A method of performing a procedure, comprising: positioning a distal end of a tracked arm in communication with a reference location at or on an object received at the site, or adjacent to the site or an object received at the site, the reference location being located in three dimensional space relative to a proximal end of the tracked arm; contacting each of a plurality of physical points at or adjacent to the site or object with a distal end of an end effector of a procedure tool engaged with the distal end of a robotic arm, the proximal end of the robotic arm being located in a known relationship relative to the proximal end of the tracked arm; and simultaneously contacting each of the physical points with the distal end of the end effector and measuring the position of the end effector in three dimensional space. determining a position of a distal end of a robot arm; forming a reference frame in three dimensional space to include positions of the site or object in the reference frame from positions of physical points with respect to a reference position; forming a plan of a procedure to be performed on the site or object by the end effector within the reference frame and with respect to the reference position, the procedure including a path the end effector moves during the procedure performed on the site or object by the end effector to and from the site or object, and a trajectory of the end effector during the procedure; and performing the procedure on the site or object according to the plan, including moving the path with an end effector of a treatment tool engaged to the distal end of the robot arm.
[0018] Embodiment 9: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein contacting each of the physical points with a distal end of an end effector of a treatment tool includes contacting each of the physical points with a distal end of the end effector, the end effector comprising a drill or abrasive bit of the treatment tool, and the treatment tool comprising a punching device.
[0019] Embodiment 10: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein the robotic arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, and determining the position of the distal end of the end effector includes determining the position of the distal end of the end effector relative to the proximal end of the robotic arm from position data from the one or more position sensors.
[0020] Embodiment 11: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein the tracking arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, and the method includes determining a position of a distal end of the tracking arm relative to a proximal end of the tracking arm from position data from the one or more position sensors.
[0021] Embodiment 12: A method of any preceding embodiment, or any combination of preceding embodiments, wherein determining the position of the distal end of the end effector in three dimensional space includes determining the position of a site or object in three dimensional space via the end effector relative to a reference position, the reference position being physically engaged with the distal end of the tracking arm.
[0022] Embodiment 13: A method of any preceding embodiment, or any combination of preceding embodiments, wherein a distal end of the tracking arm is spaced from the site or object and includes a detector device engaged with the distal end, the detector device being positioned in communication with the site or object, and determining a position of the distal end of the end effector includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position being detected by the detector device engaged with the distal end of the tracking arm.
[0023] Embodiment 14: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein determining the position of the distal end of the end effector includes determining the position of the distal end of the end effector in three dimensional space relative to a reference position determined via the tracking arm.
[0024] Embodiment 15: A method of any preceding embodiment, or any combination of preceding embodiments, wherein performing the treatment includes performing the treatment on the site or object according to a plan, including moving a path using an end effector of a treatment tool engaged with a distal end of the robotic arm relative to a reference position determined via a tracking arm.
[0025] Embodiment 16: A method of any preceding embodiment, or any combination of preceding embodiments, comprising adjusting the plan during performance of the procedure in response to movement of the site or object, as determined via movement of a reference position determined via a tracking arm.
[0026] Embodiment 17: A method of any preceding embodiment, or any combination of the preceding embodiments, comprising providing feedback in response to the treatment device deviating from a plan during performance of a treatment including moving a path.
[0027] Embodiment 18: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein providing feedback includes directing haptic or tactile feedback via the treatment device.
[0028] Embodiment 19: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein providing feedback includes providing visual or auditory feedback via a deviation display device.
[0029] Embodiment 20: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein providing feedback includes limiting movement of the treatment device by providing resistance to movement via the robotic arm.
[0030] Embodiment 21: A method of performing a procedure comprising: positioning a distal end of a tracked arm in communication with a reference location at the site or on an object received at the site, or adjacent to the site or on an object received at the site, the reference location being located in three-dimensional space relative to a proximal end of the tracked arm; contacting a physical point on the site or object with a distal end of an end effector of a procedure tool engaged with the distal end of the robotic arm, the proximal end of the robotic arm being located in a known relationship relative to the proximal end of the tracked arm; and simultaneously contacting the physical point with the distal end of the end effector, determining the location of the distal end of the end effector in three-dimensional space. determining a location of a treatment tool for performing a procedure on the site or object relative to a physical point on the site or object; establishing a trajectory of the end effector for performing a procedure on the site or object relative to a physical point on the site or object; forming a plan for the treatment to be performed by the end effector at the location of the physical point on the site or object, the treatment including a path the end effector travels to and from the site or object and during the treatment to be performed by the end effector at the location and established trajectory at the physical point on the site or object; and performing the treatment at the site or on the object according to the plan, including traveling the path with an end effector of a treatment tool engaged to a distal end of the robotic arm.
[0031] Embodiment 22: The method of any preceding embodiment, or any combination of preceding embodiments, wherein contacting the physical point with a distal end of an end effector of a treatment tool includes contacting the physical point with a distal end of the end effector, the end effector comprising a drill or abrasive bit of the treatment tool, and the treatment tool comprising a perforating device.
[0032] Embodiment 23: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein the robotic arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, and determining the position of the distal end of the end effector includes determining the position of the distal end of the end effector relative to the proximal end of the robotic arm from position data from the one or more position sensors.
[0033] Embodiment 24: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein the tracking arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, and the method includes determining a position of a distal end of the tracking arm relative to a proximal end of the tracking arm from position data from the one or more position sensors.
[0034] Embodiment 25: A method of any preceding embodiment, or any combination of preceding embodiments, wherein determining the position of the distal end of the end effector in three dimensional space includes determining the position of a site or object in three dimensional space via the end effector relative to a reference position, the reference position physically engaging the distal end of the tracking arm.
[0035] Embodiment 26: A method of any preceding embodiment, or any combination of preceding embodiments, wherein a distal end of the tracking arm is spaced from the site or object and includes a detector device with which the distal end is engaged, the detector device being positioned in communication with the site or object, and determining a position of the distal end of the end effector includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position being detected by the detector device engaged with the distal end of the tracking arm.
[0036] Embodiment 27: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein determining the position of the distal end of the end effector includes determining the position of the distal end of the end effector in three dimensional space relative to a reference position determined via the tracking arm.
[0037] Embodiment 28: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein performing the treatment includes performing the treatment on the site or object according to a plan, including moving a path using an end effector of a treatment tool engaged to the distal end of the robotic arm relative to a reference position determined via the tracking arm.
[0038] Embodiment 29: A method of any preceding embodiment, or any combination of preceding embodiments, comprising adjusting the plan during performance of the procedure in response to movement of the site or object, as determined by movement of a reference position determined via a tracking arm.
[0039] Embodiment 30: A method of any preceding embodiment, or any combination of preceding embodiments, comprising providing feedback in response to the treatment device deviating from the plan during performance of a treatment including navigating a path.
[0040] Embodiment 31: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein providing feedback includes directing haptic or contact feedback via the treatment device.
[0041] Embodiment 32: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein providing feedback includes providing visual or auditory feedback via a deviation display device.
[0042] Embodiment 33: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein providing feedback includes limiting movement of the treatment device by providing resistance to movement via the robotic arm.
[0043] Embodiment 34: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein forming the plan includes forming a plan for a procedure to be performed by an end effector at each of a plurality of physical points on the site or object, and performing the procedure includes performing the procedure at each of the physical points on the site or object using the end effector within the established trajectory, and the procedure is performed in parallel between the physical points.
[0044] Embodiment 35: A method of performing a procedure comprising: positioning a distal end of a tracked arm in communication with a reference location at or on an object received at the site, or adjacent to the site or on an object received at the site, the reference location being disposed in three dimensional space relative to a proximal end of the tracked arm; determining a location of a distal end of an end effector of a procedure tool in three dimensional space, the procedure tool engaged with a distal end of a robotic arm, the proximal end of the robotic arm being disposed in a known relationship relative to the proximal end of the tracked arm; and determining a location of the distal end of the end effector of the procedure tool relative to the location of the distal end of the end effector. establishing a trajectory for the end effector; forming a plan of a procedure to be performed by the end effector at a location of a physical point on the site or object, the procedure including locations of the end effector to and from the site or object and at physical points on the site or object and a path the end effector will travel back and forth during the procedure performed by the end effector on the established trajectory; and performing the procedure on the site or object according to the plan, including traversing the path using an end effector of a treatment tool engaged with a distal end of a robotic arm; and orienting the end effector within the established trajectory.
[0045] Embodiment 36: A method of any preceding embodiment, or any combination of the preceding embodiments, wherein establishing the trajectory includes manually orienting a treatment tool so that the end effector is in a three-dimensional angular configuration relative to a distal end of the end effector, and storing the angular configuration of the end effector that provides a trajectory for use in forming the plan.
[0046] Embodiment 37: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein establishing the trajectory includes determining a three-dimensional angular configuration of the end effector that provides the trajectory, determining a spatial offset of a proximal end of the end effector from a distal end of the end effector that provides the angular configuration, and storing the spatial offset of the proximal end of the end effector that provides the trajectory for use in forming the plan.
[0047] Embodiment 38: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein determining the position of the distal end of the end effector includes determining the position of the distal end of the end effector, the end effector comprising a drill bit or an abrasive bit of a treatment tool, and the treatment tool comprising a punching device.
[0048] Embodiment 39: A method of any preceding embodiment, or any combination of preceding embodiments, comprising determining a position of a distal end of the end effector, contacting a physical point with the distal end of the end effector, and simultaneously determining a position of the distal end of the end effector in three-dimensional space.
[0049] Embodiment 40: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein the robotic arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, and determining the position of the distal end of the end effector includes determining the position of the distal end of the end effector relative to the proximal end of the robotic arm from position data from the one or more position sensors.
[0050] Embodiment 41: A method of any preceding embodiment, or any combination of preceding embodiments, wherein the tracking arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, and the method includes determining a position of a distal end of the tracking arm relative to a proximal end of the tracking arm from position data from the one or more position sensors.
[0051] Embodiment 42: A method of any preceding embodiment, or any combination of preceding embodiments, wherein determining the position of the distal end of the end effector in three dimensional space includes determining the position of a site or object in three dimensional space via the end effector relative to a reference position, the reference position physically engaging the distal end of the tracking arm.
[0052] Embodiment 43: A method of any preceding embodiment, or any combination of preceding embodiments, wherein a distal end of the tracking arm is spaced from the site or object and includes a detector device engaged with the distal end, the detector device being positioned in communication with the site or object, and determining a position of the distal end of the end effector includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position being detected by the detector device engaged with the distal end of the tracking arm.
[0053] Embodiment 44: A method of any preceding embodiment, or any combination of the preceding embodiments, wherein determining the position of the distal end of the end effector includes determining the position of the distal end of the end effector in three-dimensional space relative to a reference position determined via the tracking arm.
[0054] Embodiment 45: A method of any preceding embodiment, or any combination of preceding embodiments, wherein performing the treatment includes performing the treatment on the site or object according to a plan using an end effector of a treatment tool engaged with the distal end of the robotic arm, the plan including moving a path relative to a reference position determined via the tracking arm and orienting the end effector on an established trajectory.
[0055] Embodiment 46: A method of any preceding embodiment, or any combination of preceding embodiments, comprising adjusting the plan during performance of the procedure in response to movement of the site or object, as determined via movement of a reference position determined via a tracking arm.
[0056] Embodiment 47: A method of any preceding embodiment, or any combination of preceding embodiments, including moving a path to orient the end effector within an established trajectory, and providing feedback in response to the treatment device deviating from the plan during performance of the treatment.
[0057] Embodiment 48: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein providing feedback includes directing touch or haptic feedback via the treatment device.
[0058] Embodiment 49: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein providing feedback includes providing visual or auditory feedback via a deviation display device.
[0059] Embodiment 50: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein providing feedback includes limiting movement of the treatment device by providing resistance to movement via the robotic arm.
[0060] Embodiment 51: The method of any preceding embodiment, or any combination of the preceding embodiments, wherein forming the plan includes forming a plan for a procedure to be performed by an end effector at each of a plurality of physical points on the site or object, and performing the procedure includes performing the procedure at each of the physical points on the site or object using the end effector within the established trajectory, and the procedure is performed in parallel between the physical points.
[0061] These and other features, aspects, and advantages of the present disclosure will become apparent from reading the following detailed description in conjunction with the accompanying drawings, which are briefly described below. The present disclosure includes any combination of two, three, four, or more features or elements described in the present disclosure, regardless of whether such features or elements are explicitly combined or otherwise recited in the description of a particular embodiment herein. The present disclosure is intended to be read as a whole as any separable features or elements of the disclosure are intended, i.e., combinable, in any of its aspects and embodiments, unless the context of the disclosure clearly dictates otherwise.
[0062] It will be understood that the summary of this specification is provided only for the purpose of summarizing some exemplary aspects to provide a basic understanding of the present disclosure. Therefore, it will be understood that the exemplary aspects described above are merely examples and should not be interpreted in any way to narrow the scope or spirit of the present disclosure. It will be understood that the scope of the present disclosure encompasses many potential aspects, some of which are further described below, in addition to those summarized herein. Furthermore, other aspects and advantages of such aspects disclosed herein will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, which illustrate by way of example the principles of the described aspects.
[0063] Having thus described the disclosure in general terms, reference is now made to the accompanying drawings, which are not necessarily drawn to scale. [Brief description of the drawings]
[0064] [Figure 1] FIG. 13 is a schematic diagram of another aspect of a robotic system implemented according to method aspects of the present disclosure. [Diagram 2] FIG. 13 is a schematic diagram of another aspect of a robotic system implemented according to method aspects of the present disclosure. [Diagram 3] FIG. 3 is a schematic diagram illustrating a method for planning a procedure according to an embodiment of the present disclosure, implementing the robotic system shown in FIGS. 1 and 2. [Figure 4] FIG. 4 shows a schematic diagram of the method of FIG. 3 applied to a dental implant in a jawbone in one example. [Diagram 5] FIG. 4 is a schematic diagram of a reference frame formed according to the method of FIG. 3; [Figure 6] FIG. 4 is a schematic diagram illustrating a method for performing a procedure according to an embodiment of the present disclosure, implementing the method for planning a procedure shown in FIG. [Figure 7] 13A-13C are schematic diagrams illustrating a method of performing a procedure according to another aspect of the present disclosure. [Figure 8] 8A-8C are schematic diagrams illustrating the method of FIG. 7 as applied to a dental implant in a jawbone in one example. [Figure 9] 8A-8C are schematic diagrams illustrating the method of FIG. 7 as applied to a dental implant in a jawbone in one example. [Figure 10] FIG. 13 shows a schematic diagram of a method for performing a procedure according to yet another aspect of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0065] The present disclosure is described more fully below with reference to the accompanying drawings, in which some, but not all, aspects of the disclosure are shown. Indeed, the disclosure may be embodied in many different forms and should not be construed as limited to the aspects set forth herein, but rather, these aspects are provided so that this disclosure will satisfy applicable legal requirements. Like numerals refer to like elements throughout.
[0066] 1 illustrates a schematic diagram of a robotic system 100 according to one embodiment of the present disclosure. Such a system includes a treatment tool 200 having an end effector 300 configured to interact with a site 25 or an object 50 received at the site 25. The site 25 can be a maxillofacial or dental structure, and the object 50 can be a tooth, a dental implant / crown, or the like.
[0067] Although aspects of the present disclosure include examples of associating a robotic system with maxillofacial / dental anatomical structures or maxillofacial structures, those skilled in the art will understand that references to maxillofacial / dental anatomical structures or maxillofacial / dental structures are merely intended to provide examples of objects that, in some aspects, interact with / are interacted with by the disclosed treatment tools / end effectors and / or robotic systems. Otherwise, references to "objects" herein are intended and expressly refer to non-human objects. In some examples, such non-human objects are maxillofacial / dental anatomical structures or maxillofacial / dental structures models or other non-human representations or reproductions of such anatomical structures or structures. The systems and methods disclosed herein are implemented to provide convenient and effective training tools or training offerings for dental professionals to develop their skills, for example, with respect to the treatments and tools described herein. Additionally, any methods disclosed and claimed herein are specifically directed to the control and operation of the systems described and claimed herein, and such methods are not specifically directed to methods of surgery on humans, but instead to the operation of robotic systems and / or treatment tools and end effectors with respect to the training procedures set forth above.
[0068] Additionally, while the embodiments of the present disclosure illustrate exemplary procedures involving maxillofacial / dental anatomy, those skilled in the art will appreciate that the concepts of the robotic systems and methods disclosed herein may find applicability to other surgical processes that do not involve dental surgery, such as, for example, orthopedic surgery, ENT surgery, and neurosurgery. Thus, the embodiments of the present disclosure presented herein are merely examples of the applicability of the disclosed concepts and are not intended to be limiting in any way. That is, the embodiments of the robotic systems disclosed herein may be applicable to various portions of a patient to facilitate other types of surgery besides dental surgery.
[0069] In one embodiment, the treatment tool 200 is a drilling device and the end effector 300 is a drill bit or an abrasive bit, as shown, for example, in FIGS. 1 and 2. The treatment tool 200 engages with a distal end 725 of an articulating robotic arm of the robotic system 100, and the end effector 300 of the treatment tool 200 is configured to interact with the site 25 and / or an object 50 received at the site. The controller 800 is configured to communicate with the articulating robotic arm, the treatment tool 200, and a fiducial marker 900 adapted to engage a reference location 10 at or adjacent the site 25 or object 50. The controller 800 is configured to determine the position of the end effector 300 relative to the fiducial marker 900 during movement of the end effector 300 to interact with the site 25 or object 50, for example. The controller 800 is further configured to direct the articulated robotic arm to physically control the permissible movements of the treatment tool 200 relative to the fiducial marker 900 engaged with the reference location 10, e.g., directly relative to the placement of the end effector 300, to account for and accommodate movements of the site 25 or object 50 during the robotic procedure. For example, in one aspect, the controller 800 is implemented to develop a plan, procedure, or operation that includes the treatment tool 200 / end effector 300 being directed to move a path proximate to (and away from) the site 25 or object 50, and a subsequent path along which the treatment tool 200 / end effector 300 is manipulated to interact with the site 25 or object 50, to perform the plan, procedure, or operation, the end effector 300 being on the established trajectory.
[0070] According to aspects of the present disclosure, the developed plan / procedure / action details the movement, including trajectory, of the treatment tool 200 / end effector 300 along a path engaged towards the site 25 or object 50, and the articulated robotic arm (having the treatment tool 200 attached to its distal end 725) includes structure and functionality that allows for manually moving the treatment tool 200 along an acceptable path or route in accordance with the plan / procedure / action. However, manual movement of the treatment tool 200 outside the acceptable path or route is limited, impeded, or prevented by the articulated robotic arm.
[0071] In one embodiment (see, e.g., FIG. 1 ), the distal end 1025 of the tracking arm 1050 physically engages the fiducial marker 900. The tracking arm 1050 is a separate and distinct element from the articulated robot arm. Additionally, the tracking arm 1050 is configured to communicate with the controller 800 and cooperate with the controller 800 to determine a spatial relationship between the fiducial marker 900 / fiducial position 10 and the end effector 300 (via the articulated robot arm). In another embodiment (see, e.g., FIG. 2 ), the robotic system 100 includes a detector 1000 that engages the distal end 1025 of the tracking arm 1050, which is a separate and distinct element from the articulated robot arm. The tracking arm 1050 and the detector 1000 are arranged to communicate with the controller 800. The detector 1000 is further configured to cooperate with the tracking arm 1050 to position the detector 1000 in a spaced relationship with the fiducial marker 900 engaged with the reference location 10, to detect the fiducial marker 900, and to cooperate with the controller 800 to determine (via the articulated robot arm) the spatial relationship between the fiducial marker 900 / reference location 10 and the end effector 300. The detector 1000, in a particular exemplary embodiment, is an electrical detector, an electromechanical detector, an electromagnetic detector, an optical detector, an infrared detector, or a combination thereof.
[0072] In one aspect, the articulated robotic arm has a proximal end 720 and an opposing distal end 725. One or more sensors 730 are operatively engaged with the articulated robotic arm and configured to sense position data associated with the articulated robotic arm. For example, the one or more sensors 730 engage one of a plurality of arm members of the articulated robotic arm and / or engage a joint between the arm members or between an arm member and another component of the articulated robotic arm (e.g., between the proximal end 720 of the articulated robotic arm and a base member 715). In this manner, the position data sensed by the one or more sensors 730 includes, for example, a spatial relationship (e.g., orientation, position, etc.) of the articulated robotic arm and / or its components in three-dimensional space. In some cases, the spatial relationship is determined with respect to the base member 715 to which the proximal end 720 of the articulated robotic arm is attached. Thus, in some aspects, the one or more sensors 730 engage the articulating robot arm such that position data sensed by the one or more sensors 730 is indicative of at least a spatial position of at least the distal end 725 of the articulating robot arm in three-dimensional space, and possibly relative to the base member 715 / proximal end 720 of the articulating robot arm. The position of the treatment tool 200 / end effector 300 in three-dimensional space is related, known, or determined, or otherwise associated with the position of the distal end 725 of the articulating robot arm determined from the position data of the one or more sensors 730, and the engagement of the treatment tool 200 with the distal end 725 of the articulating robot arm. Thus, the position of the distal end of the end effector 300 relative to the proximal end 720 of the robot arm 750 is determined from position data from the one or more position sensors 730.
[0073] In one aspect, the tracking arm 1050 has a proximal end 1020 and an opposing distal end 1025. One or more sensors 1030 are operatively engaged with the tracking arm 1050 and configured to sense position data related to the tracking arm 1050. For example, the one or more sensors 1030 engage one of a plurality of arm members of the tracking arm 1050 and / or a joint engaged between the arm members or between the arm members and other components of the tracking arm 1050 (e.g., between the proximal end 1020 of the tracking arm 1050 and the base member 715). In this manner, the position data detected by the one or more sensors 1030 includes, for example, a spatial relationship (e.g., orientation, position, etc.) of the tracking arm 1050 and / or its components in three-dimensional space. In some cases, the spatial relationship is determined with respect to the base member 715 to which the proximal end 1020 of the tracking arm 1050 is attached. Thus, in an aspect, the one or more sensors 1030 engage the tracking arm 1050 such that position data sensed by the one or more sensors 1030 is indicative of at least a spatial position of at least the distal end 1025 of the tracking arm 750 in three-dimensional space, and possibly relative to the base member 715 / proximal end 1020 of the tracking arm 1050. The position of the reference position 10 in three-dimensional space is related, known, determined, or otherwise associated with the position of the distal end 1025 of the tracking arm 1050 determined from the position data of the one or more sensors 1030, and with the physical engagement between the reference marker 900 / reference position 10 and the distal end 1025 of the tracking arm 1050, or with the detection of the reference marker 900 / reference position 10 by the detector 1000 engaged with the distal end 1025 of the tracking arm 1050. That is, the position of the distal end 1025 of the tracking arm 1050 relative to its proximal end 1020 is determined from position data from one or more position sensors 1030.
[0074] Implementing aspects of the robotic system 100 disclosed herein, one aspect of the disclosure includes a method of forming a plan for performing a procedure, and in particular a method of forming such a plan, without requiring imaging of the site 25 / object 50, as shown in FIG. 3. Such a method, in one example, includes positioning a distal end 1025 of a tracked arm 1050 in communication with a reference location 10 at or adjacent to the site 25 or an object 50 received at the site 25, the reference location 10 being positioned relative to a proximal end 1020 of the tracked arm 1050 in three-dimensional space (Block 3-100) (i.e., the reference location 10 is positioned in three-dimensional space relative to the proximal end 1020 of the tracked arm 1050). The location in three-dimensional space of the distal end 1025 of the end effector 300 relative to the reference location 10 is known or determined via the tracked arm 1050 by physical connection or communication with a fiducial marker 900 engaged with the reference location 10.
[0075] Each of a plurality of physical points 5 at or adjacent to the site 25 or object 50 is contacted with a distal end of an end effector 300 of a treatment tool 200 engaged with a distal end 725 of a robotic arm 750, the proximal end 720 of which is positioned in a known relationship relative to the proximal end 1020 of a tracking arm 1050 (block 3-110). The position of the distal end of the end effector 300 in three-dimensional space is determined simultaneously with contacting each of the physical points 5 with the distal end of the end effector 300 (block 3-120 and FIG. 4). Further, the site 25 or object 50 is one of the physical points, and the position of the site 25 or object 50 is also determined in three-dimensional space via the end effector 300 with respect to the reference position 10 because the reference position 10 is physically engaged (via the reference marker 900) with the distal end 1025 of the tracking arm 1050 or is detected (via the reference marker 900) by the detector device 1000 engaged with the distal end 1025 of the tracking arm 1050.
[0076] A reference frame 500 (see, e.g., FIG. 5) is then formed in three-dimensional space from the positions of the physical points 5 relative to the reference position 10, with the position of the site 25 or object 50 also included within the reference frame 500 (Block 3-130). That is, as the case may be, the physical points 5 in contact with the distal end of the end effector 300 are selected to surround and / or include the site 25 or object 50 such that, once formed, the site 25 or object 50 is located within or relative to the reference frame 500. Once the reference frame 500 is established, a plan is formed within the reference frame 500 and relative to the reference position 10 of the procedure to be performed by the end effector 300 on the site 25 or object 50, the procedure including the path the end effector 300 will travel to and from the site 25 or object 50 and during the procedure performed by the end effector 300 on the site 25 or object 50, as well as the trajectory of the end effector 300 during the procedure (Block 3-140). Because both the reference frame 500 and the path of the treatment tool 200 / end effector 300 are established relative to the reference position 10 and the reference position 10 in three-dimensional space is monitored during the performance of the plan / procedure / operation, the reference frame 500 and the path can be modified or adjusted in real time to take into account any movement of the site 25 / object 50 as the plan / procedure / operation is being performed.
[0077] Thus, in such an embodiment, a plan / procedure / action is formed without requiring a separate imaging procedure of the region 25 / object 50 as a basis for forming the plan / procedure / action. That is, the configuration of the robotic system 100 in which the position of the distal end of the end effector 300 is known with respect to the fiducial marker 900 that engages the region 25 / object 50 allows the reference frame 500 established through acquisition of the position of the distal end of the end effector 300 by each of the physical points 5 to serve as a surrogate or substitute for the imaging step. The physical points 5 are selected on or around the region 25 / object 50 and may include the region 25 / object 50 itself, such that the reference frame 500 is formed as a three-dimensional representation or model of the region 25 / object 50. Furthermore, since the region 25 / object 50 itself may be included as one of the physical points 5, this method of forming the reference frame 500 to include the region 25 / object 50 itself provides an accurate three-dimensional representation or model for forming the plan / procedure / action. For example, as shown in FIGS. 4 and 5, the robotic system 100 and method may be applied to position a dental implant in a model jaw structure, which may require the implant / post to be installed in the jaw (e.g., site 25) before the post receives a crown thereon. By contacting the end of a drill bit (end effector 300) of a drilling device (treatment tool 200) attached to the distal end 725 of the robotic arm 750 with physical points 5 on anatomical structures near, at, or adjacent to site 25 (e.g., nearby tooth surfaces and jawbone surfaces (lingual and buccal)), the locations of those physical points 5 in three-dimensional space are recorded via the controller 800. The controller 800 may then form a local reference frame 500 that includes the site 25 therein, and based on this reference frame 500, create a plan, for example, centering the implant / post on the jawbone site 25, with the implant / post oriented to extend from the jawbone at an angle or trajectory, centered between the teeth on either side (mesial and distal).This precise positioning of the implant / post therefore facilitates the process of placing a crown on the implant / post (i.e., restoring the tooth) by optimizing the alignment between the implant / post and the crown taking into account the surrounding structures.
[0078] In another embodiment, the method of forming a plan by establishing a reference frame 500 can be extended to a method of performing a procedure based on the plan. For example, as shown in FIG. 6, such a method includes positioning a distal end 1025 of a tracked arm 1050 in communication with a reference location 10 at or adjacent to a site 25 or an object 50 received at the site 25, the reference location 10 being positioned in three-dimensional space relative to a proximal end 1020 of the tracked arm 1050 (block 6-100). Each of a plurality of physical points 5 at or adjacent to the site 25 or object 50 is in contact with a distal end of an end effector 300 of a treatment tool 200 engaged with a distal end 725 of the robot arm 750, the proximal end 720 of the robot arm 750 being positioned in a known relationship relative to the proximal end 1020 of the tracked arm 1050 (block 6-110). The position of the distal end of the end effector 300 in three-dimensional space is determined (block 6-120) simultaneously with bringing each of the physical points 5 into contact with the distal end of the end effector 300. A reference frame 500 in three-dimensional space is then formed from the positions of the physical points 5 relative to the reference position 10 and includes the position of the site 25 or object 50 within the reference frame 10 (block 6-130).
[0079] A plan is then formed for the procedure to be performed by the end effector 300 on the site 25 or object 50 relative to the reference position 10 in the reference frame 500. The procedure includes a path that the end effector 300 will travel to and from the site 25 or object 50 and during the procedure performed by the end effector 300 on the site 25 or object 50, as well as a trajectory or orientation of the end effector 300 during the procedure (block 6-140). The procedure is then performed on the site 25 or object 50 according to the plan, including traversing the path, using the end effector 300 of the treatment tool 200 engaged with the distal end 725 of the robot arm 750 (block 6-150). That is, the procedure is performed on the site 25 or object 50 according to the plan, including traversing the path, using the end effector 300 of the treatment tool 200 engaged with the distal end 725 of the robot arm 750, relative to the reference position 10 determined via the tracking arm 1050.
[0080] Because communication with the fiducial marker 900 / reference location 10 is maintained during the performance of the procedure, the plan, including the path along which the treatment tool 200 / end effector 300 will travel, can be adjusted during the performance of the procedure in response to movement of the site 25 or object 50, as determined by movement of the fiducial location 10 determined via the tracking arm 1050. Additionally, because the treatment tool 200 / robot arm 750 can be manually manipulated to perform the procedure, the robotic system 100 can be configured to provide feedback in response to deviations of the treatment device 200 from the plan (e.g., deviations from the path) during the performance of the procedure, including moving the path. For example, haptic or touch feedback can be directed via the treatment device 200 by the controller 800, visual or auditory feedback can be directed via a deviation indicator (e.g., see element 1300 in FIGS. 1 and 2) by the controller 800, and / or movement of the treatment device 200 can be limited by providing resistance to the movement via the robot arm 750.
[0081] In yet another aspect of the disclosure, a method of performing a procedure can be performed without forming a reference frame 500. For example, as shown in FIGS. 7-9, the method includes positioning a distal end 1025 of a tracked arm 1050 in communication with a reference location 10 at or adjacent to a site 25 or an object 50 received at the site 25, the reference location 10 being positioned in three-dimensional space relative to a proximal end 1020 of the tracked arm 1050 (Block 7-100). A physical point on the site 25 or object 50 (e.g., the site 25 itself) is contacted with a distal end of an end effector 300 of a procedure tool 200 engaged with the distal end 725 of the robotic arm 750, the proximal end 720 of the robotic arm 750 being positioned in a known relationship relative to the proximal end 1020 of the tracked arm 1050 (Block 7-110). The position of the distal end of the end effector 300 in three-dimensional space is determined (block 7-120) simultaneously with bringing a physical point (eg, site 25) into contact with the distal end of the end effector 300.
[0082] In connection with contacting a physical point (e.g., site 25) with the distal end of the end effector 300, a trajectory or orientation (see, e.g., element 1500 in FIG. 9 ) of the end effector 300 relative to the physical point at site 25 or object 50 is established to perform a procedure at site 25 or object 50 (e.g., a drill bit can be placed in contact with site 25 and then a drilling device / drill bit is manually aligned such that the drill bit is aligned in the desired orientation / direction in three-dimensional space to drill a hole in site 25) (block 7-130). A plan is then formed (e.g., by providing a signal via an actuator, see, e.g., element 1400 of FIG. 9 ) for a procedure to be performed by the end effector 300 to the controller 800 at the location of a physical point on the site 25 or object 50 when the end effector 300 is in contact with the site 25 and oriented at a desired angle (e.g., trajectory or orientation 1500 in three-dimensional space) relative to the site 25 (block 7-140). The procedure may also include a path that the end effector 300 travels to and from the site 25 or object 50 and during the procedure performed by the end effector 300 at the location of the physical point of the site 25 or object 50 and the established trajectory 1500. The procedure is then performed at the site 25 or object 50 according to the plan (block 7-150), including traveling the path, using the end effector 300 of the treatment tool 200 engaged with the distal end 725 of the robot arm 750. That is, the treatment is performed on the site 25 or object 50 according to the plan, relative to the reference position 10 determined via the tracking arm 1050, which includes moving a path with the end effector 300 of the treatment tool 200 engaged with the distal end 725 of the robot arm 750 within the established trajectory 1500.
[0083] Because communication with the fiducial marker 900 / reference position 10 is maintained during performance of the procedure, the plan, including the path along which the treatment tool 200 / end effector 300 travels and the trajectory 1500 of the end effector 300 can be adjusted during performance of the procedure in response to movement of the site 25 or object 50, as determined by movement of the reference position 10 determined via the tracking arm 1050. Additionally, because the treatment tool 200 / robot arm 750 can be manually manipulated to perform the procedure, the robotic system 100 can be configured to provide feedback in response to deviations of the treatment device 200 from the plan (e.g., deviations from the path) during performance of the procedure, including navigating the path. For example, tactile or contact feedback can be directed by the controller 800 via the treatment device 200, visual or auditory feedback can be directed by the controller 800 via a deviation indication device (see, e.g., element 1300 in Figures 1 and 2), and / or movement of the treatment device 200 can be limited by providing resistance to movement via the robotic arm 750.
[0084] Thus, in such an embodiment, as shown, for example, in FIGS. 8 and 9, the robotic system 100 and method may be applied to place a dental implant in a model jaw structure, which may require the implant / post to be installed in the jaw (e.g., site 25) before the post receives a crown thereon. By contacting the site 25 (e.g., on the jawbone surface) with an end of a drill bit (end effector 300) of a drilling device (treatment tool 200) attached to the distal end 725 of the robotic arm 750 and establishing a desired trajectory / orientation of the drill bit, the location of the implant site 25 in three-dimensional space may be recorded via the controller 800 in response to the actuator 1400. If desired, the controller 800 may form a plan, for example, toward placing the implant / post at the site 25 of the jawbone. However, in an alternative embodiment, both the imaging process, as well as the planning process disclosed herein above, may be bypassed and the procedure / operation may be performed immediately upon establishing the location of the site 25 and the trajectory / orientation of the end effector 300. In some cases, the distance traveled by the end effector 300 along the orientation / trajectory may also be established, for example, by an input to the controller 800. In this way, the robotic system 100 may return the end effector 300 to the same position / orientation / trajectory if, for example, a larger hole needs to be drilled into the site 25.
[0085] In yet another aspect of the disclosure, a method of performing a procedure can be performed without contacting a physical point on the site 25 or object 50 (e.g., the site 25 itself) with the distal end of the end effector 300 to determine the location of the distal end of the end effector 300 in three-dimensional space. For example, as shown in FIG. 10, such a method includes positioning a distal end 1025 of a tracking arm 1050 in communication with a reference location 10 at or adjacent to the site 25 or the object 50 received at the site 25, the reference location 10 being located in three-dimensional space relative to a proximal end 1020 of the tracking arm 1050 (Block 8-100). The position of the distal end of the end effector 300 of the treatment tool 200 is determined in three-dimensional space, the treatment tool 200 engages with the distal end 725 of the robotic arm 750, and the proximal end 720 of the robotic arm 750 is positioned in a known relationship to the proximal end 1020 of the tracking arm 1050 (block 8-110).
[0086] That is, because the robot arm 750 comprises a plurality of interconnected arm segments having one or more position sensors 730 engaged therewith (the position of the distal end of the end effector 300 relative to the proximal end 720 of the robot arm 750 can be determined from position data from the one or more position sensors 730), and the tracking arm 1050 comprises a plurality of interconnected arm segments having one or more position sensors 1030 engaged therewith (the position of the distal end 1025 of the tracking arm 1050 relative to its proximal end 1020 can be determined from position data from the one or more position sensors 1030), the position of the distal end of the end effector 300 in three-dimensional space relative to the reference position 10 can be determined at any point in three-dimensional space. For example, the position of the distal end of the end effector 300 in three-dimensional space can be continuously monitored by the robot arm 750, or the position of the distal end of the end effector 300 in three-dimensional space can be determined on demand upon actuation of the actuator 1400 (see, e.g., FIG. 9). In such cases, the position of the distal end of the end effector 300 is determined in free space (e.g., at any position in three-dimensional space). However, in other aspects, the position of the distal end of the end effector 300 can be determined by contacting a physical point (e.g., site 25) with the distal end of the end effector 300 and simultaneously determining the position of the distal end of the end effector 300 in three-dimensional space.
[0087] Once the position of the distal end of the end effector 300 is determined, a trajectory (see, e.g., element 1500 of FIG. 9) of the end effector 300 is established relative to the distal end position (blocks 8-120). That is, in one embodiment, the trajectory 1500 is established by manually orienting the treatment tool 200 such that the end effector 300 is in a three-dimensional angular configuration relative to the distal end of the end effector 300, and the angular configuration of the end effector 300 that provides the trajectory 1500 is stored (e.g., upon actuation of the actuator 1400) for use in forming a treatment plan. In other embodiments, the trajectory 1500 is established by determining a three-dimensional angular configuration of the end effector 300 that provides the desired trajectory, and then determining a spatial offset of the proximal end of the end effector 300 from the distal end to provide the angular configuration. The spatial offset of the proximal end of the end effector 300 that provides the trajectory 1500 is then stored for use in forming a treatment plan.
[0088] A plan is then formed of the procedure to be performed by the end effector 300 at the location of the physical point on the site 25 or object 50 (e.g., by providing a signal to the controller 800 via an actuator (see, e.g., element 1400 of FIG. 9 ) when the end effector 300 is oriented at a desired angle relative to the site 25) (block 8-130). The procedure may also include the location of the end effector 300 to and from the site 25 or object 50 and at the physical point on the site 25 or object 50 and the path the end effector 300 will travel during the procedure performed by the end effector 300 at the established trajectory. The procedure is then performed on the site 25 or object 50 according to the plan (block 8-140), including traversing the path and orienting the end effector 300 to the established trajectory 1500, using the end effector 300 of the treatment tool 200 engaged with the distal end 725 of the robot arm 750. That is, the treatment is performed on the site 25 or object 50 according to the plan, using the end effector 300 of the treatment tool 200 engaged with the distal end 725 of the robot arm 750, relative to the reference position 10 determined via the tracking arm 1050, which includes moving a path and orienting the end effector 300 within the established trajectory 1500.
[0089] Because communication with the fiducial marker 900 / reference position 10 is maintained during performance of the procedure, the plan, including the path along which the treatment tool 200 / end effector 300 travels and the trajectory of the end effector 300, can be adjusted during performance of the procedure in response to movement of the site 25 or object 50, as determined by movement of the reference position 10 determined via the tracking arm 1050. Additionally, because the treatment tool 200 / robot arm 750 can be manually manipulated to perform the procedure, the robotic system 100 can be configured to provide feedback in response to deviations of the treatment device 200 from the plan (e.g., deviations from the path and / or trajectory of the end effector 300) during performance of the procedure, including navigating the path and orienting the end effector 300 within the established trajectory 1500. For example, tactile or contact feedback can be directed by the controller 800 via the treatment device 200, visual or auditory feedback can be directed by the controller 800 via a deviation indication device (see, e.g., element 1300 in Figures 1 and 2), and / or movement of the treatment device 200 can be limited by providing resistance to movement via the robotic arm 750.
[0090] 10 can be accomplished without contacting a physical point on the site 25 or object 50 (e.g., the site 25 itself) with the distal end of the end effector 300 to determine the location of the distal end of the end effector 300 in three-dimensional space (e.g., to establish a trajectory for the end effector 300), such a method can also provide the opportunity to perform procedures at multiple sites 25 with the end effector 300 within the same trajectory 1500. That is, in some cases, fitting of the prosthetic restoration is facilitated when a prosthetic restoration (e.g., a denture) is fitted with multiple implants / anchors, with the associated anchors / implants positioned substantially parallel to one another. Establishing the trajectory 1500 of the end effector 300 independent of contact with a physical point to determine the location of the distal end of the end effector 300 allows the end effector 300 to be oriented on the same trajectory 1500 to perform procedures at multiple sites 25 (e.g., multiple bores can be drilled using drill bits oriented on the same trajectory such that the bores are parallel to each other in three-dimensional space, and the implants / anchors received by the bores will be substantially parallel to each other to facilitate receipt of prosthetic restorations). More specifically, in some aspects, a plan can be formed for the procedures to be performed by the end effector 300 at the location of each of the multiple physical points (e.g., multiple sites 25) of the site 25 or object 50. Thus, procedures can be performed at each of the physical points of the site 25 or object 50 using the end effector 300 in the same established trajectory, such that procedures are performed in parallel between the physical points (e.g., parallel holes are formed).
[0091] Thus, aspects of the present disclosure provide methods for planning and performing procedures (e.g., dental or maxillofacial procedures), particularly robotically assisted or robotically implemented procedures, that can be accomplished, for example, without the need for imaging one or more features of the site (e.g., jaw or maxillofacial bone structures). In some aspects, the planning stage of the treatment can also be bypassed so that the treatment can be performed immediately in a repeatable manner. In some cases, such methods can be accomplished while the site is established in a reference frame known to the robotic system, so that planning and performing the treatment at the site can be performed in a compact time frame, without the need to subject the site to a separate imaging system in advance at additional time and expense. Furthermore, such methods are ergonomically friendly, convenient, and convenient for dental professionals, for example, by minimizing the steps required to accomplish the plan and eliminating the need to exchange instruments between planning and performing the treatment.
[0092] Many modifications and other embodiments of the inventions described herein will occur to those skilled in the art to which these disclosed embodiments pertain having the benefit of the teachings presented in the foregoing description and the associated drawings. It is to be understood, therefore, that the embodiments of the invention are not limited to the specific embodiments disclosed, and that modifications and other embodiments are intended to be included within the scope of the invention. Moreover, while the foregoing description and the associated drawings describe exemplary embodiments in the context of certain exemplary combinations of elements and / or functions, it is to be understood that alternative embodiments may provide different combinations of elements and / or functions without departing from the scope of the disclosure. In this regard, for example, combinations of elements and / or functions different from those explicitly described above are also contemplated within the scope of the disclosure. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
[0093] In this specification, the terms first, second, etc. may be used to describe various steps or calculations, but it should be understood that these steps or calculations should not be limited by these terms. These terms are used only to distinguish one operation or calculation from another operation or calculation. For example, a first calculation can be referred to as a second calculation, and similarly, a second step can be referred to as a first step, without departing from the scope of this disclosure. As used herein, the term "and / or" and the " / " symbol include any and all combinations of one or more of the associated listed items.
[0094] As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms unless the context clearly dictates otherwise. It will be further understood that the terms "comprising" and / or "including," as used herein, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. Accordingly, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting.
Claims
1. 1. A method for forming a plan for performing a procedure, comprising: positioning a distal end of the tracking arm in communication with a reference location at the site or on an object received at the site, or adjacent to the site or on an object received at the site, the reference location being positioned relative to a proximal end of the tracking arm in three-dimensional space; contacting each of a plurality of physical points at or adjacent to the site or object with a distal end of an end effector of a treatment tool engaged with a distal end of a robotic arm, the proximal end of the robotic arm being disposed in a known relationship relative to a proximal end of a tracking arm; contacting each of the physical points with the distal end of the end effector and simultaneously determining a position of the distal end of the end effector in three-dimensional space; forming a reference frame in three-dimensional space to include a location of the part or object within the reference frame from the location of the physical point with respect to the reference position; A method comprising: forming a plan of a procedure to be performed by the end effector on a site or object relative to a reference position within a reference frame, the procedure including a path the end effector moves during the procedure performed on the site or object by the end effector to and from the site or object, and a trajectory of the end effector during the procedure.
2. 2. The method of claim 1, wherein contacting each of the physical points with a distal end of an end effector of a treatment tool includes contacting each of the physical points with a distal end of the end effector, the end effector comprising a drill or abrasive bit of the treatment tool, and the treatment tool comprising a drilling device.
3. 2. The method of claim 1, wherein the robotic arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, and determining a position of the distal end of the end effector includes determining a position of the distal end of the end effector relative to a proximal end of the robotic arm from position data from the one or more position sensors.
4. 10. The method of claim 1 , wherein the tracking arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, the method including determining a position of a distal end of the tracking arm relative to a proximal end of the tracking arm from position data from the one or more position sensors.
5. 2. The method of claim 1, wherein determining a position of the distal end of the end effector in three-dimensional space includes determining a position of the site or object in three-dimensional space via the end effector relative to a reference position, the reference position being physically engaged with the distal end of the tracking arm.
6. 2. The method of claim 1, wherein a distal end of the tracking arm is spaced from the site or object and includes a detector device engaged with the distal end, the detector device being positioned in communication with the site or object, and determining a position of the distal end of the end effector includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position being detected by the detector device engaged with the distal end of the tracking arm.
7. The method of claim 1 , wherein determining a position of the distal end of the end effector comprises determining a position of the distal end of the end effector in three-dimensional space relative to a reference position determined via a tracking arm.
8. 1. A method of performing a procedure, comprising: positioning a distal end of the tracking arm in communication with a reference location at the site or on an object received at the site, or adjacent to the site or on an object received at the site, the reference location being located in three dimensional space relative to a proximal end of the tracking arm; contacting each of a plurality of physical points at or adjacent to the site or object with a distal end of an end effector of a treatment tool engaged with a distal end of a robotic arm, the proximal end of the robotic arm being disposed in a known relationship relative to a proximal end of a tracking arm; contacting each of the physical points with the distal end of the end effector while determining a position of the distal end of the end effector in three-dimensional space; forming a reference frame in three-dimensional space to include a location of the part or object within the reference frame from the location of the physical point with respect to the reference position; forming a plan of a procedure to be performed on a site or object by the end effector in a reference frame and relative to a reference position, the procedure including a path along which the end effector travels during the procedure performed on the site or object by the end effector to and from the site or object, and a trajectory of the end effector during the procedure; performing a procedure on the site or object according to the plan, including traversing a path with an end effector of a procedure tool engaged to a distal end of the robotic arm; The method includes:
9. 10. The method of claim 8, wherein contacting each of the physical points with a distal end of an end effector of a treatment tool includes contacting each of the physical points with a distal end of the end effector, the end effector comprising a drill or abrasive bit of the treatment tool, and the treatment tool comprising a drilling device.
10. 9. The method of claim 8, wherein the robotic arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, and determining a position of the distal end of the end effector includes determining a position of the distal end of the end effector relative to a proximal end of the robotic arm from position data from the one or more position sensors.
11. 9. The method of claim 8, wherein the tracking arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, the method including determining a position of a distal end of the tracking arm relative to a proximal end of the tracking arm from position data from the one or more position sensors.
12. 10. The method of claim 8, wherein determining a position of the distal end of the end effector in three dimensional space includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position being physically engaged with the distal end of the tracking arm.
13. 10. The method of claim 8, wherein a distal end of the tracking arm is spaced from the site or object and includes a detector device engaged with the distal end, the detector device being disposed in communication with the site or object, and determining a position of the distal end of the end effector includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position being detected by the detector device engaged with the distal end of the tracking arm.
14. The method of claim 8 , wherein determining a position of the distal end of the end effector comprises determining a position of the distal end of the end effector in three-dimensional space relative to a reference position determined via the tracking arm.
15. The method of claim 8, wherein performing the treatment includes performing the treatment on the site or object according to a plan, including moving a path using an end effector of a treatment tool engaged with a distal end of the robotic arm relative to a reference position determined via the tracking arm.
16. 16. The method of claim 15, comprising adjusting the plan during performance of the procedure in response to movement of the site or object as determined via movement of a reference position determined via the tracking arm.
17. 10. The method of claim 8, comprising providing feedback in response to a treatment device deviating from a plan during performance of a treatment that includes traversing a path.
18. 20. The method of claim 17, wherein providing feedback comprises directing haptic or tactile feedback via the treatment device.
19. 20. The method of claim 17, wherein providing feedback comprises providing visual or auditory feedback via a deviation indicator.
20. 20. The method of claim 17, wherein providing feedback includes limiting movement of the treatment device by providing resistance to movement via a robotic arm.
21. 1. A method of performing a procedure, comprising: Positioning a distal end of the tracking arm in communication with a reference location at the site or on an object received at the site, or adjacent to the site or on an object received at the site, the reference location being positioned in three dimensional space relative to a proximal end of the tracking arm; bringing a physical point on the site or object into contact with a distal end of an end effector of a treatment tool engaged with a distal end of a robotic arm, the proximal end of the robotic arm being disposed in a known relationship to a proximal end of a tracking arm; determining a location of the distal end of the end effector in three-dimensional space simultaneously with contacting the physical point with the distal end of the end effector; Establishing a trajectory of an end effector for performing a procedure on the site or object relative to a physical point on the site or object; forming a plan for a procedure to be performed by an end effector at a location of a physical point on the site or object, the procedure including a path that the end effector travels to and from the site or object and during the procedure to be performed by the end effector at the location and established trajectory at the physical point on the site or object; and performing a procedure at a site or on an object according to a plan, the procedure including traversing a path using an end effector of a treatment tool engaged to a distal end of a robotic arm.
22. 22. The method of claim 21, wherein contacting the physical point with a distal end of an end effector of a treatment tool comprises contacting the physical point with a distal end of the end effector, the end effector comprising a drill or abrasive bit of the treatment tool, and the treatment tool comprising a drilling device.
23. 22. The method of claim 21, wherein the robotic arm comprises a plurality of interconnected arm segments having one or more position sensors engaged thereto, and determining the position of the distal end of the end effector comprises determining the position of the distal end of the end effector relative to a proximal end of the robotic arm from position data from the one or more position sensors.
24. 22. The method of claim 21 , wherein the tracking arm comprises a plurality of interconnected arm segments having one or more position sensors engaged therewith, the method including determining a position of a distal end of the tracking arm relative to a proximal end of the tracking arm from position data from the one or more position sensors.
25. 22. The method of claim 21, wherein determining a position of the distal end of the end effector in three dimensional space includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position physically engaging the distal end of the tracking arm.
26. 22. The method of claim 21 , wherein a distal end of the tracking arm is spaced from the site or object and includes a detector device with which the distal end is engaged, the detector device being disposed in communication with the site or object, and determining a position of the distal end of the end effector includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position being detected by the detector device engaged with the distal end of the tracking arm.
27. 22. The method of claim 21, wherein determining a position of the distal end of the end effector includes determining a position of the distal end of the end effector in three-dimensional space relative to a reference position determined via the tracking arm.
28. 22. The method of claim 21, wherein performing the procedure includes performing the procedure at the site or on the object according to a plan, including moving a path using an end effector of a treatment tool engaged to a distal end of the robotic arm relative to a reference position determined via the tracking arm.
29. 30. The method of claim 28, comprising adjusting the plan during performance of the procedure in response to movement of the site or object as determined by movement of the reference position determined via the tracking arm.
30. 22. The method of claim 21, comprising providing feedback in response to a treatment device deviating from a plan during performance of a treatment that includes navigating a path.
31. 31. The method of claim 30, wherein providing feedback comprises directing haptic or tactile feedback via the treatment device.
32. 31. The method of claim 30, wherein providing feedback comprises providing visual or auditory feedback via a deviation indicator.
33. 31. The method of claim 30, wherein providing feedback includes limiting movement of the treatment device by providing resistance to movement via the robotic arm.
34. 22. The method of claim 21, wherein forming the plan includes forming a plan for a procedure to be performed by the end effector at each of a plurality of physical points on the site or object, and performing the procedure includes performing the procedure at each of the physical points on the site or object using the end effector within the established trajectory, the procedure being performed in parallel between the physical points.
35. 1. A method of performing a procedure, comprising: Positioning a distal end of the tracking arm in communication with a reference location at the site or on an object received at the site, or adjacent to the site or on an object received at the site, the reference location being positioned in three dimensional space relative to the proximal end of the tracking arm; determining a position of a distal end of an end effector of a treatment tool in three-dimensional space, the treatment tool engaged with a distal end of a robotic arm, the proximal end of the robotic arm being disposed in a known relationship to a proximal end of a tracking arm; establishing a trajectory of the end effector relative to a position of a distal end of the end effector; forming a plan of a procedure to be performed by the end effector at a location of a physical point on the site or object, the procedure including a path that the end effector will travel to and from the site or object and a location of the end effector at the physical point on the site or object and during the procedure to be performed by the end effector at the established trajectory; A method comprising: performing a procedure on a site or object according to a plan, the method comprising: navigating a path using an end effector of a treatment tool engaged with a distal end of a robotic arm; and orienting the end effector within an established trajectory.
36. 36. The method of claim 35, wherein establishing the trajectory includes manually orienting a treatment tool such that an end effector is in a three-dimensional angular configuration relative to a distal end of the end effector, and storing the angular configuration of the end effector that provides the trajectory for use in forming the plan.
37. 36. The method of claim 35, wherein establishing the trajectory includes determining a three dimensional angular configuration of the end effector that provides the trajectory, determining a spatial offset of a proximal end of the end effector from a distal end of the end effector that provides the angular configuration, and storing the spatial offset of the proximal end of the end effector that provides the trajectory for use in forming the plan.
38. 36. The method of claim 35, wherein determining a position of a distal end of an end effector comprises determining a position of a distal end of an end effector, the end effector comprising a drill or abrasive bit of a treatment tool, the treatment tool comprising a drilling device.
39. 36. The method of claim 35, wherein determining a position of the distal end of the end effector comprises contacting a physical point with the distal end of the end effector and simultaneously determining a position of the distal end of the end effector in three dimensional space.
40. 36. The method of claim 35, wherein the robotic arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, and determining a position of the distal end of the end effector includes determining a position of the distal end of the end effector relative to a proximal end of the robotic arm from position data from the one or more position sensors.
41. 36. The method of claim 35, wherein the tracking arm comprises a plurality of interconnected arm segments engaged with one or more position sensors, the method including determining a position of a distal end of the tracking arm relative to a proximal end of the tracking arm from position data from the one or more position sensors.
42. 36. The method of claim 35, wherein determining a position of the distal end of the end effector in three dimensional space includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position physically engaging the distal end of the tracking arm.
43. 36. The method of claim 35, wherein a distal end of the tracking arm is spaced from the site or object and includes a detector device engaged with the distal end, the detector device disposed in communication with the site or object, and determining a position of the distal end of the end effector includes determining a position of the site or object in three dimensional space via the end effector relative to a reference position, the reference position being detected by the detector device engaged with the distal end of the tracking arm.
44. 36. The method of claim 35, wherein determining a position of the distal end of the end effector includes determining a position of the distal end of the end effector in three-dimensional space relative to a reference position determined via the tracking arm.
45. 36. The method of claim 35, wherein performing the treatment includes performing the treatment at the site or on the object according to a plan, using an end effector of a treatment tool engaged with a distal end of the robotic arm to move a path relative to a reference position determined via the tracking arm and orienting the end effector on an established trajectory.
46. 46. The method of claim 45, comprising adjusting the plan during performance of the procedure in response to movement of the site or object as determined via movement of a reference position determined via the tracking arm.
47. 36. The method of claim 35, comprising providing feedback in response to the treatment device deviating from the plan during performance of the treatment, including moving the path to direct the end effector to the established trajectory.
48. 48. The method of claim 47, wherein providing feedback comprises directing haptic or tactile feedback via the treatment device.
49. 48. The method of claim 47, wherein providing feedback comprises providing visual or auditory feedback via a deviation indicator.
50. 48. The method of claim 47, wherein providing feedback includes limiting movement of the treatment device by providing resistance to movement via the robotic arm.
51. 36. The method of claim 35, wherein forming the plan includes forming a plan for a procedure to be performed by the end effector at each of a plurality of physical points on the site or object, and performing the procedure includes performing the procedure at each of the physical points on the site or object using the end effector within the established trajectory, and the procedure is performed in parallel between the physical points.
Citation Information
Patent Citations
Tooth preparation system
CN112790885A
Robotic device for dental surgery
JP2018505014A
Method for the guided performance of oral and maxillofacial procedures and related systems
JP2020517381A
Methods and systems for computer-aided surgery using intra-operative video acquired by a free moving camera
US20180071032A1
Systems and methods for visual sensing of and docking with a trocar
WO2021086409A1
