Data capture and adaptive guidance for robotic surgery with elongate medical devices

Abstract

The invention relates to data capture and adaptive guidance for robotic surgery with elongate medical devices. A system for adaptive guidance of operating one or more elongate medical devices includes a processing unit configured to cause the system to provide feedback to an operator during a simulated or field procedure with one or more first elongate medical devices and performed by the operator, the feedback includes an adaptive guidance for operation of the one or more first elongate medical devices during the simulated or field procedure, the feedback based on at least one profile, and the at least one profile based on input from a reference operator for operation of one or more second elongate medical devices.

Description

This application is a divisional application of Chinese patent application No. 202080064586.1, filed on July 14, 2020, entitled “Data Capture and Adaptive Guidance for Robotic Surgery Utilizing Elongated Medical Devices”.

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of U.S. Provisional Application No. 62 / 874,177, filed on July 15, 2019, entitled “DATA CAPTURE AND ADAPTIVE GUIDANCE FOR ROBOTIC PROCEDURES WITH AN ELONGATED MEDICAL DEVICE” (Case No. C130-310). Technical Field

[0002] The present invention relates generally to the field of robotic medical surgical systems, and more particularly to systems, apparatus and methods related to capturing data associated with user input and providing adaptive guidance for surgery using elongated medical devices. Background Art

[0003] Catheter and other elongated medical devices (elongated medical device, EMD) can be used for minimally invasive medical procedures for diagnosing and treating diseases of various vascular systems, including neurovascular intervention (NVI), percutaneous coronary intervention (PCI) and peripheral vascular intervention (PVI), which are also called neurointerventional procedures. These operations usually involve guiding guide wires through the vascular system, and the catheter is advanced by the guide wire to provide treatment. Catheterization begins with entering into a suitable blood vessel, such as an artery or vein, by using a guide sheath of standard percutaneous technology. Through the guide sheath, the sheath or guide catheter is then advanced to the main position on the diagnostic guide wire, such as the internal carotid artery for NVI, the coronary artery ostium for PCI, or the superficial femoral artery for PVI. Then the guide wire suitable for the vascular system is guided by the sheath or guide catheter to the target position in the vascular system. In some cases, such as in a tortuous anatomical structure, a support catheter or a microcatheter is inserted on the guide wire to help guide the guide wire. A doctor or operator can use an imaging system (e.g., a fluoroscope) to obtain a movie with a contrast injection and select a fixed frame to be used as a roadmap to guide a guidewire or catheter to a target location, such as a lesion. Contrast-enhanced images are also obtained when the doctor delivers the guidewire or catheter so that the doctor can verify that the device moves to the target location along the correct path. While using fluoroscopy to observe the anatomical structure, the doctor manipulates the proximal end of the guidewire or catheter to guide the distal tip into the appropriate blood vessel toward the lesion or target anatomical location and avoids advancing into branch vessels.

[0004] A surgical system based on a robotic catheter has been developed that can be used to help doctors perform catheterization procedures such as NVI, PCI, and PVI. Examples of NVI procedures include coil embolization of aneurysms, liquid embolization of arteriovenous malformations, and mechanical thrombectomy of large vessel occlusions in the case of acute ischemic stroke. In NVI surgery, doctors use a robotic system to obtain a target lesion pathway by controlling the operation of a neurovascular guidewire and a microcatheter to provide treatment to restore normal blood flow. The target pathway is achieved by a sheath or guide catheter, but an intermediate catheter may also be required for a more distal area or to provide adequate support for the microcatheter and guidewire. Depending on the type and treatment of the lesion, the distal end of the guidewire is guided into or through the lesion. In order to treat an aneurysm, a microcatheter is advanced into the lesion and the guidewire is removed, and several embolic coils are deployed into the aneurysm by the microcatheter and used to block blood from flowing into the aneurysm. In order to treat an arteriovenous malformation, a liquid embolic agent is injected into the malformation site by a microcatheter. Mechanical thrombectomy can be achieved by suction and / or using a stent retriever to treat vascular occlusion. Depending on the location of the clot, suction can be performed through an aspiration catheter, or for smaller arteries, through a microcatheter. Once the aspiration catheter is at the lesion, negative pressure is applied to remove the clot through the catheter. Alternatively, the clot can be removed by deploying a stent retriever through a microcatheter. Once the clot is incorporated into the stent retriever, the clot is retrieved by retracting the stent retriever and microcatheter (or intermediate catheter) into the guide catheter.

[0005] In PCI, doctors use a robotic system to gain access to the lesion by manipulating a coronary guidewire to provide treatment and restore normal blood flow. This access is achieved by placing a guide catheter in the coronary artery opening. The distal end of the guidewire is guided through the lesion, and for complex anatomical structures, a microcatheter can be used to provide adequate support for the guidewire. Blood flow is restored by delivering and deploying a stent or balloon at the lesion. The lesion may need to be prepared before stent implantation, either by delivering a balloon for pre-dilation of the lesion, or by performing plaque removal using, for example, a laser or atherectomy catheter and a balloon on a guidewire. Diagnostic imaging and physiological measurements can be performed using an imaging catheter or flow reserve fraction (FFR) measurements to determine appropriate therapy.

[0006] In PVI, physicians use a robotic system to deliver treatment and restore blood flow using techniques similar to NVI. The distal tip of a guidewire is guided through the lesion, and a microcatheter may be used to provide adequate support for the guidewire in complex anatomy. Blood flow is restored by delivering and deploying a stent or balloon to the lesion. As with PCI, lesion preparation and diagnostic imaging may also be used.

[0007] When support at the distal end of a catheter or guidewire is needed, for example, to guide a tortuous or calcified vascular system, to reach a distal anatomical position, or to pass through a hard lesion, an over-the-wire (OTW) catheter or coaxial system is used. An OTW catheter has an inner lumen of a guidewire for extending the full length of the catheter. This provides a relatively stable system because the guidewire is supported along the entire length. However, compared to a rapid replacement catheter (see below), this system has some disadvantages, including higher friction and a longer total length. Typically, in order to remove or replace an OTW catheter while maintaining the position of an indwelling guidewire, the exposed length of the guidewire (outside the patient) must be longer than the OTW catheter. A 300 cm long guidewire is generally sufficient for this purpose and is generally referred to as a replacement length guidewire. Due to the length of the guidewire, two operators are required to remove or replace the OTW catheter. This becomes even more challenging if a triple coaxial (also known as a quad coaxial catheter) known as a triaxial system is used. However, due to its stability, the OTW system is often used in NVI and PVI surgery. On the other hand, PCI procedures typically use rapid-exchange (or monorail) catheters. The guidewire lumen in a rapid-exchange catheter passes only through the distal segment of the catheter, which is called the monorail or rapid-exchange (RX) segment. With the RX system, the operator manipulates the interventional devices parallel to each other (as opposed to the OTW system, where the devices are manipulated in a serial configuration), and the exposed length of the guidewire only needs to be slightly longer than the RX segment of the catheter. Rapid-exchange length guidewires are typically 180-200 cm long. Given the shorter guidewire length and monorail, RX catheters can be replaced by a single operator. However, when more distal support is needed, RX catheters are typically not enough. Summary of the invention

[0008] According to an embodiment, a data capture system for generating a profile using captured parameters from a reference operator. The data capture system includes: a user interface that receives input from a reference operator for operation of one or more elongated medical devices (EMDs); a sensor system that captures parameters associated with the input from the reference operator; and a processing unit that uses the captured parameters to generate at least one profile associated with characteristics of the reference operator.

[0009] In one example, the parameter detected by the sensor includes at least one of a motion parameter or a load parameter.

[0010] In one example, the motion parameter and the load parameter include at least one of displacement, linear velocity, linear force, rotational velocity, rotational torque, acceleration, or frequency.

[0011] In one example, the parameters detected by the sensor include at least one of: (a) a combination of linear velocity and linear force load; (b) a combination of rotational velocity and rotational torque; (c) a combination of displacement and / or velocity and / or acceleration with linear force; or (d) a combination of angular displacement and / or angular velocity and / or angular acceleration and torque.

[0012] In one example, the parameter detected by the sensor includes a manipulation frequency of the EMD.

[0013] In one example, the parameter detected by the sensor includes a combination of two or more of a motion parameter, a load parameter, a position, a displacement, a frequency, a linear velocity, a linear force, a rotational speed, or a rotational torque.

[0014] In one example, the data capture system is stand-alone or part of another system such as a robotic medical system or a training system.

[0015] In one example, the sensor system includes contact and / or non-contact sensors to detect movement and / or load of an EMD or a stack of EMDs.

[0016] In one example, the sensor system includes signal conditioning.

[0017] In one example, the user interface includes more than one EMD, and the sensor system detects input parameters for concurrent operation of the more than one EMD.

[0018] In one example, the input parameters are captured based on a heuristic model.

[0019] In one example, the characteristics of the reference operator include at least one of physician metadata.

[0020] In one example, at least a portion of the captured data may be associated with case metadata.

[0021] In one example, at least a portion of the captured data may be a combination of physician metadata and case metadata.

[0022] In one example, the recording and retrieval of data can be local or non-local to the system.

[0023] In one example, the processing unit utilizes algorithmic analysis of input from one or more operators in forming the profile.

[0024] In one example, the processing unit will generate a power profile associated with the operator's profile that includes motion and load parameters.

[0025] In one example, the processing unit calculates and determines an envelope of a range of motion, load, and power parameters.

[0026] In one example, the processing unit will generate adaptive guidance parameters for the EMD maneuver based on the motion and load parameters contained in the operator's profile.

[0027] In one example, the processing unit generates a motion profile and / or a load profile associated with one or more EMDs.

[0028] In one example, the motion profile is constructed based only on the motion parameters of the operator profile for one EMD, including simultaneous rotational and linear motion of the EMD.

[0029] In one example, the motion profile is constructed based on motion parameters of an operator profile for more than one EMD, including rotational and / or linear motion of a first EMD and rotational and / or linear motion of a second EMD occurring simultaneously.

[0030] In one example, the motion profile is constructed based on load parameters of operator profiles for more than one EMD.

[0031] In one example, the motion profile is constructed based on both motion and load parameters of the operator profile for more than one EMD.

[0032] In one example, the processing unit generates a master profile by combining the doctor metadata and the case metadata.

[0033] In one example, the processing unit combines the captured data from the reference operator with additional captured data from additional operators to generate an aggregated dossier.

[0034] In one example, the generated dossier is updated with additional captured data from additional additional operators.

[0035] In one example, the processing unit updates the profile when new input data is available, such as after consecutive surgeries that are ongoing.

[0036] In one example, the processing unit converts input from the operator in combination with other metadata into operational control equations, operational constraints, and commands.

[0037] In one example, the processing unit can generate or update the profile and convert data into operational rules offline or in real time.

[0038] In one example, the processing unit provides feedback to the second operator based on the generated profile.

[0039] In one example, the feedback is provided during a training simulation.

[0040] In one example, the feedback is provided during a live procedure performed by the second operator.

[0041] In one example, the second operator can selectively accept or reject the feedback.

[0042] In one example, the processing unit generates adaptive boot parameters.

[0043] In one example, the adaptive guidance parameters include at least one of operating control equations or constraints applied to the EMD or procedure, surgical recommendations, motion profiles, or general rule-based motions and loads.

[0044] In another embodiment, a robotic medical system includes: a module for independently and collaboratively actuating one or more EMDs; a user interface that receives input from a reference operator to manipulate the EMD; a sensor system to detect motion and / or load parameters applied to the EMD; a data capture portion that captures parameters detected by the sensor associated with the input from the reference operator, the captured parameters including at least one motion or load parameter, wherein the data capture portion associates the captured parameters with characteristics of the reference operator; and a processing unit that converts the detected parameters into operational control equations for the elongated medical device and surgery.

[0045] In another embodiment, a method includes: capturing input parameters from a reference operator of a robotic device, the captured input parameters including at least one motion or load parameter; converting the captured input parameters into operation commands for the robotic device; and using the captured input parameters to generate a profile, the profile being associated with characteristics of the reference operator.

[0046] In another embodiment, a non-transitory computer-readable storage medium is encoded with instructions executable by a processor of a computing system. The computer-readable storage medium includes instructions for: capturing input parameters from a reference operator of a robotic device, the captured input parameters including at least one motion or load parameter; converting the captured input parameters into operation commands for the robotic device; and generating a profile using the captured input parameters, the profile being associated with characteristics of the reference operator.

[0047] In another embodiment, a computer-implemented method includes: capturing input parameters from a reference operator of a robotic device, the captured input parameters including at least one motion or load parameter; converting the captured input parameters into operation commands for the robotic device; and using the captured input parameters to generate a profile, the profile being associated with characteristics of the reference operator.

[0048] In another embodiment, a data capture system includes: a user interface that receives input from a reference operator for operation of a slender medical device, the user interface including sensors to detect parameters associated with the input from the reference operator; a recording portion that captures parameters associated with the input from the reference operator detected by the sensor, the captured parameters including at least one motion or load parameter; and a processing unit that generates parameters for adaptive guidance of operation of the slender medical device based on the captured input parameters.

[0049] In another embodiment, a robotic medical system comprises: a user interface that receives input from a reference operator; a sensor system that detects parameters associated with the input from the reference operator; a data capture portion that captures parameters associated with the input from the reference operator detected by the sensor; a processing unit that converts the input from the operator into operational adaptive guidance for a slender medical device and surgery; and at least one module that independently and collaboratively actuates one or more EMDs.

[0050] In another embodiment, a method includes: capturing input parameters from a reference operator of a slender medical device, the captured input parameters including at least one motion or load parameter; converting the captured input parameters into operation commands for the slender medical device; and generating guidance parameters for the slender medical device based on the captured input parameters.

[0051] In another embodiment, a non-transitory computer-readable storage medium is encoded with instructions executable by a processor of a computing system. The computer-readable storage medium includes instructions for: capturing input parameters from a reference operator of a robotic device, the captured input parameters including at least one motion or load parameter; converting the captured input parameters into operation commands for the robotic device; and generating guidance parameters for the elongated medical device based on the captured input parameters.

[0052] In another embodiment, a computer-implemented method includes: capturing input parameters from a reference operator of a robotic device, the captured input parameters including at least one motion or load parameter; converting the captured input parameters into operation commands for the robotic device; and generating guidance parameters for the elongated medical device based on the captured input parameters.

[0053] In another embodiment, a data capture system for generating a profile using captured parameters from a reference operator includes: a user interface that receives input from a reference operator for operation of one or more elongated medical devices (EMDs); and a sensor system that captures parameters associated with the input from the reference operator, wherein the parameters detected by the sensor include at least one of: (a) a combination of linear velocity and linear force load; (b) a combination of rotational velocity and rotational torque; (c) a combination of displacement and / or velocity and / or acceleration with linear force; or (d) a combination of angular displacement and / or angular velocity and / or angular acceleration with torque.

[0054] In another embodiment, a data capture system for generating a profile using captured parameters from a reference operator comprises: a user interface that receives input from a reference operator for operation of one or more elongated medical devices (EMDs); and a sensor system that captures parameters associated with the input from the reference operator, wherein the parameters detected by the sensors include a combination of two or more of motion parameters, load parameters, position, displacement, frequency, linear velocity, linear force, rotational velocity, or rotational torque. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] The present invention will be more fully understood from the following detailed description taken in conjunction with the accompanying drawings, wherein reference numerals refer to like parts and wherein: Figure 1 is a perspective view of an exemplary catheter-based surgical system according to an embodiment; Figure 2 is a schematic block diagram of an exemplary catheter-based surgical system according to an embodiment; Figure 3 is a perspective view of a robotic actuator for a catheter-based surgical system according to an embodiment; Figure 4 is a schematic diagram of an exemplary data capture system for use with a robotic medical system having an elongated medical device (EMD), according to an embodiment; Figure 5 is a schematic diagram of an exemplary robotic medical system with an exemplary data capture system according to an embodiment; Figure 6is a flow chart illustrating an exemplary method for using operator input to generate a profile associated with operator characteristics according to an embodiment; Figure 7 is a flow chart illustrating an exemplary method for generating adaptive guidance parameters using operator input according to an embodiment; Figure 8 illustrates an exemplary data input arrangement and data utilization of a robotic medical system with an EMD according to an embodiment; Fig. 9 illustrates an exemplary actuator / sensor arrangement for use with various EMDs according to embodiments; Fig.10 illustrates an exemplary data capture linear module for use with various EMDs according to an embodiment; and Fig.11 An exemplary data capture rotation module for use with various EMDs is illustrated in accordance with an embodiment. DETAILED DESCRIPTION

[0056] Figure 1 is a perspective view of an exemplary catheter-based surgical system 10 according to an embodiment. The catheter-based surgical system 10 can be used to perform catheter-based medical procedures, such as percutaneous interventional procedures, such as percutaneous coronary intervention (PCI) (e.g., for treating STEMI), neurovascular interventional procedures (NVI) (e.g., for treating emergency large vessel occlusion (ELVO)), peripheral vascular interventional procedures (PVI) (e.g., for critical limb ischemia (CLI)), etc.). Catheter-based medical procedures may include diagnostic catheterization, during which one or more catheters or other elongated medical devices (EMDs) are used to help diagnose a patient's disease. For example, during one embodiment of a catheter-based diagnostic procedure, a contrast agent is injected into one or more arteries through a catheter, and an image of the patient's vascular system is taken. Catheter-based medical procedures may also include catheter-based therapeutic procedures (e.g., angioplasty, stent placement, treatment of peripheral vascular disease, clot removal, arteriovenous malformation treatment, treatment of aneurysms, etc.), during which a catheter (or other EMD) is used to treat the disease. This can be accomplished by including adjuncts such as intravascular ultrasound (IVUS), optical coherence tomography (OCT), fractional flow reserve (FFR), and other Figure 2 ) to enhance therapeutic procedures. However, it should be noted that those skilled in the art will recognize that certain specific percutaneous interventional devices or components (e.g., type of guidewire, type of catheter, etc.) may be selected based on the type of procedure to be performed. The catheter-based surgical system 10 may perform any number of catheter-based medical procedures with minor adjustments to accommodate the specific percutaneous interventional device to be used in the procedure.

[0057] The catheter-based surgical system 10 includes a bedside unit 20 and a control station 26, among other elements. The bedside unit 20 includes a robotic drive 24 and a positioning system 22 positioned adjacent to the patient 12. The patient 12 is supported on a patient table 18. The positioning system 22 is used to position and support the robotic drive 24. The positioning system 22 may be, for example, a robotic arm, an articulated arm, a holder, etc. The positioning system 22 may be attached at one end to a track, a base, or a cart, for example, on the patient table 18. The other end of the positioning system 22 is attached to the robotic drive 24. The positioning system 22 may be removed (along with the robotic drive 24) to allow the patient 12 to be placed on the patient table 18. Once the patient 12 is positioned on the patient table 18, the positioning system 22 may be used to position or position the robotic drive 24 relative to the patient 12 for surgery. In one embodiment, the patient table 18 is operably supported by a support 17 fixed to a floor and / or ground. The patient table 18 is capable of moving with multiple degrees of freedom relative to the support 17, such as roll, pitch, and yaw. The bedside unit 20 may also include a control device and a display 46 ( Figure 2 For example, the control device and the display may be located on the housing of the robot drive 24.

[0058] Typically, the robotic driver 24 may be equipped with appropriate percutaneous access devices and accessories 48 ( Figure 2 ) (e.g., guidewires, various types of catheters including balloon catheters, stent delivery systems, stent retrievers, embolic coils, liquid embolic agents, aspiration pumps, devices for delivering contrast agents, drugs, hemostatic valve adapters, syringes, stopcocks, inflation devices, etc.) to allow a user or operator 11 to perform catheter-based medical procedures via the robotic system by operating various control devices such as control devices and inputs located at a control station 26. The bedside unit 20, and in particular the robotic drive 24, may include any number and / or combination of components to provide the bedside unit 20 with the functionality described herein. The user or operator 11 at the control station 26 is referred to as a control station user or control station operator, and is referred to herein as a user or operator. The user or operator at the bedside unit 20 is referred to as a bedside unit user or bedside unit operator. The robotic drive 24 includes a device mounted to a track or linear member 60 ( Figure 3 1 and 12 ). A track or linear member 60 guides and supports the device modules. Each device module 32a-d can be used to drive an EMD, such as a catheter or a guidewire. For example, the robotic drive 24 can be used to automatically advance a guidewire into a diagnostic catheter and into a guide catheter in an artery of the patient 12. One or more devices, such as an EMD, enter the body (e.g., a blood vessel) of the patient 12 at the insertion point 16 through, for example, an introducer sheath.

[0059] The bedside unit 20 is in communication with the control station 26, thereby allowing signals generated by user inputs to the control station 26 to be transmitted wirelessly or by hardwire to the bedside unit 20 to control various functions of the bedside unit 20. As described below, the control station 26 may include a control computing system 34 ( Figure 2 ) or coupled to the bedside unit 20 via the control computing system 34. The bedside unit 20 can also communicate with the control station 26, the control computing system 34 ( Figure 2 ) or both to provide feedback signals (e.g., load, speed, operating status, warning signals, error codes, etc.). Communication between the control computing system 34 and the various components of the catheter-based surgical system 10 may be provided via a communication link, which may be a wireless connection, a cable connection, or any other means capable of allowing communication between the components. The control station 26 or other similar control system may be located at a local location (e.g., Figure 2 ) or at a remote location (e.g., Figure 2 ). The catheter surgery system 10 can be operated by a control station at a local site, a control station at a remote site, or both the local control station and the remote control station simultaneously. At the local site, the user or operator 11 and the control station 26 are located in the same room as the patient 12 and the bedside unit 20 or in an adjacent room. As used herein, the local site is the location of the bedside unit 20 and the patient 12 or object (e.g., an animal or a corpse), and the remote site is the location of the user or operator 11 and the control station 26 for remotely controlling the bedside unit 20. For example, the control station 26 (and the control computing system) at the remote site and the bedside unit 20 and / or the control computing system at the local site can be connected via the Internet using the communication system and service 36 ( Figure 2 In one embodiment, the remote site and the local (patient) site are remote from one another, e.g., in different rooms in the same building, in different buildings in the same city, in different cities, or other different locations where the remote site does not have physical access to the bedside unit 20 and / or the patient 12 at the local site.

[0060] The control station 26 typically includes one or more input modules 28 configured to receive user input to operate various components or systems of the catheter-based surgical system 10. In the illustrated embodiment, the control station 26 allows the user or operator 11 to control the bedside unit 20 to perform a catheter-based medical procedure. For example, the input module 28 can be configured to cause the bedside unit 20 to use a percutaneous interventional device (e.g., EMD) interfaced with the robotic drive 24 to perform various tasks (e.g., for advancing, retracting, or rotating a guidewire, advancing, retracting, or rotating a catheter, inflating or deflating a balloon located on a catheter, positioning and / or deploying a stent, positioning and / or deploying a stent retriever, positioning and / or deploying a coil, injecting contrast media into a catheter, injecting a liquid embolic agent into a catheter, injecting a drug or saline into a catheter, aspirating on a catheter, or performing any other function that may be performed as part of a catheter-based medical procedure). The robotic drive 24 includes various drive mechanisms to cause movement (e.g., axial and rotational movement) of components of the bedside unit 20 including the percutaneous interventional device.

[0061] In one embodiment, the input module 28 may include one or more touch screens, joysticks, scroll wheels, and / or buttons. In addition to the input module 28, the control station 26 may use additional user control devices 44 ( Figure 2), such as a foot switch and a microphone for voice commands, etc. The input module 28 can be configured to advance, retract or rotate various components and percutaneous interventional devices, such as guidewires, and one or more catheters or microcatheters. For example, the buttons may include an emergency stop button, a multiplier button, a device selection button, and an automatic movement button. When the emergency stop button is pressed, the power (e.g., electrical power) given to the bedside unit 20 is turned off or removed. When in speed control mode, the multiplier button is used to increase or decrease the speed at which the relevant components move in response to manipulation of the input module 28. When in position control mode, the multiplier button changes the mapping between the input distance and the output command distance. The device selection button allows the user or operator 11 to select which percutaneous interventional devices loaded into the robot drive 24 are controlled by the input module 28. The automatic movement button is used to enable the catheter-based surgical system 10 to perform algorithmic movements on percutaneous interventional devices without direct commands from the user or operator 11. In one embodiment, the input module 28 may include one or more controls or icons (not shown) displayed on a touch screen (which may or may not be part of the display 30) that, when activated, cause operation of the components of the catheter-based surgical system 10. The input module 28 may also include a balloon or stent control device that is configured to inflate or deflate the balloon and / or deploy the stent. Each input module 28 may include one or more buttons, scroll wheels, joysticks, touch screens, etc., which may be used to control one or more specific components dedicated to the control device. In addition, one or more touch screens may display one or more icons (not shown) associated with various portions of the input module 28 or various components of the catheter-based surgical system 10.

[0062] The control station 26 may include a display 30. In other embodiments, the control station 26 may include two or more displays 30. The display 30 may be configured to display information or patient-specific data to a user or operator 11 located at the control station 26. For example, the display 30 may be configured to display image data (e.g., X-ray images, MRI images, CT images, ultrasound images, etc.), hemodynamic data (e.g., blood pressure, heart rate, etc.), patient record information (e.g., medical history, age, weight, etc.), lesion or treatment assessment data (e.g., IVUS, OCT, FFR, etc.). In addition, the display 30 may be configured to display surgery-specific information (e.g., surgery checklist, recommendations, surgery duration, catheter or guidewire position, amount of medication or contrast agent delivered, etc.). In addition, the display 30 may be configured to display information to provide information related to the control computing system 34 ( Figure 2 The display 30 may include touch screen capabilities to provide some user input capabilities for the system.

[0063] The catheter-based surgical system 10 also includes an imaging system 14. The imaging system 14 may be any medical imaging system that may be used in conjunction with a catheter-based medical procedure (e.g., non-digital X-ray, digital X-ray, CT, MRI, ultrasound, etc.). In an exemplary embodiment, the imaging system 14 is a digital X-ray imaging device that communicates with the control station 26. In one embodiment, the imaging system 14 may include a C-arm ( Figure 1 ), the C-arm allows the imaging system 14 to be partially or completely rotated around the patient 12 to obtain images at different angular positions relative to the patient 12 (e.g., sagittal view, caudal view, anteroposterior view, etc.). In one embodiment, the imaging system 14 is a fluoroscopy system that includes a C-arm having an X-ray source 13 and a detector 15, which is also called an image intensifier.

[0064] The imaging system 14 may be configured to take X-ray images of appropriate areas of the patient 12 during surgery. For example, the imaging system 14 may be configured to take one or more X-ray images of the head to diagnose neurovascular conditions. The imaging system 14 may also be configured to take one or more X-ray images (e.g., real-time images) during a catheter-based medical procedure to help a user or operator 11 at the control station 26 properly position a guidewire, guide catheter, microcatheter, stent retriever, coil, stent, balloon, etc. during the procedure. The one or more images may be displayed on the display 30. For example, the image may be displayed on the display 30 to allow the user or operator 11 to accurately move the guide catheter or guidewire to the appropriate position.

[0065] In order to clarify the direction, a rectangular coordinate system with X, Y and Z axes is introduced. The positive X axis is oriented in the longitudinal (axial) distal direction, that is, in the direction from the proximal end to the distal end, in other words, from the proximal side to the distal side. The Y axis and the Z axis are located in a transverse plane relative to the X axis, wherein the positive Z axis points upward, that is, in the direction opposite to gravity, and the Y axis is automatically determined by the right-hand rule.

[0066] Figure 2 is a block diagram of a catheter-based surgical system 10 according to an exemplary embodiment. The catheter surgical system 10 may include a control computing system 34. For example, the control computing system 34 may be physically located at the control station 26 ( Figure 1). The control computing system 34 may generally be an electronic control unit suitable for providing the various functions described herein for the catheter-based surgical system 10. For example, the control computing system 34 may be an embedded system, a dedicated circuit, a general-purpose system programmed with the functions described herein, etc. The control computing system 34 communicates with the bedside unit 20, communication systems and services 36 (e.g., the Internet, a firewall, a cloud service, a session manager, a hospital network, etc.), a local control station 38, an additional communication system 40 (e.g., a telepresence system), a remote control station and computing system 42, and a patient sensor 56 (e.g., an electrocardiogram (ECG) device, an electroencephalogram (EEG) device, a blood pressure monitor, a temperature monitor, a heart rate monitor, a respiratory monitor, etc.). The control computing system also communicates with the imaging system 14, the patient table 18, the additional medical system 50, the contrast agent injection system 52, and the auxiliary devices 54 (e.g., IVUS, OCT, FFR, etc.). The bedside unit 20 includes a robotic drive 24, a positioning system 22, and may include additional control devices and a display 46. As described above, additional controls and displays may be located on the housing of the robotic drive 24. Interventional devices and accessories 48 (e.g., guidewires, catheters, etc.) interface with the bedside system 20. In one embodiment, the interventional devices and accessories 48 may include specialized devices (e.g., IVUS catheters, OCT catheters, FFR wires, diagnostic catheters for angiography, etc.) that interface with their corresponding accessory devices 54, i.e., IVUS systems, OCT systems, FFR systems, etc.

[0067] In various embodiments, the control computing system 34 is configured to control the computer system 34 based on the user and the input module 28 (e.g., the control station 26 ( Figure 138 or remote control station 42) and / or generates control signals based on information accessible to the control computing system 34, so that the catheter-based surgical system 10 can be used to perform medical surgery. The local control station 38 includes one or more displays 30, one or more input modules 28, and an additional user control device 44. The remote control station and the computing system 42 may include similar components to the local control station 38. The remote control station 42 and the local control station 38 may be different and customized based on their desired functions. The additional user control device 44 may include, for example, one or more foot input control devices. The foot input control device may be configured to allow the user to select functions of the imaging system 14, such as turning on and off the X-ray and scrolling through different stored images. In another embodiment, the foot input device may be configured to allow the user to select which devices are mapped to the scroll wheel included in the input module 28. Additional communication systems 40 (eg, audio conferencing, video conferencing, telepresence, etc.) may be employed to assist the operator in interacting with the patient, medical personnel (eg, angio-suite staff), and / or equipment near the bedside.

[0068] The catheter-based surgical system 10 may be connected or configured to include any other systems and / or devices not explicitly shown. For example, the catheter-based surgical system 10 may include an image processing engine, a data storage and archiving system, an automated balloon and / or stent expansion system, a drug injection system, a drug tracking and / or recording system, a user log, an encryption system, a system for limiting access to or use of the catheter-based surgical system 10, and the like.

[0069] As mentioned, the control computing system 34 communicates with the bedside unit 20, which includes the robotic drive 24, the positioning system 22, and may include additional controls and a display 46, and may provide control signals to the bedside unit 20 to control the operation of motors and drive mechanisms used to drive percutaneous interventional devices (e.g., guidewires, catheters, etc.). Various drive mechanisms may be provided as part of the robotic drive 24. Figure 3 is a perspective view of a robotic actuator for a catheter-based surgical system 10 according to an embodiment. Figure 3In, the robotic drive 24 includes a plurality of device modules 32a-d coupled to a linear member 60. Each device module 32a-d is coupled to the linear member 60 via a stage 62a-d that is movably mounted to the linear member 60. The device modules 32a-d can be connected to the stage 62a-d using a connector such as an offset bracket 78a-d. In another embodiment, the device modules 32a-d are directly mounted to the stage 62a-d. Each stage 62a-d can be independently actuated to move linearly along the linear member 60. Therefore, each stage 62a-d (and the corresponding device modules 32a-d coupled to the stages 62a-d) can move independently relative to each other and the linear member 60. A drive mechanism is used to actuate each stage 62a-d. In Figure 3 In the embodiment shown in , the drive mechanism includes an independent stage translation motor 64a-d and a platform drive mechanism 76 coupled to each stage 62a-d, for example, a lead screw via a rotating nut, a rack via a pinion, a belt via a pinion or pulley, a chain via a sprocket, or the stage translation motor 64a-d itself can be a linear motor. In some embodiments, the stage drive mechanism 76 can be a combination of these mechanisms, for example, each stage 62a-d can adopt a different type of stage drive mechanism. In an embodiment where the stage drive mechanism is a lead screw and a rotating nut, the lead screw can be rotated and each stage 62a-d can engage and disengage with the lead screw to move, for example, to advance or retract. In Figure 3 In the embodiment shown in FIG. 6 , the stages 62 a - d and device modules 32 a - d are in a serial drive configuration.

[0070] Each device module 32a-d includes a drive module 68a-d and a cartridge 66a-d mounted on and coupled to the drive module 68a-d. Figure 3In the embodiment shown in, each box 66a-d is mounted to the drive module 68a-d with a vertical orientation. In other embodiments, each box 66a-d can be mounted to the drive module 68a-d with other installation orientations. Each box 66a-d is configured to interface with the proximal part of the EMD (not shown) and supports the proximal part. In addition, each box 66a-d may include the following element, that is: in addition to the linear motion provided by the actuation of the corresponding platform 62a-d for linear movement along the linear member 60, the element also provides one or more degrees of freedom. For example, the box 66a-d may include an element that can be used for rotating the EMD when the box is coupled to the drive module 68a-d. Each drive module 68a-d includes at least one coupler to provide a drive interface for the mechanism in each box 66a-d, to provide additional degrees of freedom. Each box 66a-d also includes a channel, in which the device support 79a-d is located, and each device support 79a-d is used to prevent the EMD from buckling. Support arms 77a, 77b and 77c are attached to each device module 32a, 32b and 32c, respectively, to provide a fixing point for supporting the proximal end of device supports 79b, 79c and 79d, respectively. The robot drive 24 may also include a device support connector 72 connected to the device support 79, the distal support arm 70 and the support arm 770. The support arm 770 is used to provide a fixing point to support the proximal end of the distal device support 79a housed in the distal device module 32a. In addition, an introducer interface support (redirector) 74 may be connected to the device support connector 72 and the EMD (e.g., an introducer sheath). The configuration of the robot drive 24 has the following benefits, namely: the volume and weight of the drive robot drive 24 are reduced by using an actuator on a single linear member.

[0071] To prevent pathogens from contaminating the patient, the medical staff receives the bedside unit 20 and the patient 12 or object ( Figure 1 Aseptic technique is used in a room (shown in ). The room that houses the bedside unit 20 and the patient 12 can be, for example, a catheterization room or a vascular room. Aseptic technique includes the use of sterile barriers, sterile equipment, appropriate patient preparation, environmental control, and contact instructions. Therefore, all EMDs and interventional accessories are sterilized and can only come into contact with sterile barriers or sterile equipment. In one embodiment, a sterile drape (not shown) is placed on the non-sterile robotic drive 24. Each box 66a-d is sterilized and acts as a sterile interface between the robotic drive 24 covered by the drape and at least one EMD. Each box 66a-d can be designed to be sterilized for a single use, or to be re-sterilized in whole or in part, so that the box 66a-d or its components can be used in multiple surgeries.

[0072] In one example, various types of data during a procedure performed by an operator may be captured and used to generate profiles associated with various characteristics. The various types of data are associated with inputs from the operator, which may be received via a user interface and captured by a sensor system. The captured data may be used to generate one or more profiles, which may then be used to facilitate operation of the robotic medical system by the same or a different operator.

[0073] In another example, the captured data can be used to provide adaptive guidance by the same or a different operator during training, simulation, or live surgery.As described in various examples below, the guidance parameters can include limitations on the operation of the robotic medical system or other guidance methods.

[0074] definition In various examples, the sensor system captures operator input in the form of waveforms (in the time domain), commands, signals, and settings. This data is then processed by the processing unit 124 ( Figure 4 ) and apply different mappings and transformations, such as filters, Fourier transforms and other mathematical or numerical mappings and transformations, in order to make them operationally usable. When the data capture system is part of a robotic medical system, motion parameters, load parameters, motion and load profiles and limitations, successful and unsuccessful attempts (e.g., number of attempts to select a branch), total travel of each EMD, and other such parameters are examples of what is captured during a case or data capture event. In addition, other data about operator characteristics and the surgery (case) can be used to better represent, describe, classify or segment the data. The latter is often referred to as metadata.

[0075] In various examples, the archive may include a collection of data associated with a user or user group. The data may be a collection of metadata, collected kinematic or dynamic (or motion or load) parameters, or parameters derived from an algorithm that processes metadata and kinematic or dynamic parameters. Kinematic parameters refer to mathematical representations of a point, body or body motion system, such as displacement, velocity, acceleration, time and frequency (frequency = 1 / time) and trajectory. This does not take into account the load required for the mobile device. Dynamic parameters refer to mathematical representations of a point, body or body motion system, such as displacement, velocity, acceleration, time and frequency (frequency = 1 / time) and trajectory, taking into account the load required for the mobile device and the external load (or loss) experienced by the device or manipulator of the mobile device. Archives related to the robot EMD drive system may include relevant force zones (typical, high, maximum), which are further classified for the type of surgery, the type of device driven, the device position within the anatomical structure, etc., speed thresholds or limits, load thresholds or limits, power thresholds or limits, or typical devices (device lengths) used.

[0076] In some examples, data associated with the operator, referred to as physician metadata, is also captured by the robotic system and used to process and present the collected data. Examples of physician metadata may include, but are not limited to, name, age, organization, years of experience, number of cases per year, total number of cases, techniques / procedures used (e.g., use of aspiration or stent retriever in mechanical thrombectomy), preferred devices (e.g., conventional guide catheter or sheath vs. balloon guide catheter), risk tolerance, and patient population acuity.

[0077] A subset of metadata representing data that may be collected from a medical procedure or training case is referred to as case metadata. Examples of case metadata may include, but are not limited to, length of procedure (time), subsets or different use cases performed within the procedure, date of procedure, devices used, treatment techniques / sequence of procedures, patient age, case type, treatment location, access location (femoral, radial, carotid, etc.), contrast used, radiation emitted (fluoroscopy time), images taken (e.g., real-time and reference fluorescence images), robotic manipulation time, robotic device loading time, robot setup time, robot movement, loads, outcomes and clinical evaluation metrics before, during, and after treatment.

[0078] As used herein, the term "motion parameter" refers to a kinematic parameter and includes translational and rotational displacement, velocity, acceleration, and the time history of these parameters (i.e., displacement (t), velocity (t), acceleration (t)) and any function of these parameters, such as the frequency of displacement, velocity, and acceleration. Motion parameters can be integrated or differentiated with respect to time to obtain other motion parameters. For example, velocity can be determined by differentiating displacement data with respect to time, acceleration can be determined as the second derivative of displacement with respect to time, velocity can be determined as the integral of acceleration over time, and displacement can be determined as the integral of velocity over time.

[0079] In various examples, the data capture system includes a sensor system and a data acquisition system, the sensor system includes sensors to detect motion and / or load parameters, and the data acquisition system records and / or displays the output of the sensor. The data acquisition system may be equipped with a reference timing unit to record the time associated with each data point. In addition, it may also be equipped with a signal conditioning unit to filter and amplify the signal. The sensor system may include a motion sensor and a load sensor. The motion sensor is a sensor that detects motion parameters. Contact motion sensors include, but are not limited to, accelerometers, LVDTs, encoders that are directly or indirectly connected to the EMD. Non-contact motion sensors include, but are not limited to, CMOS sensors, optical encoders, ultrasonic sensors, standard or high-speed cameras. Load sensors are sensors that measure force and / or torque.

[0080] In various examples, the data capture system can capture motion parameters. Motion parameters are equivalent to kinematic parameters and include linear and rotational displacement, velocity, acceleration, and the time history of these parameters (i.e., displacement (t), velocity (t), acceleration (t)) and any other products and derivatives of these parameters, such as the frequency of displacement, velocity, and acceleration. The data capture system captures the motion parameters over time so that the time history of each of these parameters is also captured. The motion parameters can be integrated or differentiated with respect to time to obtain other motion parameters. For example, velocity can be obtained by differentiating the displacement data with respect to time, acceleration can be obtained as the second-order derivative of displacement with respect to time, velocity can be determined as the integral of acceleration over time, and displacement can be determined as the integral of velocity over time.

[0081] The data capture system is capable of capturing load parameters including force and torque parameters and the time history of these parameters (ie force(t) and torque(t)). The data capture system captures the load parameters over time such that the time history of each of these parameters is captured.

[0082] In one example, a data capture system may simultaneously capture both effort (e(t)) and flow (f(t)) to measure power. The measured power may be used to form a power profile. In the mechanical domain, power is the product of force (F(t)) and velocity (V(t)), or in rotational form, the product of torque (t) and angular velocity ω(t). In the electrical domain, it may be calculated as the product of voltage (v(t)) and current (i(t)). Power may be converted between energy domains, and models used to describe power flow within multi-domain systems (typically represented as bond diagrams) may also include resistance (R), inertia (I), and compliance (C) components. For linear mechanical systems, the effort is force, and the flow is velocity. For angular mechanical systems, the effort is torque, and the flow is angular velocity. For electromagnetic systems, the effort is voltage, and the flow is current.

[0083] The target operator or reference operator for the data capture system and the medical robotic system is an individual who has experience in performing medical procedures, such as an interventionalist or radiologist or surgeon. However, for comparison purposes, data related to other types of operators may be captured. In addition, the reference operator may be the individual from whom the data is captured. Reference operators may include, but are not limited to, experienced physicians familiar with vascular interventions.

[0084] The data processing unit creates one or more archives based on the captured data and metadata. The motion archive is formed by one or a combination of multiple motion and / or load patterns associated with the manipulation of the EMD, which are referred to in the literature as techniques such as synchronized motion (e.g., drilling techniques). Any combination of smaller archives such as motion archives, power archives, load archives, case metadata, and physician archives can be used to form a master archive.

[0085] In some examples, the captured data can be used to provide adaptive guidance during training, simulation, or live surgery by the same or different operators. In various examples, the system can provide guidance by providing information to the operator or applying restrictions and rules to the operator. The operator may be able to override certain guidance, but not certain other restrictions or rules. Examples may include operational restrictions (e.g., on loads and speeds, on displacements, etc.) or restrictions on the order of steps, on the devices to be used, or on combinations of motions for certain situations.

[0086] The term "adaptive guidance" refers to the active and responsive guidance provided to the operator during surgery. It can be used during training, simulation, or live surgery by the same or different operator. The content and type of guidance may be updated over time as the operator gains more experience, or as devices improve and new technologies become available, etc. The guidance provided by the system to the operator may include limitations and rules within the environment of the surgery being performed. The operator may be able to override some guidance without overriding other guidance, such as certain limitations or rules. Examples include operating limitations (e.g., load, speed, displacement, etc.) or the sequence of steps, or the devices used, or combinations of movements for certain situations.

[0087] Data Capture System Various examples can be found in Figure 4 The exemplary system may be a stand-alone system or may be implemented as part of a robotic medical system, such as the one described above with reference to Figure 1-3 The system described in 10. For example, Figure 4 The exemplary system 100 may be implemented as part of the bedside unit 20 , the control station 26 , and / or the control computing system 34 of the system 10 .

[0088] Figure 4 The data capture system 120 includes a sensor system 122 and a processing unit 124. Figure 5 As shown in the example of , the data capture system 120 may also include an EMD interface 110. Various examples of the EMD interface 110, the sensor system 122, and the processing unit 124 are described in further detail below.

[0089] EMD Interface The exemplary system 100 includes an EMD interface 110 to receive input from an operator, such as a practitioner, via an input module 220. Figure 5 As described above, the input module 220 may include various types of input devices, such as a joystick or other tactile input device. The EMD interface 110 operates the EMD based on commands received from the input module 220. These commands are created by the input module 220 based on operator input to the input module 220 and transmitted to the EMD interface 110. The EMD interface 110 may be part of the robot drive 24, and the input module 220 may be the above referenced Figure 1-3 1. A portion of control station 26 of exemplary system 10 is depicted. Various examples of EMD interface 110 are described in further detail below.

[0090] In one embodiment, the data capture system 120 is coupled to a robotic medical system that may include an elongated medical device (EMD). The robotic medical system may be similar to the one described above with reference to Figure 1-3 The bedside unit 20 described herein may be, or may be a portion of, the bedside unit 20. For example, the robotic EMD may include a robotic drive 24 of the bedside unit 20.

[0091] As described above, the data capture system 120 of the exemplary system 100 may be implemented in a robotic medical system. In various examples, the data capture system 120 may be implemented in various parts of the robotic medical system. For example, in Figure 1-3 In the exemplary system 10 of FIG. 1 , certain portions of the data capture system 120 may be provided in the control station 26, the bedside unit 20 (e.g., within the robotic drive 24), or the control computing system 34. For example, the sensor system 122 may be implemented within the device module 32, and the processing unit may be implemented within the control station 26.

[0092] In one example, if Figure 5As shown in , the data capture system 120 can be a part of the robotic medical system 200 of the exemplary system 10 described above. Such a data capture system can be used to capture the load and motion parameters applied to the EMD during the robotic vascular intervention surgery. The robotic system 200 has an input module 28 to receive motion commands for the EMD from the operator. In this regard, the mechanical input from the operator (e.g., the movement of the control device) is coupled and transmitted to the corresponding output or command (e.g., the movement of the catheter). In another example, the input module 28 receives the operator's digital input to actuate the EMD accordingly. In this regard, the input from the operator can be received as a digital signal or converted into a digital signal. These signals can be transmitted by, for example, the control computing system 34 of the robotic system 200. The robot drive 24 of the medical robot system 10 actuates the EMD based on the motion command received from the input module 28. The data capture system 120 of the robotic system 200 includes a sensor system 122 to detect the load and motion parameters applied to the EMD actuated by the robot drive 24. The data capture system 120 also has a processing unit (processing unit 124) to record and post-process the captured data. The processing unit 124 processes the captured data and combines it with case metadata and physician metadata to generate an operator profile. The processing unit 124 may further process the profile to generate operating rules / limits. The robotic system 200 may update existing operating rules / limits defined for the robotic system 200 using the newly generated rules / limits. The robotic system 200 allows the operator to override the operating rules / limits by inputting digital values ​​of characteristic parameters and / or by applying physical / mechanical inputs to the EMD interface coupled to the data capture system 110.

[0093] Sensor system like Figure 4 As shown in the example of , the data capture system 120 includes a sensor system 122 and a processing unit 124. The sensor system 122 may include: one or more sensors to detect motion and / or load parameters applied to the EMD associated with the input from the operator; and a mechanical fixture that interfaces with the EMD. Although both the sensor system 122 and the processing unit 124 are part of the data capture system 120, they may be physically located in different locations and operate at different times. Various types of sensors may be provided to detect various parameters. For example, sensors may be provided to detect motion (e.g., linear displacement, linear velocity, linear acceleration, rotational displacement, rotational velocity, or rotational acceleration) or load (e.g., linear force or rotational torque). For example, various sensors may be able to detect other parameters, such as the frequency of the input.

[0094] In one example, a sensor system 122 is provided to capture the motion and loading parameters of the EMD when the EMD is directly manipulated by an operator. Thus, the sensor system 122 can detect the force or torque applied by the operator or the motion parameters (e.g., displacement, velocity, acceleration) introduced by the operator. In other examples, the parameters detected by the sensor system 122 can be related to the response of the EMD to the operator input. For example, the sensor system 122 can detect the displacement, velocity, acceleration, or reaction load of the catheter in response to the operator input.

[0095] Any of a variety of sensors may be provided in the sensor system 122. For example, the sensor system 122 may include contact sensors and / or contactless (or non-contact) sensors. Contact sensors may include, but are not limited to, accelerometers, linear variable differential transformers (LVDTs), encoders, or load sensors, such as piezoelectric sensors or strain gauge-based sensors, directly or indirectly connected to the EMD. Non-contact sensors may include, but are not limited to, complementary metal oxide semiconductor (CMOS) sensors, non-contact optical encoders, ultrasonic sensors, standard or high-speed cameras, optical-based load sensors, or magnetic-based load sensors. In one example, the sensor system 122 may adjust the signal from the sensor to facilitate use by the processing unit 124. For example, the sensor system 122 may perform a smoothing function, such as root mean square (RMS), to eliminate fluctuations or disturbances in the signals from the various sensors. In another example, the signal conditioning unit may be equipped with a low-pass filter and / or an amplifier to filter out high-frequency noise and amplify the signal accordingly from the signal.

[0096] The data captured by the sensor system 122 may be stored for processing by the processing unit 124 or another processor. In this regard, the data may be stored on a storage device of the data capture system 120 or an external storage device independent of the data capture system 120. The stored data may be retrieved from the storage device when needed.

[0097] In one example, the data capture system has a timing unit such as a hardware clock source that reports the time associated with each data point. The data points of the sensor are stored together with their corresponding time. In one example, the data is stored at a constant sampling rate, which means that the time between each data point is constant and can be known from the clock source. Therefore, the data is stored as a function of time (e.g., displacement (t), velocity (t), acceleration (t), force (t), torque (t)), and the time history of each sensed parameter can be used for further processing. Through further processing of the data, secondary parameters that are not directly measured are found. As an example, the frequency of displacement, velocity, and acceleration can be determined by the time history with these parameters. As another example, the velocity can be obtained by differentiating the displacement data with respect to time, the acceleration can be obtained as the second derivative of the displacement with respect to time, the velocity can be determined as the integral of the acceleration over time, and the displacement can be determined as the integral of the velocity over time. The sampling rate can be adjusted based on the frequency of the sensed parameter.

[0098] The sensor system 122 may include any of a variety of sensors to capture the desired parameters associated with the user input. The sensor system 122 is provided to accurately capture and record the dynamic motions and loads that the physician will use when manipulating the device proximally. In this regard, the primary measurements are force, torque and its rate of change, displacement, linear velocity and acceleration, rotational velocity and acceleration.

[0099] In one example, a sensor system including a force sensor and a mechanical fixture interfaced with an EMD can be used to achieve force measurement. The bottom of the force sensor is fixed to a substrate (ground). The mechanical fixture is attached to the force sensor to provide a friction interface with the EMD mounted on the top of the sensor for force measurement. The interface with the EMD may depend on the geometry of the EMD and the clinical case scenario that is expected to be captured. For example, the friction interface may include a spring-loaded friction clamp. The friction clamp is made of a material that allows the EMD to slide smoothly through the friction clamp. In order to prevent the buckling of the END, the END is supported in the lateral direction. As an example, in the design, two rows of locating pins can be used as guides for the EMD to provide support. The mechanical fixture used as an interface to the EMD is designed to apply an adjustable resistive load on the EMD when the operator manipulates the EMD, and sense and store load and motion parameters. The operator can adjust the resistive load to simulate different loads and motion scenarios that occur in actual vascular intervention situations such as non-manual manual surgery.

[0100] In one example, the measurement of torque can be achieved by using one or more modules to measure the torque on the EMD that can be twisted. Like the force measurement module, the torque measurement module includes an interface and a sensor. The sensor can directly measure the torque or convert the reaction force into torque. A torque sensor is provided to allow the EMD to rotate continuously when an adjustable torque resistance is applied to it, or to simulate the EMD with a certain compliance when the far end is fixed due to high torque resistance or being stuck by something. In another embodiment, the motor or actuator current can be used to calculate the load applied to the EMD.

[0101] File Generation As described above, use of the robotic medical system by one or more operators may be used to facilitate operation of the robotic medical system. In this regard, a processing unit 124 of the data capture system 120 is provided to process parameters captured by the sensor system 122 to facilitate future or further operation of the EMD. In one example, the data captured by the sensor system 122 is used to generate a profile and associate the profile with characteristics of the operator (physician metadata), and / or associate the profile with characteristics of the case (case metadata). Figure 4 As shown in , the profile along with its association with various parameters may be stored in the profile module 130. The profile may be used to facilitate the operation of various devices for training, simulation or live surgery via a training system, simulator or robotic medical system, respectively.

[0102] Figure 6 A method for generating archives and associating archives is illustrated in FIG. In exemplary method 300, parameters associated with user input are captured by sensor system 122, such as data capture system 120 (frame 310). The captured parameters may be associated with any one of a variety of inputs or input combinations. In one example, the parameters are associated with discrete user inputs, which may be any type of motion or load parameters. For example, the captured parameters may be associated with discrete linear velocity, linear force, rotational speed, or rotational torque. In a specific example, the captured parameters may be associated with each input in the speed of six degrees of space and the force / torque of six degrees of space. Therefore, sensor system 122 may divide the measurement results into different modules that may be positioned on a table. As in a clinical environment, a doctor may operate while standing by the table, with each sensor module located at the patient's position relative to the doctor. Sensor data may be collected at the proximal end of the EMD, where the EMD is being manipulated by an operator.

[0103] In another example, the captured parameters may be associated with various combinations of user inputs. In one particular example, the captured parameters are associated with a combination of linear speed and rotational speed (e.g., a drilling motion), a combination of linear force and rotational torque, a combination of linear speed and linear force, and / or a combination of rotational speed and rotational torque. When a combination of load and speed is captured, a new product parameter may be determined, such as a power parameter that is the product of load and speed. In various examples, the various parameters of the combination are measured simultaneously.

[0104] In yet another example, the captured parameters may be associated with various combinations of any number of user inputs. For example, the captured parameters may be associated with any combination of linear motion, linear load, rotational motion, and / or rotational load.

[0105] In one example, the data capture system 120 captures parameters from one EMD. In this case, one or more EMDs may be nested / assembled to represent the actual settings of the EMDs during an actual surgery, but the motion and load parameters are captured from a single EMD. In another example, more than one EMD is nested / assembled, and the sensor system 122 uses sensors to capture concurrent data from more than one EMD. As an example, the data capture system captures the relative motion (referred to as differential motion) of two or more EMDs and / or the relative loads of two or more EMDs, such as differential forces and torques.

[0106] Reference again Figure 6 In the exemplary method 300 of the present invention, the captured parameters are converted into at least one profile (block 320). In one example, the processing unit 124 may generate a profile based on the captured data associated with a single reference operator. In this regard, the profile may be based on a single or multiple surgeries performed by the reference operator. The profile may be updated or modified with each subsequent surgery performed by the reference operator. In this regard, the processing unit 124 may utilize an algorithmic analysis of inputs from one or more operators when forming the profile.

[0107] In other examples, the processing unit 124 may generate a profile based on captured data from multiple operators. In one example, the captured data associated with a reference operator may be combined with captured data associated with other operators. The processing unit 124 may generate a profile based on experience level or other characteristics by combining data associated with multiple operators using algorithmic analysis. In one example, the data from each operator may be weighted based on the characteristics of each operator. For example, an operator with a higher experience level may have a greater weight than another operator with a lower experience level. Weighting may also be used to generate a profile for a specific experience level. For example, a profile for n years of experience may be generated in the following manner, that is, making the weight of an operator with close to n years of experience greater than the weight of an operator with fewer years of experience. Therefore, in one example, separate profiles may be generated for experience levels of about 5 years, about 10 years, about 15 years, etc. For a profile corresponding to 15 years of experience, an operator with 10 years of experience may have a higher weight than an operator with 5 years of experience. Similarly, weighting may be applied to provide a profile associated with any one of a variety of operator characteristics. In one example, the profile is based on a combination of reference operator characteristics, patient characteristics, anatomical data, physiological data, intravascular device characteristics, procedure characteristics, technique characteristics, imaging data, and procedure results. The profile may be updated or generated by combining the data with additional data associated with other practitioners, procedures, or patients. In one example, the profile may be updated periodically or continuously (on an ongoing basis) with successive procedures.

[0108] In one example, the profile generated by the processing unit 124 is a power profile based on motion and load parameters associated with input from the operator. In one example, the profile may include power in six dimensions (three linear dimensions and three rotational dimensions) throughout the surgery. In this regard, the profile may be a continuous profile for each point in the surgery, or may include discrete points at various stages of the surgery. In one example, the profile generated by the processing unit 124 may be based on a heuristic model. The heuristic model may be based on data captured from one or more surgeries.

[0109] Reference again Figure 6In the exemplary method 300 of the present invention, the profile is associated with the characteristics of the operator (block 330). In one example, the profile is associated with metadata of the operator. For example, the captured data may be associated with the identity (e.g., name), age, experience level, or specialty of the operator. In other examples, the captured data may be associated with the surgery in which the data was captured. In this regard, the captured data may be associated with anatomical structures, patient characteristics, device specifications, type of surgery, techniques used, or surgical results. In other examples, the profile may be associated with metadata of the case of the surgery. For example, the case metadata may include anatomical structures, anatomical locations, patient characteristics, device types, device specifications, type of surgery, specific parts of the surgery, physician descriptions (e.g., name, age, number of cases per year, specialty, and experience), techniques used, or surgical results.

[0110] Figure 6 The exemplary method 300 can be implemented on a computer or another electronic device. In addition, the various steps of the exemplary method 300 can be implemented as instructions stored on a non-transitory computer-readable medium. These instructions can be executed by a processor of a computing system.

[0111] Adaptive Boot In the above example, the processing unit 124 uses the data captured by the sensor system 122 to generate a profile associated with the characteristics of the operator. In another example, the data captured by the sensor system 122 is used to generate guidance parameters, which can help the operator use the robot EMD for example for future surgery. For example, data captured from a reference operator or a group of operators can be used to generate guidance parameters associated with motion, load or power parameters, which are associated with user input. The guidance parameters can be converted into, for example, restrictions on any parameter of linear speed, linear force, rotational speed, rotational torque or a variety of other parameters. In another example, adaptive guidance can be completed by rules and relationships between more than one parameter. For example, the restriction on speed can be a function of the load acting on the EMD. In such an example, the maximum allowable speed can be reduced when the load is considered high to enhance the safety of the operation. In one example, the restrictions are consistently applied throughout the operation. In another example, the restrictions are variably applied throughout the operation. In addition, the guidance parameters can be based on any of a variety of factors and change, including but not limited to the position of the elongated medical device relative to the human body, the surgical environment, the age of the patient, the direction of movement of the EMD or the load level applied by the operator.

[0112] Figure 7An exemplary method associated with adaptive guidance is illustrated in FIG. According to exemplary method 400, captured parameters associated with user input are received for processing (block 410). As described above, the captured parameters may be associated with input from one or more practitioners and may be based on detection by a sensor system. The captured parameters may be stored in a memory device or transmitted to a processor, such as processing unit 124.

[0113] according to Figure 7 In the exemplary method 400 of the present invention, the captured parameters are used to generate adaptive guidance parameters for use with the robotic medical device (block 420). In one example, the processing unit 124 may generate guidance parameters that define an operating envelope associated with, for example, surgical characteristics, patient characteristics, or operator characteristics. For example, the guidance parameters may determine linear speed limits based on the experience level of the operator. In this regard, the guidance parameters may define tighter limits for less experienced operators and looser limits for more experienced operators. In other examples, the guidance parameters may determine limits based on the age of the patient. In this regard, the limits may be tighter for very young or very old patients.

[0114] Similarly, guidance parameters may depend on the stage in the surgery. In one example, adaptive guidance parameters provide a constant level of guidance throughout the surgery. For example, adaptive guidance parameters may provide constant limits on various inputs (e.g., force, torque, linear velocity, or rotational velocity) at each stage of the surgery. In other examples, these limits may vary throughout the surgery. For example, when approaching delicate anatomical structures, the limits on linear velocity may be more stringent, otherwise they may be relaxed.

[0115] The adaptive guidance parameters may be used to facilitate the operator's operation of the robotic medical device (block 430). In this regard, an alarm or other form of guidance may be provided to the operator during surgery based on the guidance parameters.

[0116] Additionally, in various examples, the operator may be provided with the option of accepting or overriding the constraints defined by the guidance parameters. One or more constraints (eg, limits) may be sufficiently critical to not allow the option of being overridden, while other constraints allow for operator discretion.

[0117] As mentioned above, in some examples, the guiding parameters may be reflected as restrictions. In other examples, the guiding parameters may be reflected as any one of operating rules, control equations, surgical suggestions, motion archives, rule-based motion and load values ​​or multiple other forms. The motion archives may include synchronous motion associated with input from an operator. Various archives may be based on a database associated with the operator's input, and may indicate a synchronous motion pattern associated with one or more EMDs from the operator's input.

[0118] In one example, the adaptive guidance parameters may be modified or updated based on additional data associated with other practitioners, surgeries, or patients. In one example, the adaptive guidance parameters may be updated periodically or continuously (on an ongoing basis) with successive surgeries. For example, restrictions on various operator inputs may be tightened or relaxed based on additional surgical data.

[0119] and Figure 6 As in the exemplary method 300, Figure 7 The exemplary method 400 can also be implemented on a computer or another electronic device. In addition, the various steps of the exemplary method 400 can be implemented as instructions stored on a non-transitory computer-readable medium. These instructions can be executed by a processor of a computing system.

[0120] Robotic system with data capture system Reference now Figure 5 , which illustrates a schematic diagram of an exemplary robotic medical system with an exemplary data capture system according to an embodiment. In this regard, although Figure 4 The system 100 is illustrated as being provided as a stand-alone system that can be coupled to a robotic EMD, but Figure 5 A robotic medical system 200 is illustrated in which a data capture system is implemented.

[0121] therefore, Figure 5 The robotic medical system 200 is provided with a data capture system 120 and an EMD interface 110. Similarly, the data capture system 120 includes a sensor system 122 and Figure 4 The processing unit 124 of the data capture system 120. In addition, the robotic medical system 200 is equipped with one or more EMDs, which are controlled by the robot drive 24. The robot drive 24 responds to commands from the input module 220.

[0122] In turn, the EMD interface 110 may respond to operator input received through the input module 220. The input module 220 may include a physical or tactile input device controlled by an operator. The operator input of the input module 220 may be converted into a mechanical or digital input to the EMD interface 110.

[0123] Figure 5 The exemplary robotic medical system 200 may be similar to the one described above with reference to Figure 1-3 The system 10 is described and may include a bedside unit and a control station. The input module 220 and a portion of the data capture system 120 may be disposed in the control station, while the one or more EMDs are disposed on the bedside unit.

[0124] In one example, the robot medical system 200 is provided with a single EMD. In other examples, the number of EMDs can be selected for a specific purpose or surgery. Multiple EMDs can be arranged in series, in parallel or in any other desired arrangement structure. In one example, using multiple EMDs arranged in series, user input can be applied to the first EMD in the series, and the command is relayed to the additional EMD located downstream by the first EMD. In another example, using multiple EMDs arranged in parallel, the user input from the operator is directly provided to each EMD. Of course, some examples may include multiple EMDs arranged in series and in parallel. In a system with multiple EMDs, the EMD interface 110 and the input module 220 allow the operator to operate multiple EMDs simultaneously. Similarly, the sensor system 122 can simultaneously detect and capture the motion and load parameters associated with the operator input applied to multiple EMDs by the robot system.

[0125] Figure 5 The robotic medical system 200 is provided with a data capture system 120 and an EMD interface 110 to perform the above-referenced Figure 4 The ability of archive generation and adaptive guidance described in the present invention. Of course, the generation of archives and the generation of adaptive guidance parameters can be performed in conjunction with training, simulation or live surgery. In addition, the generation of archives and the generation of adaptive guidance parameters can be performed as a batch function after capturing data during surgery. In some examples, the capture of data, the generation of archives and the generation of adaptive guidance parameters can be performed separately on the same robotic medical system 200 or different systems 200. In addition, the archives and adaptive guidance parameters generated based on the data captured on one robotic medical system 200 can be used to facilitate the operation of other robotic medical systems 200 and / or the operation of EMD in manual cases. In this regard, once the archives and / or adaptive guidance parameters are generated, they can be disseminated for use by operators of various other robotic medical systems 200 and / or operators of manual surgery.

[0126] As described above, the data capture system 120 of the robotic medical system 200 can be coupled to the control computing system 34 of the robotic medical system 200 to generate and / or update profiles and operating rules and restrictions. In other examples, the data capture system can be coupled to the training system 230 or simulator 240 to facilitate the training of various operators.

[0127] Reference now Figure 8 , which illustrates an exemplary data input arrangement and data utilization of a robotic medical system with an EMD according to an embodiment. The exemplary arrangement 500 illustrates the use of Figure 4 An exemplary data capture system 100 or Figure 5 The data flow of the robotic medical system 200. Figure 8 As shown in FIG, data from an experienced physician 510 may be obtained during live surgery via a measurement system 512 (e.g., Figure 5 The data may alternatively be collected during a training phase or during a simulation on a simulator / trainer 522. The captured data is collected, recorded, and processed 514. The captured data may be used to generate a physician profile 516. One or more physician profiles 516 may be used to generate a public profile. For example, as described above, a public profile may be generated for association with a particular experience level.

[0128] The newly captured profiles may be used to update the operating rules and limits 518. In this regard, the robotic medical system may use these profiles to teach or guide other operators or to limit various parameters of the robotic medical system.

[0129] like Figure 8 As shown in , a feedback loop can be provided, wherein the use of the robotic system can be used to collect, record or process additional data. The additional data can be used to continuously update the physician's profile.

[0130] In one example, a robotic medical system can be used to obtain limits on loads and motion parameters for an EMD that is manipulated by a robot. An EMD may be damaged during manipulation by an operator under a particular load, for example, due to buckling, kinking, or fracture. Appropriate ranges of load and motion parameters such as force, torque, velocity, acceleration, displacement, and combinations of these parameters depend on the mechanical properties of the EMD and the boundary conditions of the EMD, for example, how the EMD is supported. For an EMD manipulated by a robotic system, in addition to the mechanical properties of the EMD, appropriate ranges of load and motion parameters that avoid damage to the EMD also depend on the design and characteristics of the robotic drive system. In an exemplary embodiment, Figure 5 The robotic system 200 uses a data capture system to obtain the appropriate range of loads and motion parameters on the EMD while being manipulated by the robotic medical system. The appropriate range can be found during testing that may be destructive or non-destructive. The data capture system stores the captured data during such testing and uses the data when generating operating rules and restrictions for the robotic manipulation of the EMD. For such testing, the data capture system may use an EMD or an arrangement of two or more EMDs. The arrangement may involve serial or parallel manipulation of the EMD. In addition, the processing unit 130 may consider other factors, such as the constraints of the medical robotic system, to modify the operating rules and restrictions. For example, when there is a delay in the system, the processing unit 130 may reduce the maximum linear and rotational speeds of the EMD; for example, this is due to network delays associated with the remote input module.

[0131] According to an embodiment, the data capture system can simultaneously capture one or a combination of two or more of the linear and rotational motion parameters and force and torque parameters applied to the EMD. Such a data capture system can be independent, such as Figure 4 As shown in , or can be coupled to a robotic medical system, such as Figure 5 In one embodiment, the robot system uses a data capture system operating in two states. When the robot system is used to manipulate the EMD through the input module 220 (for example, during surgery or simulation), the data capture system operates in the first state. In this first state, the data capture system captures and stores the motion and load parameters that the robot system applies to the EMD. In the second state, the EMD is loaded into the robot system, but they are directly manipulated by the operator. In other words, the operator can apply mechanical input to the EMD when the EMD is engaged in the robot system equipped with the data capture system. In this second state, the robot system does not manipulate the EMD, but instead it applies an adjustable resistive load to the EMD to resist its movement. The operator can adjust the resistive load that the robot system applies to the EMD to create different load scenarios. Similar to the first state, when the user directly manipulates the EMD, the data capture system captures the load and motion parameters applied to the EMD. The robot system generates archives and operating rules and restrictions based on the data captured in state 1, state 2 or the combination of the data captured in the two states. Such a robotic system allows for customization of load and motion profiles and operating rules / limits based on operator mechanical inputs on the EMD without the need for an additional stand-alone data capture system.

[0132] As an example of such a robot system with two states as described above, in state 2, the EMD can be engaged in the device module 32 by the chuck. The chuck clamps the EMD so that the EMD does not move relative to the chuck. Alternatively, the entire device module 32 is allowed to move linearly with the chuck and the EMD in response to the force mechanically applied to the EMD by the operator. In addition, the chuck is allowed to rotate in response to the torque applied by the EMD. Although the linear and rotational motion of the EMD is allowed, the actuator will produce an adjustable resistive load to resist the movement of the EMD. The data capture system allows independent resistance and torque to be applied to the EMD. As an example, the current of the actuator can be adjusted to adjust the resistive load applied to the EMD by the device module 32. The load parameter can be determined by measuring the current of the actuator, because the load of the actuator is proportional to its current. As another example, a brake can be used on each actuator to generate an adjustable load on the EMD. As another example, the device module 32 does not move and only captures the load data applied to the EMD by the operator. In another example, a sensor can be used to measure the load parameter. A sensor for measuring torque is attached between the actuator for the rotational degree of freedom and the chuck that holds the EMD. A sensor for measuring force may be placed between the chuck and the device module 32 or between the device module 32 and the base of the sliding member for the linear degree of freedom of the EMD. As another example, the EMD has an embedded load sensor to measure load parameters.

[0133] Example Hardware Reference now Figure 9-11 , which illustrates various examples of hardware for use with the exemplary robotic medical system or data capture system described herein. Fig. 9 , which illustrates an exemplary actuator / sensor arrangement for use with various EMDs according to an embodiment. Fig. 9 The exemplary arrangement 600 shown in can be used to measure force and linear velocity using a single module and simultaneously. In addition, the exemplary arrangement 600 can be used to measure torque and rotational speed simultaneously.

[0134] Exemplary arrangement 600 is illustrated as having an EMD 610 passing therethrough. The EMD 610 is clamped with an adjustable friction clamp 620. The clamp 620 may include spring-loaded pads and / or tires that push against the EMD 610, which allow continuous movement of the EMD 610. Frictional resistance may be adjusted using, for example, a thumb screw or a motorized system with servo control. An optical sensor 630 is also used to measure motion parameters of the EMD.

[0135] The exemplary arrangement 600 also includes a torquer 640 for clamping the EMD. The operator uses the back side ( Fig. 9The EMD is manipulated by the optical sensor 630 (rightmost side of the torquer in FIG. 1 ). The torquer has one or more sensors 650 to measure the load (force and torque) applied to the EMD by the torquer. Data is captured simultaneously from the optical sensor 630 and the sensor 650.

[0136] Reference now Fig.10 , which illustrates an exemplary linear sensor system module for use with various EMDs according to an embodiment. An exemplary linear module 700 is illustrated with an EMD 710 passing therethrough. The exemplary linear module 700 includes a friction clamp 720. As described above, the friction clamp 720 allows for continuous movement of the EMD 710 through the linear module 700. The friction clamp 720 includes a spring 722 to provide a clamping force to the EMD 710. The clamping force can be adjusted using a thumb screw 724.

[0137] The exemplary linear module 700 includes an optical encoder 740 to measure linear displacement and / or linear velocity and / or acceleration. The optical encoder 740 is coupled to a pair of tires 730. The pair of tires 730 clamps the EMD using a torque spring. When the EMD moves linearly (advancing or withdrawing), the tire rotates accordingly, and the optical encoder 740 measures the rotational speed of the tire. Given the rotational speed of the tire and by knowing the diameter of the tire, the processing unit 124 of the data capture system 120 determines the linear velocity of the EMD. In addition, a force sensor 750 is provided to measure the linear force applied to the EMD 710.

[0138] Reference now Fig.11 , which illustrates an exemplary rotation sensor system module for use with various EMDs according to an embodiment. An exemplary rotation module 800 is illustrated as having an EMD 810 passing therethrough. The exemplary rotation module 800 includes a friction clamp 820 having a clamping plate that allows the EMD 810 to move continuously through the rotation module 800. The friction clamp 820 applies an adjustable torque on the EMD. The resistance torque applied to the EMD can be adjusted, for example, using a screw. A spring can be used in the friction clamp 820 to form an adjustable clamping system.

[0139] The exemplary rotation module 800 includes an encoder 840, such as an optical encoder, to measure rotational displacement, rotational velocity, and / or rotational acceleration. In addition, a torque sensor 830 is provided to measure the torque applied to the EMD 810. Torque and motion parameters are captured simultaneously from the encoder 840 and the torque sensor 830, which can be used to obtain the rotational power applied to the EMD.

[0140] Computer executable instructions for the steps of exemplary methods 300 and 400 may be stored on a form of computer readable media. Computer readable media include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer readable media include, but are not limited to, random access memory (RAM), read-only memory (ROM), electrically erasable programmable ROM (EEPROM), flash memory or other storage technology, compact disk ROM (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or may be used to store the desired instructions and may be accessed by system 10 ( Figure 1 any other medium accessible through the Internet or other computer network.

[0141] This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to make and use the invention. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal language of the claims. The order and sequence of any process or method steps may be changed or reordered according to alternative embodiments.

[0142] Numerous other changes and modifications may be made to the present invention without departing from the spirit of the invention. The scope of these and other variations will become apparent from the appended claims.

[0143] Item 1: A data capture system for generating a profile using capture parameters from a reference operator, comprising: a user interface that receives input from the reference operator for operation of one or more elongated medical devices (EMDs); a sensor system having sensors to capture parameters associated with the input from the reference operator; and a processing unit that uses the capture parameters to generate at least one profile associated with characteristics of the reference operator.

[0144] Item 2: A robotic medical system comprising: a module for independently and collaboratively actuating one or more EMDs; a user interface that receives input from a reference operator to manipulate the EMD; a sensor system having sensors to detect motion and / or load parameters applied to the EMD; a data capture portion that captures parameters detected by the sensors associated with the input from the reference operator, the captured parameters including at least one motion or load parameter, wherein the data capture portion associates the captured parameters with characteristics of the reference operator; and a processing unit that converts the detected parameters into operational control equations for the elongated medical device and surgery.

[0145] Item 3: A method comprising: capturing input parameters from a reference operator of a robotic device, the captured input parameters including at least one motion or load parameter; converting the captured input parameters into operation commands for the robotic device; and using the captured input parameters to generate a profile, the profile being associated with characteristics of the reference operator.

[0146] Item 4: A non-transitory computer-readable storage medium encoded with instructions executable by a processor of a computing system, the computer-readable storage medium comprising instructions for: capturing input parameters from a reference operator of a robotic device, the captured input parameters comprising at least one motion or load parameter; converting the captured input parameters into operation commands for the robotic device; and using the captured input parameters to generate a profile, the profile being associated with characteristics of the reference operator.

[0147] Item 5: A computer-implemented method comprising: capturing input parameters from a reference operator of a robotic device, the captured input parameters including at least one motion or load parameter; converting the captured input parameters into operation commands for the robotic device; and using the captured input parameters to generate a profile, the profile being associated with characteristics of the reference operator.

[0148] Item 6: A data capture system comprising: a user interface that receives input from a reference operator for operation of a slender medical device, the user interface including sensors to detect parameters associated with the input from the reference operator; a recording portion that captures parameters associated with the input from the reference operator detected by the sensor, the captured parameters including at least one motion or load parameter; and a processing unit that generates parameters for adaptive guidance of operation of the slender medical device based on the captured input parameters.

[0149] Item 7: A robotic medical system comprising: a user interface that receives input from a reference operator; a sensor system having sensors to detect parameters associated with the input from the reference operator; a data capture portion that captures parameters associated with the input from the reference operator detected by the sensors; a processing unit that converts the input from the operator into operational adaptive guidance for an elongated medical device (EMD) and surgery; and at least one module that independently and collaboratively actuates one or more EMDs.

[0150] Item 8: A method comprising: capturing input parameters from a reference operator of a slender medical device, the captured input parameters including at least one motion or load parameter; converting the captured input parameters into operation commands for the slender medical device; and generating guidance parameters for the slender medical device based on the captured input parameters.

[0151] Item 9: A non-transitory computer-readable storage medium encoded with instructions executable by a processor of a computing system, the computer-readable storage medium comprising instructions for: capturing input parameters from a reference operator of a robotic device, the captured input parameters comprising at least one motion or load parameter; converting the captured input parameters into operation commands for the robotic device; and generating guidance parameters for an elongated medical device based on the captured input parameters.

[0152] Item 10: A computer-implemented method comprising: capturing input parameters from a reference operator of a robotic device, the captured input parameters comprising at least one motion or load parameter; converting the captured input parameters into operation commands for the robotic device; and generating guidance parameters for an elongated medical device based on the captured input parameters.

[0153] Item 11: A data capture system for generating a profile using captured parameters from a reference operator, comprising: a user interface that receives input from a reference operator for operation of one or more elongated medical devices (EMDs); and a sensor system having sensors to capture parameters associated with the input from the reference operator; wherein the parameters detected by the sensors include at least one of: (a) a combination of linear velocity and linear force load; (b) a combination of rotational velocity and rotational torque; (c) a combination of displacement and / or velocity and / or acceleration with linear force; or (d) a combination of angular displacement and / or angular velocity and / or angular acceleration with torque.

[0154] Item 12: A data capture system for generating a profile using captured parameters from a reference operator, comprising: a user interface that receives input from a reference operator for operation of one or more elongated medical devices (EMDs); and a sensor system having sensors to capture parameters associated with the input from the reference operator; wherein the parameters detected by the sensors include a combination of two or more of motion parameters, load parameters, position, displacement, frequency, linear velocity, linear force, rotational velocity, or rotational torque.

[0155] Clause 13: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-12, wherein the parameter detected by the sensor includes at least one of a motion parameter or a load parameter.

[0156] Clause 14: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-13, wherein the motion parameters and the load parameters include at least one of displacement, linear velocity, linear force, rotational velocity, rotational torque, acceleration, or frequency.

[0157] Item 15: A data capture system, a robotic medical system, a method, a non-transitory computer-readable storage medium, or a computer-implemented method as described in any of Items 1-14, wherein the parameters detected by the sensor include at least one of: (a) a combination of linear velocity and linear force load; (b) a combination of rotational velocity and rotational torque; (c) a combination of displacement and / or velocity and / or acceleration with linear force; or (d) a combination of angular displacement and / or angular velocity and / or angular acceleration and torque.

[0158] Clause 16: The data capture system, the robotic medical system, the method, the non-transitory computer-readable storage medium, or the computer-implemented method of any of Clauses 1-15, wherein the parameter detected by the sensor comprises a manipulation frequency of the EMD.

[0159] Item 17: A data capture system, a robotic medical system, a method, a non-transitory computer-readable storage medium, or a computer-implemented method as described in any of Items 1-16, wherein the parameters detected by the sensor include a combination of two or more of motion parameters, load parameters, position, displacement, frequency, linear velocity, linear force, rotational velocity, or rotational torque.

[0160] Clause 18: A data capture system, a robotic medical system, a method, a non-transitory computer-readable storage medium, or a computer-implemented method as described in any of Clauses 1-17, wherein the data capture system is independent or part of another system such as a robotic medical system or a training system.

[0161] Clause 19: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-18, wherein the sensor system comprises contact and / or non-contact sensors to detect movement and / or load of the EMD or a stack of EMDs.

[0162] Clause 20: The data capture system, the robotic medical system, the method, the non-transitory computer-readable storage medium, or the computer-implemented method of any of Clauses 1-19, wherein the sensor system may include signal conditioning.

[0163] Clause 21: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-20, wherein the user interface comprises more than one EMD and the sensor system detects input parameters for concurrent operation of more than one EMD.

[0164] Clause 22: The data capture system, the robotic medical system, the method, the non-transitory computer-readable storage medium, or the computer-implemented method of any of Clauses 1-21, wherein the parameters are captured based on a heuristic model.

[0165] Clause 23: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-22, wherein the characteristics of the reference operator include at least one of physician metadata.

[0166] Clause 24: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-23, wherein at least a portion of the capture parameters are associated with case metadata.

[0167] Clause 25: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-24, wherein at least a portion of the capture parameters is a combination of physician metadata and case metadata.

[0168] Clause 26: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-25, wherein recording and retrieval of data can be local or non-local to the system.

[0169] Clause 27: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-26, wherein the processing unit utilizes an algorithmic analysis of inputs from one or more operators when forming the at least one profile.

[0170] Clause 28: The data capture system, the robotic medical system, the method, the non-transitory computer-readable storage medium, or the computer-implemented method of any of Clauses 1-27, wherein the processing unit generates a power profile associated with the at least one profile comprising motion and load parameters.

[0171] Clause 29: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-28, wherein the processing unit calculates and determines an envelope of a range of motion, load, and power parameters.

[0172] Item 30: A data capture system, a robotic medical system, a method, a non-transitory computer-readable storage medium, or a computer-implemented method as described in any of Items 1-29, wherein the processing unit generates adaptive guidance parameters for manipulating the EMD based on motion and load parameters contained in the at least one archive.

[0173] Clause 31: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-30, wherein the processing unit generates a motion profile and / or load profile associated with one or more EMDs.

[0174] Item 32: A data capture system, a robotic medical system, a method, a non-transitory computer-readable storage medium, or a computer-implemented method as described in Item 31, wherein the motion profile is constructed solely based on the motion parameters of at least one profile for an EMD, including simultaneous rotational and linear motion of the EMD.

[0175] Item 33: A data capture system, a robotic medical system, a method, a non-transitory computer-readable storage medium, or a computer-implemented method as described in Item 31, wherein the motion profile is constructed based on the motion parameters of at least one profile for more than one EMD, including rotational and / or linear motion of a first EMD and rotational and / or linear motion of a second EMD occurring simultaneously.

[0176] Clause 34: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of clause 31, wherein the motion profile is constructed based on load parameters of the at least one profile for more than one EMD.

[0177] Clause 35: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of clause 31, wherein the motion profile is constructed based on both motion and load parameters of at least one profile for more than one EMD.

[0178] Clause 36: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-35, wherein the processing unit generates a master profile by combining physician metadata and case metadata.

[0179] Clause 37: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-36, wherein the processing unit combines the capture parameters from the reference operator with additional capture parameters from additional operators to generate an aggregated profile.

[0180] Clause 38: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-37, wherein the at least one archive generated by the processing unit is updated with additional captured data from additional additional operators.

[0181] Clause 39: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of any of Clauses 1-38, wherein the processing unit updates the archive when new input data is available following ongoing consecutive surgeries.

[0182] Item 40: A data capture system, a robotic medical system, a method, a non-transitory computer-readable storage medium, or a computer-implemented method as described in any of items 1-39, wherein the processing unit converts input from the reference operator in combination with other metadata into operational control equations, operational constraints, and commands.

[0183] Clause 41: A data capture system, a robotic medical system, a method, a non-transitory computer-readable storage medium, or a computer-implemented method as described in any of Clauses 1-40, wherein the processing unit is capable of generating or updating the at least one profile and converting the data into operational rules offline or in real time.

[0184] Clause 42: The data capture system, the robotic medical system, the method, the non-transitory computer-readable storage medium, or the computer-implemented method of any of Clauses 1-41, wherein the processing unit provides feedback to the second operator based on the generated profile.

[0185] Clause 43: The data capture system, robotic medical system, method, non-transitory computer-readable storage medium, or computer-implemented method of clause 42, wherein the feedback is provided during a training simulation.

[0186] Clause 44: The data capture system, the robotic medical system, the method, the non-transitory computer-readable storage medium, or the computer-implemented method of clause 42, wherein the feedback is provided during a live procedure performed by the second operator.

[0187] Clause 45: The data capture system, the robotic medical system, the method, the non-transitory computer-readable storage medium, or the computer-implemented method of Clause 42, wherein the second operator is capable of selectively accepting or rejecting the feedback.

[0188] Clause 46: The data capture system, the robotic medical system, the method, the non-transitory computer-readable storage medium, or the computer-implemented method of any of Clauses 1-45, wherein the processing unit generates adaptive guidance parameters.

[0189] Item 47: A data capture system, a robotic medical system, a method, a non-transitory computer-readable storage medium, or a computer-implemented method as described in Item 46, wherein the adaptive guidance parameters include at least one of operational control equations or constraints applied to the EMD or surgery, surgical recommendations, motion profiles, or general rule-based motions and loads.

Claims

1. A system for operating adaptive guidance of one or more elongated medical devices, the system comprising: a processing unit configured to cause the system to provide feedback to an operator during a simulated or live procedure utilizing one or more first elongated medical devices and performed by the operator, wherein The feedback comprises adaptive guidance for operation of the one or more first elongated medical devices during the simulated or live surgery, The feedback is based on at least one profile, and The at least one profile is based on input from a reference operator for operation of one or more second elongated medical devices.

2. The system according to claim 1, further comprising: A user interface is configured to receive the input from the reference operator for operation of the one or more second elongated medical devices.

3. The system according to claim 1, further comprising: a sensor system configured to capture parameters associated with said input from said reference operator; And among them, The processing unit is configured to generate the at least one profile based on the parameters.

4. The system according to claim 3, wherein: The parameters include motion parameters and / or load parameters.

5. The system according to claim 3 or 4, wherein: The processing unit is configured to combine the parameters with additional captured parameters from additional reference operators to generate one or more aggregated profiles.

6. The system according to claim 3, wherein: The parameter includes at least one of displacement, linear velocity, linear force, rotational speed, rotational torque, acceleration or frequency.

7. The system according to claim 3, wherein: The parameters captured by the sensor system include at least one of the following: The combination of linear speed and linear force load, The combination of rotational speed and rotational torque, a combination of at least one of displacement, velocity or acceleration and linear force, or A combination of at least one of angular displacement, angular velocity, angular acceleration, or rotational torque.

8. The system according to claim 3, wherein: The parameters captured by the sensor system include a manipulation frequency of the one or more second elongated medical devices.

9. The system according to claim 3, wherein: The parameters captured by the sensor system include a combination of two or more of a motion parameter, a load parameter, position, displacement, frequency, linear velocity, linear force, rotational speed, or rotational torque.

10. The system according to claim 3, wherein: The sensor system includes at least one of a contact or non-contact sensor to detect at least one of a movement or a load of the one or more second elongated medical devices.

11. The system according to claim 10, wherein: The one or more second elongated medical devices comprise a stack of elongated medical devices.

12. The system of claim 3, further comprising: a user interface configured to receive said input from said reference operator for operation of a plurality of second elongated medical devices, and wherein, The sensor system is configured to detect an input parameter for concurrent operation of the plurality of second elongated medical devices.

13. The system according to claim 3, wherein: The sensor system is configured to capture the parameters based on a heuristic model.

14. The system of claim 1, wherein: The at least one profile is associated with at least one characteristic of the reference operator, and The at least one characteristic of the reference operator includes physician metadata and / or case metadata.

15. The system of claim 14, wherein: The doctor metadata includes characteristics of the doctor who is the reference operator.

16. The system of claim 1, wherein: The processing unit is configured to utilize an algorithmic analysis of input from at least the reference operator in generating the at least one dossier.

17. The system of claim 1, wherein: The at least one profile comprises a power profile.

18. The system of claim 1, wherein: The processing unit is configured to generate adaptive guidance parameters for providing the adaptive guidance based on the at least one profile.

19. The system of claim 18, wherein: The adaptive guidance parameters include at least one of operating control equations or constraints, surgical recommendations, motion profiles, or general rule-based motions and loads for operation of the one or more first elongated medical devices.

20. The system of claim 18, wherein: The at least one profile comprises motion parameters and / or load parameters, and The processing unit is configured to generate the adaptive guidance parameters based on the motion parameters and / or load parameters.

21. The system of claim 1, wherein: The processing unit is configured to update the at least one profile with captured data from other reference operators.

22. The system of claim 1, wherein: The processing unit is configured to update the at least one profile when input data becomes available following consecutive surgeries that are ongoing.

23. The system of claim 1, wherein: The processing unit is configured to: generating or updating the at least one profile, and The data of the at least one archive is converted into operational rules offline or in real time.

24. The system of claim 1, wherein: The operator selectively accepts or rejects the feedback.

Images