4596results about "Surgical systems user interface" patented technology

A surgical visualization system for use with a robotic surgical system that includes a surgical tool movable with respect to a tissue of a patient in response to an instrument motion control signal is disclosed. The surgical visualization system includes a camera and a control circuit coupled to the camera. The control circuit is configured to determine a distance between the surgical tool and the tissue and adjust a magnification of the camera based on the distance between the surgical tool and the tissue.

One or more data streams may be used for controlling multi-system interaction. For example, a data stream may be received, and a surgical option associated with a surgical instrument may be selected based on the data stream. A control signal associated with the surgical instrument may be generated based on the selected surgical option. A surgical device may receive an external data stream from a source external to the surgical system. The device may derive, based at least on the external data stream, decision contextual information. The device may select a surgical option associated with a surgical instrument based on the decision context information. The device may generate a visual indication of the decision context information associated with selecting the surgical option. The device may generate a control signal associated with the surgical instrument based on the selected surgical option.

A modular surgical system for use in a surgical procedure is disclosed. The modular surgical system includes a control module including a power supply and surgical modules including a first surgical module and a second surgical module. The first surgical module is arranged in a stack configuration with the control module and the second surgical module. The power supply is configured to output power to the first surgical module and the second surgical module. A power backplane is configured to deliver the power to the first surgical module and the second surgical module through the first surgical module. A control circuit is configured to adaptively adjust power allocations to the first surgical module and the second surgical module.

Systems, methods, and instrumentalities are disclosed for displaying a magnitude and location of a resulting tissue tension from an applied force to an instrument and a resulting tissue reaction. A surgical stapling device for monitoring and adapting to tissue tension during a surgical stapling procedure may measure strain on at least one component of the surgical stapling device resultant from one or more of an opposed force applied by a user and a force resisted by tissue associated with the tissue tension. The device may determine a location of the tissue tension based on historical surgical data, the opposed force, and the resisted force. The device may highlight the location of the tissue tension to aid in real-time surgical decision-making.

A system comprises a processor and a memory having computer readable instructions stored thereon, which, when executed by the processor, cause the system to display an image of a surgical environment. The image includes an information icon corresponding to an instrument in the surgical environment. The instructions further cause the system to display an image of a body part of a user. The image of the body part is used to interact with the information icon. The instructions further cause the system to receive a gesture of the body part, via a gesture-based input device registering movement of the body part, to cause the image of the body part to interact with the information icon. The instructions further cause the system to display an information menu in the image of the surgical environment based on the interaction between the image of the body part and the information icon.

A robotic surgical system includes a surgeon consol coupled to a patient console and coupled to one or more surgical instruments. The surgeon consol is used by a surgeon to perform a surgical procedure. A surgeon computer is coupled to or at the surgeon console. The surgeon consol is coupled to the one or more surgical instruments. A surgical robot is coupled to a robotic surgery control system and a feedback loop. The robotic surgery control system includes or is coupled to an artificial intelligence (AI) system. The feedback loop receives data from one or more sensors at the robotic surgical system. The data is analyzed by the robotic surgery control system, and in response operation of the robotic surgical system is adjusted as needed. The surgical control system or the AI system uses intraoperative data describing a surgical procedure being performed. The feedback loop receives data from one or more sensors of the robotic surgical system regarding performance of at least a portion of the robotic surgical system. The data is analyzed by the robotic surgical control system. In response to analysis, operation of the robotic surgical system is adjusted as needed. The robotic surgical control system or AI system extracts one or more programmed steps used by the surgeon for positioning at least one of the surgical instruments during the surgical procedure.

A system, apparatus and method directed to placing a medical instrument in a patient body, where the system includes the medical instrument having a first optical fiber, a console and an interconnect having a second optical fiber to receive incident light from the console and propagate the incident light to the medical instrument. The interconnect includes a predetermined bend along its length, such that logic of the console may determine a positioning and an orientation of the medical instrument relative to the predetermined bend. Additionally, the logic may generate a display of the medical instrument based on the reflected light signals and the determination of the positioning and the orientation of the medical instrument relative to the predetermined bend, where the display may be rendered as an overlay on an ultrasound image.

Co-manipulation robotic systems are described herein that may be used for assisting with laparoscopic surgical procedures. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical instruments while providing benefits associated with surgical robotics. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument or a desired force applied by the instrument using the robot arm. For example, the robot arm may be moved automatically to maintain a constant tension force on an anatomical structure via the instrument in a constant tension mode.

A robotic surgical system includes a robotic manipulator configured to perform surgical procedures under direct surgeon control. A surgical camera system captures real-time intraoperative video. An external imaging interface receives multimodal imaging data, including preoperative and intraoperative data from at least one of magnetic resonance imaging (MRI), computed tomography (CT), ultrasound, and fluoroscopy. An artificial intelligence (AI module has a trained neural network and a deep learning model trained on multi-institutional annotated surgical datasets, The AI module is configured to execute one or more of: fuse acquired video and imaging data into temporally and spatially coherent anatomical visualizations; generate continuously updating overlays aligned with the surgical field, with segmented anatomical features; projected tissue boundaries, proximity indicators for instruments, and predictive deformation trends; provide dynamic predictive trend visualization indicating zones of future anatomical complexity or risk; register and align preoperative imaging data with intraoperative imaging data in real time; adapt overlay presentation in response to tissue deformation without actuating the robotic manipulate or; and passively augment visual feedback without initiating any autonomous actuation of surgical instruments.

An apparatus, system, and method are disclosed for remediating a condition present in a patient's foot. In some implementations, a resection guide includes a bone engagement feature configured to engage at least a portion of at least one foot bone to position the resection guide. The bone engagement feature may be least partially determined based on a model of the patient's foot, which is defined based on medical imaging of the patient's foot. The resection guide further includes a resection feature that extends through the resection guide from a superior side of the resection guide to an inferior side. The resection feature is configured to guide a cutting tool to form a first osteotomy in a first bone along a first trajectory. Additionally, the resection guide includes a first bone attachment feature configured to engage the first bone and a second bone attachment feature configured to engage a second bone.

A system comprises an EMD and coupled to a robotic drive. The EMD includes an external member defining a lumen and an internal member disposed in the lumen and coupled to a distal portion of the external member, and a linearly and rotationally-actuatable element coupled to the external member. The robotic drive includes a plurality of device modules, each of the plurality of device modules being independently linearly movable by the robotic drive, a first cassette coupled to a first one of the plurality of device modules and to the linearly and rotationally-actuatable element of the external member, and a second cassette coupled to a second one of the plurality of device modules and to the internal member.

A medical device-placing system includes an ultrasound probe, a medical-device detector, a console, and an alternative-reality headset. The ultrasound probe is configured to emit ultrasound signals into a patient's limb and receive echoed ultrasound signals from the patient's limb. The medical-device detector is configured for placement about the patient's limb. The console is configured to transform the echoed ultrasound signals to produce ultrasound-image segments corresponding to anatomical structures of the patient's limb, as well as transform magnetic-sensor signals from the medical-device detector into location information for a magnetized medical device within the patient's limb. The alternative-reality headset includes a display screen through which a wearer of the alternative-reality headset can see the patient's limb. The display screen is configured to display over the patient's limb a virtual medical device per the location information for the medical device within objects of virtual anatomy corresponding to the ultrasound-image segments.

Systems and methods are disclosed for creating an interactive tool for determining and displaying a functional relationship between a vascular network and an associated perfused tissue. One method includes receiving a patient-specific vascular model of a patient's anatomy, including at least one vessel of the patient; receiving a patient-specific tissue model, including a tissue region associated with the at least one vessel of the patient; receiving a selected area of the vascular model or a selected area of the tissue model; and generating a display of a region of the tissue model corresponding to the selected area of the vascular model or a display of a portion of the vascular model corresponding to the selected area of the tissue model, respectively.

Co-manipulation robotic systems are described herein that may be used for assisting with laparoscopic surgical procedures. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.

A surgical planning and assessment system is disclosed. The system may include a computing system having a processor, a data store, and a patient specific planning and analysis module. The system may be configured to store a patient specific target plan including a digital representation of a spinal rod having a target geometry and transform the digital representation into a curved line. The system may generate a spline data set comprising a plurality of spline segments that are sequentially linked to one another. The system may adjust, iteratively, each spline segment until the plurality of spline segments approximate the curved line. The system may generate a digital file comprising drawings for manufacturing a spinal rod based on the plurality of spline segments. In various embodiments, each spline segment may be defined by a corresponding arc or a corresponding line extending between a corresponding starting point and a corresponding ending point.

A robotic arm system for surgery is described. The method includes: processing circuitry configured to: apply a virtual barrier preventing a human controlled surgical device from entering an area within a surgical scene; and release the virtual barrier in response to a gesture.

The invention relates to the field of cardiology department operations through vascular intervention, and discloses an interventional operation navigation system based on multi-modal image fusion, which comprises a preoperative three-dimensional reconstruction and planning module, which is mainly used for generating a three-dimensional model of a heart through preoperative image data, and planning the position and section of an intraoperative ICE ultrasonic probe based on the model, the intraoperative multi-modal fusion navigation module is mainly used for fusing a three-dimensional model generated before an operation with an intraoperative real-time image and providing accurate navigation support for a doctor; and the dynamic feedback optimization module is mainly used for updating a dynamic track in real time and performing safety protection. According to the invention, through the preoperative three-dimensional reconstruction and virtual path planning module, in combination with the improved 3D U-Net network and the high-precision segmentation algorithm, a three-dimensional model containing key anatomical markers is generated, 20 groups of ICE probe alternative paths are planned, seamless connection of preoperative three-dimensional anatomical information and intraoperative real-time images is realized, doctors can quickly call pre-planned paths, and the accuracy of the ICE probe anatomy is improved. Adjusting time during operation is shortened, and operation efficiency is improved.

A method for generating and updating a three-dimensional representation of a surgical site based on imaging data from an imaging system is disclosed. The method comprises the steps of generating a first image of the surgical site based on structured electromagnetic radiation emitted from the imaging system, receiving a second image of the surgical site, aligning the first image and the second image, generating a three-dimensional representation of the surgical site based on the first image and the second image as aligned, displaying the three-dimensional representation on a display screen, receiving a user selection to manipulate the three-dimensional representation, and updating the three-dimensional representation as displayed on the display screen from a first state to a second state according to the received user selection.

A system includes a uterine manipulator having a shaft. The uterine manipulator is coupled with the robotic arm. An imaging instrument is operable to provide an image of an exterior of the uterus of the patient. A console includes a display screen and is configured to provide a view from the imaging instrument of the exterior of the uterus of the patient, on the display screen. The console is further configured to provide an indicator on the view from the imaging instrument, on the display screen, the indicator indicating a location of a predefined anatomical structure, the indicator being provided as an overlay on the predefined anatomical structure.

Various embodiments of the present disclosure can include a high-density electrode catheter. In some embodiments, the high-density electrode catheter can include a catheter shaft including a proximal end and a distal end, the catheter shaft defining a catheter shaft longitudinal axis. In some embodiments, the high-density electrode catheter can include a shaft magnetic position sensor disposed along a distal portion of the catheter shaft. In some embodiments, the high-density electrode catheter can include a flexible tip portion located adjacent to the distal end of the catheter shaft, wherein the flexible tip portion includes a flexible framework. In some embodiments, the high-density electrode catheter can include a plurality of electrodes disposed on the flexible framework. In some embodiments, the high-density electrode catheter can include a tip magnetic position sensor disposed on a portion of the flexible framework.

The invention provides a surgical process monitoring method and system based on machine vision, and the method comprises the steps: firstly obtaining a surgical scene real-time image sequence containing the dynamic images of a surgical instrument operation region and a biological tissue region; secondly, extracting a surgical instrument identification result (including an instrument type and a space posture) and a biological tissue segmentation result (including a tissue type and a region boundary), then monitoring an instrument operation track and a biological tissue region deformation parameter based on the results, generating a dynamic operation state parameter, and according to a predefined surgical stage safety threshold value, determining a biological tissue region deformation parameter; multi-modal anomaly detection is carried out on the dynamic operation state parameters, an abnormal event type and a risk level are determined, finally, a visual operation monitoring report is generated according to the abnormal event type and the risk level, the report covers abnormal area marks, risk prompt information and correction suggestions, comprehensive intelligent monitoring of the operation process is achieved, and the operation safety and the success rate are improved in an auxiliary mode.

Co-manipulation robotic systems are described herein that may be used for assisting with surgical procedures, including laparoscopic surgery. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.

Co-manipulation robotic systems are described herein that may be used for assisting with surgical procedures, including laparoscopic surgery. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.

Apparatus and methods are described including tracking a tool portion and a patient marker from a first line of sight, using a first tracking device disposed upon a first head-mounted device that includes a display. The tool portion and the patient marker are tracked from a second line of sight, using a second tracking device. When a portion of the patient marker and the tool portion are both within the first line of sight, an augmented reality image is generated upon the first display based upon data received from the first tracking device and without using data from the second tracking device. When at least the patient marker portion and the tool portion are not both within the first line of sight, a virtual image of the tool and anatomy of the patient is generated using data received from the second tracking device. Other applications are also described.

Methods and system for atrial fibrillation ablations and other cardiac procedures utilizes a cardiac mapping system for navigation and guidance, and includes an additional virtual reality (VR) system and an augmented reality (AR) or mixed reality (MR) system. The Cardiac mapping system utilizes medical images and patient's electrical signals. The virtual reality (VR) system is utilized pre-procedure for visualization and pre-procedure planning. The augmented reality (AR) or mixed reality (MR) system is utilized pre-procedure or intra-procedure. Methods and system are disclosed utilizing pre-built virtual device models which interact with 3D volume rendered structures from patient's CT or MRI of the region of interest (ROI) for the different type of cardiac procedure. With virtual reality (VR) the operator utilizes hand-held sensors. With augmented reality (AR) or mixed reality (MR) a combination of hand gestures and an X-box controller is used to manipulate virtual devices, anatomical structures in the Hologram.

Systems and methods for autonomous robotic surgery are provided to control a movement of a robotic device so as to perform a surgical procedural step, wherein controlling of the movement is based on information including a spatial position and orientation of at least a part of the robotic device. A trigger information may cause the system to pause or stop the surgical procedural step and cause the system to receive a projection image. Further, the projection image may be processed so as to determine a spatial position and orientation of at least the part of the object or of the robotic device.

Systems and methods for automatically populating a post-operative report of a surgical procedure are disclosed. A system may include at least one processor configured to implement a method including receiving an identifier of a patient, an identifier of a healthcare provider, and surgical footage of a surgical procedure performed on the patient. The method may include analyzing frames of the surgical footage to identify phases of the surgical procedure based on interactions between medical instruments and biological structures and, based on the interactions, associate a name with each phase. The method may include determining a beginning of each phase and associating a time marker with the beginning of each phase. The method may include populating a post-operative report with the patient identifier, the names of the phases, and time markers associated with the phases in a manner that enables the health care provider to alter the post-operative report.

A system and method for using augmented reality device for use during a surgical procedure are described. A system may include an augmented reality device to present a virtual indication, such as a virtual indication of a surgical instrument, a force vector, a direction, or the like. The augmented reality device may present a virtual aspect of a procedure, such as a virtual animation of a step of a procedure. The augmented reality device may present a virtual object, indication, aspect, etc., within a surgical field while permitting the surgical field or aspects of the surgical field to be viewed through the augmented reality display (e.g., presenting virtual objects mixed with real objects).

Systems and methods for enhanced user interface and crosstalk analysis for cardiac index determination. An example method includes accessing a cardiac model of a portion of a patient's heart, the portion including one or more vessels of the patient's heart, and the cardiac model indicating a plurality of lesions along a length of at least one of the vessels; obtaining, based on the cardiac model for the lesions, respective positions along the length for which the lesions are associated with index drops, wherein the index drops are with respect to an index indicative of vascular function; and causing presentation of a user interface, wherein the user interface: presents a graph mapping the length to the index indicative of vascular function, presents individual toggles enabling nulling of individual lesions, and updates the graph in response to received user input to one or more of the toggles, wherein the user input nulls effects of one or more lesions.