Rule-Based Laparoscopic Tool Tracking for Endoscope Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current laparoscopic surgery interfaces, such as those using head-mounted sensors or voice-operated systems, provide limited feedback and require constant attention from surgeons, diverting focus from the primary surgical task and failing to indicate which instrument the surgeon's attention is focused on, leading to inefficiencies and potential errors.

Innovation Solution

A surgical controlling system that includes a surgical tool, location estimating means, movement detection means, and a controller with a database that determines allowed and restricted movements based on predefined rules, such as route, environmental, and operator input rules, to manage the spatial positioning of surgical tools and endoscopes during procedures, preventing restricted movements and alerting surgeons to potential issues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If automated assistants with directional interfaces (head-mounted sensors, voice-operated systems) are used to control endoscope movement, then the endoscope can be repositioned to provide optimal surgical views, but the surgeon's focus is diverted from the primary surgical task and feedback is limited

Engineering Contradiction:
Improveendoscope repositioning controlVSAvoidsurgeon focus and feedback
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system automatically tracks and follows the surgical instrument without requiring continuous surgeon input. The automated assistant monitors instrument position and autonomously adjusts endoscope positioning to maintain optimal viewing angles, allowing the surgeon to concentrate on the surgical task while the system serves itself

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system provides visual feedback by displaying the surgical scene on a monitor, allowing the surgeon to see instrument positions and endoscope views simultaneously. This feedback mechanism eliminates the need for the surgeon to divert attention to control the endoscope, as all information is presented visually in the surgical field

Inventive Principle:
Principle #23Feedback

2Loss of information

If manual control by human assistants is used to shift endoscope placement, then the surgeon can maintain focus on the surgical task, but the assistant cannot hold the endoscope steady and keep the scene upright

Engineering Contradiction:
Improvesurgeon focusVSAvoidendoscope stability
Core Design Contradiction:
Loss of informationVSStability of the object's composition

Solution Approach 1:

The system replaces manual mechanical control by human assistants with an automated robotic assistant that uses sensors and computer control to position and stabilize the endoscope. This substitution provides precise, stable control while maintaining surgeon focus on the surgical task

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The automated assistant continuously monitors instrument position and autonomously adjusts endoscope positioning to maintain optimal viewing angles and scene stability without requiring surgeon intervention, allowing the system to stabilize itself

Inventive Principle:
Principle #25Self-service

3Ease of operation

If conventional directional interfaces are used for automated assistant control, then endoscope movement can be directed, but the operation requires constant surgeon attention and prevents maintaining surgical flow

Engineering Contradiction:
Improveendoscope direction controlVSAvoidsurgical flow
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system automatically tracks the surgical instrument and adjusts the endoscope position without requiring surgeon input. The automated assistant monitors instrument location and autonomously repositions the endoscope to maintain optimal views, eliminating the need for constant surgeon attention and maintaining surgical flow

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system provides continuous automated tracking and adjustment of the endoscope throughout the surgical procedure. The useful action of endoscope positioning continues automatically without interruption or surgeon intervention, maintaining continuous surgical flow and productivity

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11957301B2Device and method for assisting laparoscopic surgery—rule based approach
Publication Date: 2024.04.16 ASENSUS SURGICAL EUROPE S.À.R L
  • US11957301B2 patent drawing
  • US11957301B2 patent drawing
  • US11957301B2 patent drawing

AI summary

Methods of assisting an operator to perform a surgical procedure include inserting at least one surgical tool into a surgical environment of a human body. The 3D spatial position of the surgical tool within the surgical environment is estimated in real time, and movement of the surgical tool is detected. The spatial position of the surgical tool within the surgical environment is controlled using a controller, including by determining using image processing whether each of the detected movements is an ALLOWED movement or a RESTRICTED movement based on a predetermined rule stored in a database in communication with the controller.