Laparoscopic Endoscope Control via Instrument Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current laparoscopic surgery interfaces, such as those using head-mounted sensors or voice-operated systems, provide limited feedback and require cumbersome serial operations, diverting the surgeon's attention from the primary task and failing to indicate which instrument they are focused on, thus necessitating an improved interface for better control and communication between the surgeon and the endoscope system.

Innovation Solution

A surgical controlling system that includes a surgical tool, a location estimating means, a movement detection means, and a controller with a database to determine allowed and restricted movements based on predefined rules, allowing the system to control the spatial position of the tool in real-time, alerting the physician of restricted movements, and maintaining a constant field of view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If head-mounted sensors or voice-operated interfaces are used to control the endoscope, then the surgeon can control the endoscope position, but the surgeon's attention is diverted from the primary surgical task

Engineering Contradiction:
Improveendoscope control capabilityVSAvoidsurgeon attention focus
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system automatically tracks and follows the surgical instrument without requiring surgeon input. The endoscope autonomously adjusts its position to maintain optimal viewing angles, eliminating the need for surgeon interaction with control interfaces and thereby preserving surgeon attention on the surgical task.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual or voice-based control interfaces with an automated optical tracking system. Sensors detect the position and orientation of surgical instruments, and this data is processed to automatically control endoscope movement, substituting mechanical/voice interfaces with an automated sensing and control system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If automated assistants with directional interfaces are used to shift camera view, then the endoscope position can be adjusted, but the interface provides limited feedback to the surgeon

Engineering Contradiction:
Improvecamera view adjustment capabilityVSAvoidfeedback to surgeon
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system continuously provides visual feedback to the surgeon by displaying the real-time position of the surgical instrument and the corresponding endoscope view. This closed-loop feedback ensures the surgeon can see both the instrument location and the resulting camera perspective, eliminating information loss and improving situational awareness.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If conventional manual control by human assistants is used, then the endoscope can be repositioned, but it is difficult to hold the endoscope steady and keep the scene upright

Engineering Contradiction:
Improveendoscope repositioning capabilityVSAvoidimage stability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The endoscope system autonomously stabilizes the image by automatically adjusting its position in response to detected instrument movement. The system continuously calculates the optimal endoscope position to maintain a stable, upright view without requiring human assistant intervention, thereby improving image stability and reliability.

Inventive Principle:
Principle #25Self-service

4Extent of automation

If existing automated systems are used, then the endoscope can be controlled, but they do not allow the surgeon to signal which instrument their attention is focused on

Engineering Contradiction:
Improveendoscope control automationVSAvoidinstrument focus indication
Core Design Contradiction:
Extent of automationVSLoss of information

Solution Approach 1:

The system automatically detects which surgical instrument is being actively manipulated and uses this information to control endoscope positioning. The system provides feedback by automatically directing the camera view toward the active instrument, eliminating the need for separate signaling mechanisms and maintaining complete information flow.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10052157B2Device and method for assisting laparoscopic surgery—rule based approach
Publication Date: 2018.08.21 ASENSUS SURGICAL EUROPE S.À.R L
  • US10052157B2 patent drawing
  • US10052157B2 patent drawing
  • US10052157B2 patent drawing

AI summary

A surgical controlling system comprising: at least one location estimating means to real-time locate the 3D spatial position of at least one surgical tool, at least one movement detection means in communication with a movement database and with the location estimating means and a controller, which controls the position of at least one surgical tool, in communication with a movement database, a control database and the movement detection means. The movement database stores the 3D spatial position of each surgical tool at the present time and at at least one previous time; a tool has moved if its present position is different from its previous position. The control database stores rules to identify a movement of a tool as either an allowed movement or a restricted movement. Examples of rules include a maximum speed rule, a virtual zoom rule, a virtual rotation of scene rule, and position of tool rule.