Robotic Surgical Virtual Control Panel for Intuitive Tool Actuation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Minimally invasive surgical instruments lack intuitiveness, dexterity, and sensitivity, making it difficult for surgeons to control surgical instruments accurately and intuitively, especially in telesurgery systems.

Innovation Solution

A surgical system that displays a modified image of the surgical environment with a virtual control panel associated with the surgical instrument, allowing surgeons to interact with control elements to change operating parameters and control the instrument through a user interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional minimally invasive surgical instruments are used, then the surgical procedure can be performed through small incisions, but the surgeon loses flexibility of tool placement and intuitive control

Engineering Contradiction:
Improveintuitive controlVSAvoidinstrument structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent creates a virtual copy of the surgical instrument's control interface by projecting control elements directly onto the visual display showing the surgical field. This virtual control panel replicates the functionality of physical controls while being visually integrated with the surgical view, allowing surgeons to control instrument parameters intuitively through the display without needing separate physical control devices.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent merges the control interface with the visual display of the surgical environment by overlaying control elements on the same screen. This integration combines the viewing function and control function into a single unified interface, eliminating the need for separate control panels or devices and improving ease of operation.

Inventive Principle:
Principle #5Merging (Combining)

2Length of stationary object

If endoscopic instruments with added length are used, then access to deep surgical sites is improved, but the surgeon's ability to feel forces exerted by tissues is reduced

Engineering Contradiction:
Improveinstrument lengthVSAvoidtactile feedback
Core Design Contradiction:
Length of stationary objectVSReliability

Solution Approach 1:

The patent implements a visual feedback system where the display shows both the surgical field and control elements that respond to surgeon input. The system provides real-time visual feedback about instrument position, orientation, and operational parameters, compensating for the loss of tactile feedback by translating force information into visual signals that the surgeon can perceive and respond to.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If telesurgery systems with remote control are used, then surgical dexterity is increased, but the coordination between displayed image and actual end effector movement becomes difficult

Engineering Contradiction:
Improvesurgical dexterityVSAvoidcoordination
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent adds a visual dimension to the control interface by displaying control elements overlaid on the surgical field image. This creates a two-dimensional integrated display that combines the surgical view with control functionality, allowing surgeons to coordinate movements more easily by seeing both the effect and control options in the same visual space rather than switching between separate displays or devices.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12396631B2Robotic surgical system with virtual control panel for tool actuation
Publication Date: 2025.08.26 CILAG GMBH INTERNATIONAL
  • US12396631B2 patent drawing
  • US12396631B2 patent drawing
  • US12396631B2 patent drawing

AI summary

A surgical system includes a detector, comprising an array of pixels configured to detect light reflected by a surgical instrument and generate a first signal comprising a first dataset representative of a visible image of the surgical instrument. The surgical system also includes a processor configured to receive the first signal, generate a modified image of the surgical instrument that includes a control panel. The control panel includes one or more control elements representative of one or more operating parameters of the surgical instrument. The processor is further configured to receive an input to the control panel from a user, the input being effective to change one of the operating parameters. The processor is also configured to generate a command signal based on the input to change the one of the operating parameters.