Reconfigurable Surgical GUI Panels for Robotic Information Coordination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional display systems for robotic surgical systems are inadequate in managing and coordinating the large amount of information required for effective operation, leading to oversight and inefficiency in minimally-invasive surgery.

Innovation Solution

A graphical user interface (GUI) with reconfigurable display panels that can be resized and rearranged based on user input, automatically adapting to surgical tasks, and integrating multiple software applications to provide a customizable and interactive environment for surgeons, including endoscopic images and real-time data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional display systems are used for robotic surgical systems, then the system structure remains simple, but the system cannot effectively manage and coordinate the large amount of information required for effective operation

Engineering Contradiction:
Improveinformation management capabilityVSAvoiddisplay system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The display system is segmented into multiple independent panels that can be individually configured and arranged. Each panel can display different types of surgical information (endoscopic views, robotic arm positions, surgical instrument status, etc.), allowing the system to manage large amounts of information by dividing it across multiple display segments rather than overwhelming a single display area.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The display panels are made dynamic through reconfigurability - their layout, size, and content can be adjusted in real-time based on surgical needs. The system automatically adapts panel configurations during different phases of surgical procedures, and allows manual repositioning and resizing by users, transforming a static display system into a dynamic one that responds to operational requirements.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If multiple software applications are integrated into the GUI, then the functionality and information management improve, but the interface complexity increases

Engineering Contradiction:
Improvesoftware application integrationVSAvoidGUI complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The graphical user interface is designed as a universal platform that can host and integrate multiple different software applications simultaneously. Each application (endoscopic imaging, robotic control, surgical planning, etc.) maintains its own functionality while being coordinated through the unified multi-panel display system, allowing diverse functions to be accessed through a single adaptable interface rather than requiring separate specialized interfaces.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The multi-panel display system acts as an intermediary layer between the surgeon and multiple software applications. It provides a unified coordination mechanism that manages information flow from various applications, presenting it in an organized manner across multiple panels, thus simplifying the interaction complexity while maintaining access to all application functionalities.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If the display panels are made reconfigurable and adaptable, then the user efficiency improves, but the control complexity increases

Engineering Contradiction:
Improvesurgical operation efficiencyVSAvoidinterface control ease
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The display system incorporates self-service capabilities through automatic adaptation - it can autonomously reconfigure panel layouts and content based on detected surgical phases, active applications, and user preferences without requiring manual intervention. This automation reduces the control burden on users while maintaining high adaptability, allowing the system to serve itself in optimizing its own configuration based on operational context.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary actions by pre-configuring display panels for different surgical scenarios and procedures. Templates and presets are prepared in advance for common surgical tasks, allowing the system to quickly switch to appropriate configurations without requiring users to manually set up complex panel arrangements during time-critical surgical operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3687431B1Multi-panel graphical user interface for a robotic surgical system
Publication Date: 2024.08.21 VERB SURGICAL INC
  • EP3687431B1 patent drawingFigure 1A~1B
  • EP3687431B1 patent drawingFigure 1C
  • EP3687431B1 patent drawingFigure 2

AI summary

A method for a robotic surgical system includes displaying a graphical user interface on a display to a user, wherein the graphical user interface includes a plurality of reconfigurable display panels, receiving a user input at one or more user input devices, wherein the user input indicates a selection of at least one software application relating to the robotic surgical system, and rendering content from the at least one selected software application among the plurality of reconfigurable display panels.