Reconfigurable Multi-Panel Surgical GUI for Information Coordination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional display systems for robotic surgical systems are inadequate in managing and coordinating the large amount of information required for effective operation, leading to oversight and inefficiency in minimally-invasive surgery.

Innovation Solution

A graphical user interface (GUI) with reconfigurable display panels that can be resized and rearranged based on user input, automatically adapting to detected surgical tasks, and allowing for the integration of multiple software applications and endoscopic images, enabling seamless control of robotic surgical instruments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional display systems are used for robotic surgical systems, then the system structure remains simple, but the system cannot effectively manage and coordinate the large amount of information required for operation

Engineering Contradiction:
Improveinformation management capabilityVSAvoiddisplay system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The display system is segmented into multiple independent panels, each capable of displaying different types of information (endoscopic images, robotic instrument status, surgical site data, etc.). This segmentation allows the system to manage large amounts of information by distributing it across multiple display units rather than overwhelming a single display.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from a traditional single-dimensional display to a multi-dimensional panel arrangement that can be configured in various spatial configurations. The panels can be arranged in different layouts (e.g., side-by-side, stacked, or distributed across multiple screens) to optimize information presentation based on surgical needs.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If the display panels are made reconfigurable to adapt to different surgical tasks, then the adaptability improves, but the system complexity increases

Engineering Contradiction:
Improvedisplay configuration adaptabilityVSAvoiddisplay system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display panels are designed to be dynamically reconfigurable, allowing their positions, sizes, and content to be adjusted in real-time based on the surgical task at hand. The system can automatically detect the current surgical task and reconfigure the panel layout accordingly, or allow manual adjustment by the surgeon during the procedure.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Each display panel is designed to be multi-functional, capable of displaying different types of information depending on the surgical context. The same physical panel can display endoscopic images during one task, robotic instrument status during another, and surgical site data during a third, making the display system universally adaptable to various surgical scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If multiple software applications are integrated into the display interface, then the information completeness improves, but the ease of operation decreases

Engineering Contradiction:
Improveinformation completenessVSAvoidinterface operation ease
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

Each software application is assigned to a specific display panel or functional zone within the multi-panel system. This segmentation allows multiple applications to run simultaneously without competing for the same display space, reducing interface clutter and making it easier for the surgeon to access and monitor different information streams independently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary layer that manages and coordinates the multiple software applications. This intermediary handles task switching, information routing, and panel configuration automatically, reducing the operational burden on the surgeon while maintaining complete information display across all applications.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Productivity

If the display system is designed to automatically detect and adapt to surgical tasks, then the productivity improves, but the device complexity increases

Engineering Contradiction:
Improvesurgical operation efficiencyVSAvoiddisplay system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The display system incorporates feedback mechanisms that automatically detect the current surgical task being performed (through sensors, camera input, or system state monitoring) and use this feedback to automatically reconfigure the panel layout and content display. This closed-loop feedback system enables automatic adaptation without requiring manual intervention from the surgeon.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The display system performs self-configuration based on the detected surgical context. Rather than requiring the surgeon to manually adjust display settings, the system automatically detects the surgical task and configures the optimal panel arrangement and content display, making the system self-adapting and reducing cognitive load on the surgical team.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11786319B2Multi-panel graphical user interface for a robotic surgical system
Publication Date: 2023.10.17 AURIS HEALTH INC
  • US11786319B2 patent drawing
  • US11786319B2 patent drawing
  • US11786319B2 patent drawing

AI summary

A method for a robotic surgical system includes displaying a graphical user interface on a display to a user, wherein the graphical user interface includes a plurality of reconfigurable display panels, receiving a user input at one or more user input devices, wherein the user input indicates a selection of at least one software application relating to the robotic surgical system, and rendering content from the at least one selected software application among the plurality of reconfigurable display panels.