Surgical VR Interface with In-View Data Objects for Robot Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In virtual reality-assisted surgery, surgeons face challenges in accessing necessary information and views while maintaining an immersive and natural user interface, feeling disconnected from the external environment.

Innovation Solution

A surgical virtual reality user interface system that generates virtual objects for presenting information within the virtual reality landscape, allowing surgeons to interact with surgical robots and access data without disconnecting, using a sensor and tracking unit for sensing and tracking the user's position, and a computing unit for processing and generating control signals to control surgical robots and cameras, with a display unit for displaying the virtual reality world and informational objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the surgeon uses conventional screens and assistants to access information, then information accessibility is improved, but the immersive virtual reality experience is degraded

Engineering Contradiction:
Improveinformation accessibilityVSAvoidimmersive experience
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent introduces virtual reality interface elements as intermediaries between the surgeon and the information systems. These virtual elements (buttons, sliders, menus) are rendered within the VR environment and allow the surgeon to access patient data, surgical parameters, and control functions without breaking immersion. The intermediary layer translates physical controller inputs into virtual interactions that feel natural within the immersive context.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical system of physical screens and hand signals with a virtual reality-based information interface. Instead of looking at external monitors or using hand gestures to communicate with assistants, the surgeon interacts with information displayed within the VR environment through intuitive virtual controls, eliminating the need to physically turn away from the surgical field.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If the surgeon looks at external screens for information, then data visibility is improved, but the virtual reality immersion is reduced

Engineering Contradiction:
Improvedata visibilityVSAvoidvirtual reality immersion
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent merges the information display system with the virtual reality environment. Patient vitals, surgical parameters, anatomical models, and procedural checklists are all rendered as virtual objects within the immersive 3D space. This integration allows the surgeon to access all necessary data while maintaining the illusion of being present in the patient's anatomy, eliminating the need to switch between separate display systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from 2D screen displays to 3D virtual reality presentations of information. Anatomical structures, surgical instruments, and data visualizations are rendered in three dimensions, allowing the surgeon to interact with information spatially rather than flatly. This dimensional enhancement improves both visibility and immersion by making data feel like part of the surgical environment rather than separate from it.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If the system provides comprehensive information access, then surgical effectiveness is improved, but the user interface complexity increases

Engineering Contradiction:
Improvesurgical effectivenessVSAvoiduser interface complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the comprehensive information system into modular virtual components organized by surgical context. Instead of presenting all possible data at once, the interface divides information into discrete virtual objects (patient profile, anatomical models, instrument status, procedural steps) that can be independently accessed and manipulated. This segmentation reduces perceived complexity while maintaining comprehensive information availability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by customizing the information interface to match specific surgical procedures and anatomical regions. The virtual reality environment adapts the display of data, models, and controls to be relevant to the current surgical context, presenting only the information needed for that particular task rather than a generic comprehensive interface. This context-aware customization simplifies the user experience while maintaining surgical effectiveness.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables surgeons to interact with surgical robots and access desired information while maintaining an immersive experience, enhancing surgical efficiency and effectiveness by providing intuitive access to vital data and views within the virtual environment.

Implementation Method 1

a sensor and tracking unit for sensing and tracking a position of a portion of a user in space and for generating at least position data based on movement of the user

Methodology Applied
Scientific EffectPosition sensing and tracking:

Data Source

PatentUS20250366947A1Surgical virtual reality user interface
Publication Date: 2025.12.04 VICARIOUS SURGICAL INC
  • US20250366947A1 patent drawing
  • US20250366947A1 patent drawing
  • US20250366947A1 patent drawing

AI summary

A surgical virtual reality user interface generating system comprising a sensor and tracking unit for sensing and tracking a position a user and generating position data based on movement of the user, a computing unit for receiving the position data and processing the position data and generating control signals. The system also includes a surgical robot system for receiving the control signals and having a camera assembly for generating image data, and a virtual reality computing unit for generating a virtual reality world. The virtual reality computing unit includes a virtual reality rendering unit for generating an output rendering signal for rendering the image data for display, and a virtual reality object generating unit for generating virtual reality informational objects and for emplacing the informational objects in the virtual reality world. A display unit is provided for displaying the virtual reality world and the informational objects to the user.