3D Surgical Tool Depiction for Real-Time Spatial Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing minimally invasive surgery systems lack effective real-time visualization of surgical tools relative to the surgical site, limiting the surgeon's ability to accurately navigate and perform procedures.

Innovation Solution

A depiction system that generates real-time correlated depictions of surgical tool movements using 3D surface data and spatial position data, integrating sensors and a computer system to project the tool's position and orientation onto the surgical cavity's surface contour, providing dynamic visual information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a laparoscope is inserted to visualize the surgical site, then the surgeon can see inside the body cavity, but the surgeon cannot accurately determine the positions and orientations of surgical tools relative to the surgical site

Engineering Contradiction:
Improvevisualization of surgical tool positionVSAvoidspatial positioning accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The system creates a virtual copy of the surgical site using 3D surface data and overlays a virtual representation of the surgical tool onto this model. The computer system generates a virtual image showing the tool's position and orientation relative to the surgical site, allowing the surgeon to see both the actual surgical field and the tool's spatial relationship simultaneously.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system transitions from 2D endoscopic video to a 3D virtual model of the surgical site. By processing 3D surface data and spatial position data, the system creates a three-dimensional representation that preserves spatial relationships, enabling accurate visualization of tool positions and orientations that cannot be obtained from conventional 2D imaging alone.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If conventional endoscopic video is used to show the surgical site, then the surgeon can view the cavity, but the video does not provide accurate spatial context for tool navigation

Engineering Contradiction:
Improvetool navigationVSAvoidspatial orientation information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system merges the conventional endoscopic video feed with a computer-generated virtual model of the surgical site. The display shows both the real-time video from the laparoscope and the virtual 3D model with tool representations overlaid, combining the advantages of direct visual inspection with enhanced spatial awareness for improved tool navigation.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The computer system acts as an intermediary that processes spatial position data from sensors and 3D surface data, then generates a virtual image that bridges the gap between the physical surgical field and the surgeon's visual perception. This virtual intermediary provides the missing spatial orientation information while maintaining compatibility with the existing endoscopic video system.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If 3D surface data and spatial position data are processed in real time, then accurate tool positioning is achieved, but system complexity increases

Engineering Contradiction:
Improvetool position accuracyVSAvoiddata processing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The computer system is designed to perform multiple functions: it processes 3D surface data, tracks spatial position data from sensors, generates virtual images, and integrates these with endoscopic video. By creating a multi-functional processing platform, the system achieves accurate tool positioning while consolidating various processing tasks into a single integrated system rather than requiring separate dedicated systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12533008B2Real time correlated depiction system of surgical tool
Publication Date: 2026.01.27 3DINTEGRATED APS
  • US12533008B2 patent drawing
  • US12533008B2 patent drawing
  • US12533008B2 patent drawing

AI summary

A depiction system for generating a real time correlated depiction of movements of a surgical tool for uses in minimally invasive surgery is described. In an embodiment the system includes a computer system, 3D surface data generation means and position data generation means for obtaining real time spatial position data of at least a part of the surgical tool. The 3D surface data generation means or the position data generation is adapted for providing surface position data of at least the target area. The computer system is programmed for determining depiction data representing a depiction of the real time relative spatial position(s) of the surgical tool onto at least a portion of the surface contour of the surface section of the minimally invasive surgery cavity.