Marker-less 3D Visualization for Surgical C-Arms

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current medical visualization systems during surgeries require additional components like separate cameras and marker systems, limiting mobility and increasing time loss for physicians, and fail to seamlessly combine three-dimensional surface and depth information.

Innovation Solution

A marker-less visualization system integrating a C-arm projection module and head-mounted display (HMD) projection module with a camera system and synchronization device to project and capture structured light, generating a combined image data set that correlates surface and depth information for real-time display on visualization spectacles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If separate cameras and marker systems are used for navigation and visualization, then three-dimensional guidance capability is improved, but device complexity and mobility limitations increase

Engineering Contradiction:
Improvethree-dimensional guidance capabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines the navigation system's imaging device with a C-arm projection module that projects structured light patterns. This integration allows the system to capture three-dimensional surface geometry and depth information using the existing imaging device and projection module, eliminating the need for separate cameras and marker systems while maintaining comprehensive visualization capabilities.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging device serves multiple functions: it captures X-ray images for depth information and simultaneously captures structured light patterns for surface geometry. The C-arm projection module integrates with the imaging device to provide both navigation guidance and three-dimensional visualization, making the system multi-functional and reducing overall complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If separate cameras and marker systems are installed for navigation, then three-dimensional guidance is improved, but time loss and mobility restrictions increase

Engineering Contradiction:
Improvethree-dimensional guidance capabilityVSAvoidtime loss
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary setup by integrating the C-arm projection module with the imaging device before the surgical procedure. This pre-integration eliminates the need for time-consuming assembly and calibration of separate camera and marker components during the actual intervention, allowing immediate use of three-dimensional visualization capabilities.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If physicians use separate monitors for X-ray images, then depth information is improved, but attentional resources and operational efficiency deteriorate

Engineering Contradiction:
Improvedepth information availabilityVSAvoidoperational efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent overlays three-dimensional surface geometry and depth information directly onto the two-dimensional X-ray images using the C-arm projection module. This dimensional enhancement allows physicians to perceive depth and surface characteristics without leaving the original imaging plane, eliminating the need to switch between separate monitors and maintaining continuous attention on the surgical field.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system creates a virtual copy of the three-dimensional surface geometry and depth information that is superimposed on the X-ray images. This digital copy provides comprehensive anatomical information while maintaining the physician's focus on the original imaging plane, improving operational efficiency by eliminating the need to reference separate displays.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables physicians to view three-dimensional structures and depth information simultaneously without additional equipment, improving information availability and reducing time and effort during surgical interventions by correlating surface and depth images spatially.

Implementation Method 1

a C-arm projection module for projecting structured light onto a first selected region of a body surface of the patient

Methodology Applied
Scientific EffectStructured light projection: Light

Implementation Method 2

a camera system for capturing the structured light projected by said C-arm projection module and by said HMD projection module so as to compute at least one digital image data set of a 3D surface structure

Methodology Applied
Scientific EffectLight detection: Photoelectric Effect

Implementation Method 3

by way of an imaging device that moves during image acquisition

Methodology Applied
Scientific EffectX-ray imaging: X-Ray

Data Source

PatentUS10448003B2System and method for triangulation-based depth and surface visualization
Publication Date: 2019.10.15 SIEMENS HEALTHINEERS AG
  • US10448003B2 patent drawing
  • US10448003B2 patent drawing

AI summary

An intraoperative, marker-less visualization system and method for visualizing three-dimensional surface structures and depth structures of a patient during an intervention. A C-arm carries a C-arm projection module and a camera, and visualization spectacles include an HMD (head-mounted device) projection module and a camera. The projection modules serve for projecting structured light. A processor computes a combined image data set in order to project the latter onto spectacle lenses of the visualization spectacles.