Spatially-Aware Displays Using Virtual Cameras for Surgical Navigation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing surgical visualization systems fail to consider the position of the surgeon and display relative to the patient, leading to a loss of intuitive spatial perception and requiring additional devices for interaction.

Innovation Solution

A system that registers and tracks the pose of the display device and physical object in a common coordinate system, controlling rendering based on a virtual camera position opposite the display, allowing the surgeon's viewpoint to be integrated into the visualization pipeline.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If monitors are positioned away from the X-ray source and patient, then patient positioning flexibility and radiation dose to interventionalist are improved, but intuitive spatial perception is lost

Engineering Contradiction:

Improvepatient positioning flexibilityVSAvoidspatial configuration perception

Core Design Contradiction:

Ease of operationVSLoss of information

Solution Approach 1:

A virtual camera system acts as an intermediary between the physical monitor position and the surgeon's perspective. The virtual camera models the surgeon's eye position and computes rendered images that correspond to this virtual viewpoint, allowing the monitor to be positioned optimally for the patient while preserving spatial perception through computational geometry.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical coupling between monitor position and spatial perception with a computational system. Instead of requiring the monitor to be physically positioned at specific locations to maintain spatial intuition, the system uses software-based virtual camera models to compute and display images that correspond to the surgeon's virtual viewpoint, substituting physical positioning requirements with computational rendering.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Shape

If 3D volume renderings are used, then spatial visualization is improved, but ease of interpretation is worsened due to loss of training familiarity

Engineering Contradiction:

Improvespatial visualizationVSAvoidimage interpretation ease

Core Design Contradiction:

ShapeVSEase of operation

Solution Approach 1:

The system dynamically switches between different visualization modes (2D slice views and 3D volume renderings) based on the surgical task requirements. The navigation system can adaptively present information in the most appropriate format, allowing surgeons to access both familiar 2D orthogonal views and enhanced 3D spatial visualization when needed.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The visualization system is designed to provide multiple viewing modes simultaneously - it can display traditional 2D orthogonal slices for familiar interpretation while also providing 3D volume renderings for spatial understanding. This multi-functional approach allows the same system to serve both interpreters of traditional imaging and those needing enhanced spatial visualization.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Loss of information

If navigation annotations are added to slices, then surgical planning is improved, but device complexity increases

Engineering Contradiction:

Improvesurgical plan informationVSAvoidvisualization system complexity

Core Design Contradiction:

Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges preoperative planning annotations directly into the intraoperative slice views. By combining the surgical plan information with the real-time imaging data in a unified visualization, the system reduces the need for separate annotation displays and simplifies the overall system architecture while providing comprehensive surgical guidance.

Inventive Principle:

Principle #5Merging (Combining)

4Device complexity

If virtual camera position is fixed, then rendering control is simplified, but adaptability to surgeon viewpoint is worsened

Engineering Contradiction:

Improverendering control simplicityVSAvoidviewpoint adaptability

Core Design Contradiction:

Device complexityVSAdaptability or versatility

Solution Approach 1:

The system continuously tracks the surgeon's head position and orientation using sensors, and this feedback is used to dynamically adjust the virtual camera position. As the surgeon moves or rotates their head, the virtual camera automatically repositions to match their viewpoint, providing adaptive visualization without requiring complex manual control interfaces.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12419686B2Spatially-aware displays for computer-assisted interventions

Publication Date: 2025.09.23 STRYKER LEIBINGER GMBH & CO KG

AI summary

Described herein are systems, methods, and techniques for spatially-aware displays for computer-assisted interventions. A Fixed View Frustum technique renders computer images on the display using a perspective based on a virtual camera having a field-of-view facing the display and automatically updates the virtual position of the virtual camera in response to adjusting the pose of the display. A Dynamic Mirror View Frustum technique renders computer images on the display using a perspective based on a field-of-view of a virtual camera that has a virtual position behind the display device. The virtual position of the virtual camera is dynamically updated in response to movement of a user's viewpoint located in front of the display device. Slice visualization techniques are also described herein for use with the Fixed View Frustum and Dynamic Mirror View Frustum techniques.