Mixed Reality Display for Surgical Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In computer-aided surgical systems, it is challenging for users to simultaneously view images displayed on a screen and the real patient or object, as the displays are often positioned away, making it difficult to register image space with real space accurately during procedures like tumor resection.

Innovation Solution

A mixed reality display system that allows users to wear a head-mounted device to view real space and superimpose images directly onto the patient or object, enabling registration of pre-acquired images with real-time tracking and navigation of instruments, using technologies like Holo Lens and Meta 2 digital displays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If images are displayed on a screen positioned away from the patient, then the display can be viewed clearly, but it becomes difficult for the user to view both the image and the patient simultaneously

Engineering Contradiction:
Improveimage viewing clarityVSAvoidsimultaneous viewing of image and patient
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent introduces a transparent display positioned between the user and the patient that acts as an intermediary medium. This display shows surgical images, navigation data, and anatomical structures while allowing the user to simultaneously see through it to the patient, resolving the contradiction between clear image viewing and simultaneous patient observation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transitions from a traditional 2D screen display to a transparent display that overlays information in the user's direct field of view. This dimensional change allows images to be viewed in the same physical space as the patient, enabling simultaneous viewing without requiring the user to shift attention between separate displays and the patient.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If the display is positioned away from the patient, then the display can be seen clearly, but the accuracy of registering image space with real space deteriorates

Engineering Contradiction:
Improvedisplay visibilityVSAvoidregistration accuracy between image space and real space
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The transparent display serves as an intermediary that bridges image space and real space by overlaying registered anatomical images and navigation data directly onto the patient's anatomy. This maintains spatial correspondence while providing clear visual information to the user.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent merges image space and real space by superimposing surgical images, anatomical structures, and navigation information directly onto the patient through the transparent display. This merging maintains accurate spatial registration while improving visibility and reducing the need for separate display positioning.

Inventive Principle:
Principle #5Merging (Combining)

3Device complexity

If a traditional screen display is used, then the system structure is simple, but the ability to superimpose images onto the patient is lost

Engineering Contradiction:
Improvedisplay system structureVSAvoidimage superposition capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent transitions from a conventional 2D screen to a transparent display that introduces a new dimension of viewing. This allows images to be superimposed onto the patient in the user's direct field of view while maintaining relative structural simplicity through the use of modern transparent display technology.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11839433B2System for guided procedures
Publication Date: 2023.12.12 MEDTRONIC NAVIGATION INC
  • US11839433B2 patent drawing
  • US11839433B2 patent drawing
  • US11839433B2 patent drawing

AI summary

A system using images of a subject to assist in visualization of hidden portions of the subject is disclosed. The system may illustrate the images with a wearable display. The images may be displayed in an augmented or mixed reality manner.