Augmented Reality Surgical Microscope Overlaying Hidden Structures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current visualization systems during procedures, such as surgeries, lack the ability to effectively overlay real-time visual data with pre-acquired or additional information, like anatomical structures or hidden features, which can hinder precise navigation and understanding of the subject's internal structures.

Innovation Solution

A mixed visualization system that integrates a surgical microscope with optical pathways, motors for precise movement, and tracking systems to overlay real-time images with graphical representations of hidden or obstructed objects, providing an augmented reality view that combines live and pre-acquired data, allowing for enhanced understanding of the subject's internal structures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a direct visualization system with optical lenses is used to view internal components, then magnification and direct viewing capability are improved, but the ability to overlay additional information such as hidden structures or graphical representations is lost

Engineering Contradiction:
Improveviewing precisionVSAvoidinformation completeness
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent combines the direct visualization system (microscope with optical lenses) and the display system into a single integrated view. The microscope provides magnified real-time imaging while the display overlays graphical representations of hidden structures, allowing both functions to operate simultaneously through image merging technology.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an image merging system as an intermediary between the microscope camera and the display. This merging system combines the real-time microscope image with pre-acquired imaging data and graphical representations, allowing information from multiple sources to be integrated without interfering with the direct visualization capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If only real-time viewing through optical lenses is provided, then live visualization capability is improved, but the ability to visualize hidden or obstructed objects is worsened

Engineering Contradiction:
Improvereal-time viewing speedVSAvoidvisibility of hidden structures
Core Design Contradiction:
SpeedVSLoss of information

Solution Approach 1:

The patent performs preliminary acquisition of imaging data (such as CT scans or MRI images) before the procedure begins. This pre-acquired data is then integrated with the real-time microscope view during the procedure, allowing hidden structures to be visualized without delaying the real-time viewing capability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent adds a new dimension of information by overlaying graphical representations and pre-acquired imaging data onto the two-dimensional real-time microscope view. This creates a multi-layered visualization that reveals hidden structures in three-dimensional context while maintaining the real-time two-dimensional view.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Loss of information

If graphical representations and pre-acquired images are overlaid on the live view, then information completeness is improved, but the complexity of the visualization system increases

Engineering Contradiction:
Improveinformation completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent creates a multi-functional system where the microscope serves both as a direct visualization tool and as a platform for displaying overlaid information. The same optical pathway and camera system are used for both real-time imaging and for providing the base layer for graphical overlays, reducing the need for separate independent systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to view both real-time and additional information simultaneously, improving procedural precision and understanding of internal structures, thereby enhancing the accuracy and effectiveness of procedures.

Implementation Method 1

The lenses may be used to transmit light from an object to a viewing area that may include an eyepiece

Methodology Applied
Scientific EffectLight transmission: Light

Implementation Method 2

The direct visualization system may include an optical pathway that may include various optical lenses, such as magnification, focusing, and the like

Methodology Applied
Scientific EffectMagnification and focusing: Lens

Data Source

PatentUS20230196636A1System and method for viewing a subject
Publication Date: 2023.06.22 MEDTRONIC NAVIGATION INC
  • US20230196636A1 patent drawing
  • US20230196636A1 patent drawing
  • US20230196636A1 patent drawing

AI summary

A viewing system or imaging system is disclosed that includes optical pieces for viewing a subject. The viewing system may include features that allow an augmented mixed view through eyepieces of the viewing system. The mixed view may include graphical representations that are acquired or determined with information separate from the viewing system.