AR Surgical Guidance for Obscured Tissue Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current surgical procedures face challenges in effectively presenting and managing large amounts of information to surgeons, particularly in visualizing instruments and anatomical structures obscured by patient tissue, which can impact surgical efficiency and patient outcomes.

Innovation Solution

An augmented reality (AR) system integrated with a position tracking system and a controller to display real-time, customizable information, including representations of instrument positions, working volumes, and travel paths, using navigational trackers to ensure accurate visualization of instrument relationships with patient tissues without obstructing the surgeon's view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional surgical information presentation methods are used, then the surgical system is simple, but the surgeon cannot effectively visualize instruments and anatomical structures obscured by patient tissue

Engineering Contradiction:
Improvevisualization of obscured anatomical structuresVSAvoidAR system integration
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces an AR headset as an intermediary device that displays virtual information (instrument positions, anatomical structures, travel paths) overlaying the surgeon's real-world view. This mediator bridges the gap between the physical surgical field and the information needed, allowing visualization of obscured structures without directly interfering with the surgical procedure.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates virtual copies of physical instruments and anatomical structures by tracking instrument positions with navigational trackers and rendering corresponding visual representations in the AR display. These copies allow the surgeon to see instrument locations and hidden anatomical features that cannot be directly observed in the physical surgical field.

Inventive Principle:
Principle #26Copying

2Loss of information

If AR system displays all surgical information, then complete information is provided to surgeon, but the view may become cluttered and obscure real-world objects

Engineering Contradiction:
Improvecompleteness of surgical informationVSAvoidvisual clarity and obstruction
Core Design Contradiction:
Loss of informationVSIllumination intensity

Solution Approach 1:

The AR system applies different visual properties to different regions of the display, using selective transparency, color coding, and sizing to highlight only the most relevant information in each area. Critical structures and instrument positions are emphasized with distinct visual characteristics, while less critical information is displayed with reduced prominence, maintaining visual clarity while providing comprehensive information.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If real-time tracking and display is implemented, then surgical accuracy is improved, but the system complexity and computational requirements increase

Engineering Contradiction:
Improveinstrument position accuracyVSAvoidtracking and control system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The controller serves multiple functions: it processes tracking data from navigational trackers, calculates instrument positions and trajectories, manages AR display content, and coordinates updates in real-time. This multi-functional approach consolidates complex operations into a single control unit, reducing overall system complexity while maintaining high measurement precision through continuous real-time tracking.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20230293259A1Surgical systems, methods, and devices employing augmented reality (AR) graphical guidance
Publication Date: 2023.09.21 DEPUY SYNTHES PROD INC
  • US20230293259A1 patent drawing
  • US20230293259A1 patent drawing
  • US20230293259A1 patent drawing

AI summary

Described are methods and systems for computer aided surgery (CAS) comprising an augmented reality (AR) system configured to display augmented reality information, a position tracking system configured to track positions of objects, an instrument coupled to a navigational tracker detectable by the position tracking system, and a controller configured to determine a position of the instrument, based on the determined position, display augmented reality information using the AR system, the augmented reality information comprising a representation of a relationship between at least a distal end of the instrument and tissue of the patient, and if the instrument moves to a second position, updating the representation. Examples of representations include a field of view of the instrument, a working volume of the instrument, a travel path of the instrument, adjacent patient structures, and other objects generally obscured by patient tissue.