AR Visualization of Ophthalmic Instruments via Position Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

During ophthalmic surgical procedures, medical instruments can be obstructed from view by patient tissue, making it difficult for surgeons to accurately navigate and visualize their position within the eye.

Innovation Solution

A system comprising a processor and display that receives optical and anatomical images, registers them in a common coordinate system, and estimates the position of medical instruments, allowing for real-time visualization of the instrument's position even when obstructed by tissue, using a position tracking system and cameras within the eye.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a surgeon uses traditional direct visualization during ophthalmic surgery, then the surgical procedure is simple and quick, but the medical instrument becomes obstructed from view by patient tissue, reducing measurement precision

Engineering Contradiction:
Improveinstrument position visualization accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary system consisting of cameras, position tracking systems, and augmented reality displays that mediate between the surgical field and the surgeon's view. Cameras capture images from within the eye, position tracking systems monitor instrument location, and AR displays overlay this information to provide continuous instrument visualization even when obstructed by tissue.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates visual copies of the surgical field and instrument position through camera imaging and augmented reality overlays. Instead of directly viewing the instrument, the surgeon sees a copied representation displayed through the AR system, which reproduces the instrument's position and orientation based on tracking data.

Inventive Principle:
Principle #26Copying

2Measurement precision

If a position tracking system and augmented reality display are implemented, then instrument position visualization accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improveinstrument position tracking accuracyVSAvoidnumber of system components
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent integrates multiple functions into a unified system where the same camera and tracking infrastructure serves both imaging and position tracking purposes. The augmented reality display simultaneously presents anatomical views and instrument position information, making the system multi-functional and reducing the need for separate dedicated components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the camera system, position tracking system, and augmented reality display into an integrated system. These previously separate components are combined and coordinated to work together, sharing common elements such as the optical pathway and display interface, thereby managing complexity through consolidation.

Inventive Principle:
Principle #5Merging (Combining)

3Manufacturing precision

If real-time image processing and registration are performed, then surgical precision is improved, but the processing time and computational requirements increase

Engineering Contradiction:
Improvesurgical precisionVSAvoidimage processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary registration of the camera system with the position tracking system before the surgical procedure begins. This pre-alignment establishes the coordinate transformations needed for accurate instrument position visualization, eliminating the need for complex real-time calculations during surgery and reducing processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex mechanical alignment procedures with computational registration methods. Instead of physically aligning components during surgery, the system uses image processing and coordinate transformation algorithms to register the camera and tracking system, which is faster and more flexible.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11832883B2Using real-time images for augmented-reality visualization of an ophthalmology surgical tool
Publication Date: 2023.12.05 JOHNSON & JOHNSON SURGICAL VISION INC
  • US11832883B2 patent drawing
  • US11832883B2 patent drawing
  • US11832883B2 patent drawing

AI summary

A system includes a processor and a display. The processor is configured to: (a) receive, from a camera inserted into an eye of a patient, at least an optical image of at least a region-of-interest (ROI) of the eye, (b) receive, from a position tracking system (PTS), a position signal indicative of a position of a medical instrument treating the eye, (c) register the optical image and the PTS in a common coordinate system, and (d) estimate the position of the medical instrument in the optical image. The display is configured to visualize at least the ROI and the medical instrument.