Surgical Tracking and Annotation System for Anatomical Landmarks

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Surgeons face challenges in tracking and annotating surgical instruments and anatomical landmarks during minimally invasive procedures, particularly due to altered anatomy, cognitive load, and the need for precise intraoperative imaging and data management.

Innovation Solution

A visual tracking and annotation system that acquires and displays images of surgical regions and instruments, tracks instruments relative to the region of interest, and allows user-input annotations, integrating with data storage and processing to provide annotated images, utilizing technologies like OCT and endoscopes for real-time imaging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If surgeons manually track and note diagnostic image positions and treatment locations, then diagnostic accuracy and treatment precision can be maintained, but surgical time increases and cognitive load increases

Engineering Contradiction:

Improvetracking precisionVSAvoidsurgical time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical tracking methods with an automated optical tracking system that uses cameras and computer vision algorithms to automatically identify, track, and annotate anatomical landmarks and surgical instruments, eliminating the need for surgeons to manually note positions while maintaining tracking precision

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service tracking where the computational system automatically performs landmark identification, instrument tracking, and annotation without requiring surgeon intervention, allowing the surgeon to focus on the surgical task while the system handles the tracking and documentation autonomously

Inventive Principle:

Principle #25Self-service

2Adaptability or versatility

If surgeons inspect and treat multiple sparsely located anatomical regions, then comprehensive surgical coverage is achieved, but cognitive load increases

Engineering Contradiction:

Improvesurgical coverageVSAvoidcognitive load

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transitions from two-dimensional manual note-taking to three-dimensional spatial tracking and visualization, where the system automatically maps and annotates multiple anatomical landmarks in 3D space, providing comprehensive surgical coverage while reducing cognitive load through automated spatial awareness

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The tracking system serves multiple functions simultaneously: it tracks anatomical landmarks, monitors surgical instruments, provides real-time visualization, and maintains surgical records, allowing comprehensive coverage of multiple anatomical regions without increasing cognitive load as each function is automated

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If anatomy deforms or changes color naturally or from intervention, then realistic surgical conditions are represented, but tracking difficulty increases

Engineering Contradiction:

Improveanatomical variabilityVSAvoidtracking difficulty

Core Design Contradiction:

Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements dynamic tracking that continuously adapts to anatomical changes by using real-time image processing and computer vision algorithms that can detect and track landmarks despite deformation, color changes, or movement, maintaining tracking accuracy under varying surgical conditions

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system uses continuous feedback from multiple camera views and image processing to detect anatomical changes and automatically adjust tracking parameters, allowing the system to adapt to deforming anatomy and maintain accurate landmark identification throughout the surgical procedure

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS9814392B2Visual tracking and annotaton of clinically important anatomical landmarks for surgical interventions

Publication Date: 2017.11.14 JOHNS HOPKINS UNIVERSITY

AI summary

A visual tracking and annotation system for surgical intervention includes an image acquisition and display system arranged to obtain image streams of a surgical region of interest and of a surgical instrument proximate the surgical region of interest and to display acquired images to a user; a tracking system configured to track the surgical instrument relative to the surgical region of interest; a data storage system in communication with the image acquisition and display system and the tracking system; and a data processing system in communication with the data storage system, the image acquisition and display system and the tracking system. The data processing system is configured to annotate images displayed to the user in response to an input signal from the user.