Hybrid AR Tracking System for Laparoscopic Registration Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Laparoscopic surgery faces challenges with registration errors in augmented reality systems due to variable operating conditions, particularly in computer vision-based and hardware-based approaches, which can lead to inaccurate tracking of anatomical structures and surgical tools.

Innovation Solution

A hybrid tracking system that combines electromagnetic and optical hardware-based tracking with computer vision-based tracking to refine registration and improve accuracy, using a correction matrix to align virtual and real objects in augmented reality for enhanced image fusion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If computer vision-based tracking or hardware-based tracking is used alone for augmented reality in laparoscopic surgery, then the system implementation is simpler, but registration errors increase due to variable operating conditions

Engineering Contradiction:
Improveregistration accuracyVSAvoidtracking system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines computer vision-based tracking with hardware-based tracking (electromagnetic and/or optical tracking) into a hybrid tracking system. The system integrates multiple tracking methods to compensate for their individual weaknesses under variable operating conditions, thereby improving registration accuracy while managing system complexity through coordinated operation of complementary tracking technologies

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If a hybrid tracking system combining multiple tracking methods is used, then registration accuracy improves, but device complexity increases

Engineering Contradiction:
Improvetracking precisionVSAvoidtracking system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system employs feedback mechanisms where the results from hardware-based tracking inform and refine the computer vision-based tracking, and vice versa. The processing circuitry continuously adjusts and optimizes the combination of tracking methods based on real-time performance, allowing the system to achieve high measurement precision while managing complexity through intelligent coordination rather than simple addition of components

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11633235B2Hybrid hardware and computer vision-based tracking system and method
Publication Date: 2023.04.25 CHILDRENS NAT MEDICAL CENT
  • US11633235B2 patent drawing
  • US11633235B2 patent drawing
  • US11633235B2 patent drawing

AI summary

The present disclosure relates to a tracking system for augmented reality in a clinical setting. Specifically, the present disclosure relates to an approach for combining hardware-based tracking and computer vision-based tracking in order to accurately overlay a projected image onto a video image.