Surgical Camera Mesh Tracking Through Occlusion-Free Sight Lines
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing surgical navigation systems face challenges with object tracking due to line-of-sight disruptions and occlusions caused by surgeons or surgical instruments, leading to unreliable and inefficient tracking of surgical instruments and patient body parts.
Innovation Solution
A surgical field camera system utilizing a camera mesh with multiple cameras and a computer image analysis system to track objects by analyzing synchronized images from multiple viewpoints, ensuring continuous tracking by switching to unobstructed cameras and providing augmented reality overlays to guide surgeons.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single camera is used for tracking, then the device complexity is reduced, but the reliability of tracking deteriorates due to occlusions and line-of-sight disruptions
Solution Approach 1:
The system divides the tracking function across multiple cameras positioned at different locations around the surgical field. Each camera provides a separate viewpoint, and the system segments the tracking task so that if one camera's view is occluded, other cameras can continue tracking the same object, thereby maintaining reliable tracking without requiring a single complex camera system
Solution Approach 2:
The system merges data from multiple cameras to achieve reliable tracking. By combining viewpoints from several cameras, the system creates a composite tracking solution that overcomes the limitations of individual cameras. This merging allows the system to maintain continuous tracking of surgical instruments and body parts even when individual line-of-sight is blocked
2Reliability
If multiple cameras are used to overcome occlusions, then the reliability of tracking is improved, but the device complexity increases
Solution Approach 1:
Each camera in the system is designed to be universal in its function - all cameras can track any surgical instrument or body part within their field of view. This multi-functionality means that any camera can potentially track any object, and the system dynamically assigns tracking tasks to appropriate cameras based on current visibility, reducing the need for specialized cameras for specific objects or locations
3Adaptability or versatility
If cameras are positioned to cover all surgical instruments, then the tracking coverage is improved, but the difficulty of detecting and measuring increases due to occlusions
Solution Approach 1:
The system dynamically adjusts which camera tracks which object based on real-time visibility conditions. When an object becomes occluded from one camera's view, the system dynamically reassigns tracking to a different camera with an unobstructed view. This dynamic adaptation allows the system to maintain comprehensive tracking coverage while overcoming the detection difficulties posed by occlusions in the confined surgical space
Data Source
AI summary
A system and method for tracking an object within a surgical field are described. A system may include a mesh of cameras distributed around the surgical field, the mesh of cameras including, for example at least three cameras. Cameras in the mesh of cameras may be in known positions or orientations relative to the surgical field or may be mobile with position or orientation to be determined by the system. The system may include a computing system communicatively coupled to the mesh of cameras, the computing system including a processor and a memory device. The computing system may be used to generate tracking data for a tracked object from images or image data taken by one or more cameras of the mesh of cameras.