Augmented Reality Needle Guidance Using Image Planes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In medical procedures like biopsies, existing augmented reality systems lack the ability to accurately guide needles to a target without intersecting with delicate structures, as they often lack 3D information about real objects, leading to potential harm from obstacles like arteries or organs.
Innovation Solution
An image-based navigation system is used to identify a target in a medical image, display an image plane through its center, select a path for an instrument, and provide a virtual guide for needle insertion, ensuring the needle follows a safe and efficient trajectory while avoiding critical structures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If augmented reality systems superimpose virtual objects onto real scene images without 3D information, then the system complexity is reduced and ease of operation is improved, but manufacturing precision and measurement precision deteriorate because virtual objects cannot be accurately positioned relative to real objects
Solution Approach 1:
The patent introduces an image plane as an intermediary construct that bridges the virtual and real worlds. This image plane, derived from medical imaging data, serves as a reference framework that can be accurately positioned and oriented relative to the patient's anatomy. By superimposing virtual trajectory indicators onto this intermediate image plane rather than directly onto the real scene, the system achieves precise measurement and positioning while maintaining operational simplicity.
2Device complexity
If augmented reality systems use direct superimposition of virtual objects onto real scene images, then device complexity is reduced, but reliability deteriorates because the system cannot accurately guide needle placement to avoid intersecting with delicate structures
Solution Approach 1:
The patent segments the guidance system into distinct functional components: the image plane (providing anatomical reference), the trajectory plane (defining the insertion path), and the virtual indicators (providing visual guidance). This segmentation allows each component to be optimized independently - the image plane ensures reliability through accurate anatomical representation, while the virtual indicators maintain simplicity through intuitive visual display. The segmented architecture enables reliable needle placement guidance without requiring complex integrated systems.
3Measurement precision
If augmented reality systems provide comprehensive 3D information about real objects for accurate virtual object positioning, then manufacturing precision and measurement precision are improved, but device complexity increases
Solution Approach 1:
The patent extracts only the essential 3D information needed for the specific task of needle placement guidance, rather than requiring complete 3D reconstruction of all anatomical structures. By extracting and utilizing the image plane with its inherent spatial relationships from medical imaging data, the system achieves the necessary measurement precision for accurate needle positioning while avoiding the complexity of comprehensive 3D modeling and rendering systems.
Data Source
AI summary
A system and method for instrument placement using an image based navigation system is disclosed. A target of interest is identified in a medical image of a patient. An image plane is displayed that goes through a center of the target. The image plane has a configurable orientation. The image plane is used to select a path for an instrument from a position on the patient's skin to the center of the target. A trajectory plane is viewed from a tip of the instrument to the center of the target. The trajectory plane reflects an orientation of the instrument. A particular trajectory plane is selected that is representative of a desired orientation of the instrument. An image of the particular trajectory plane is frozen. The instrument can then be inserted using a virtual guide and is navigated toward the target.