AR Breast Tumor Localization Using Connected Skin Markers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current marker localization systems for soft tissue tumors, particularly in breast surgery, lack inter-marker connectivity, leading to ambiguity in determining tumor margins and creating MRI artifacts, especially in neoadjuvant settings where tumors are no longer visible, and require preoperative 3D imaging for accurate augmented reality guidance.
Innovation Solution
A system combining smart marker localization with binocular AR glasses and a processing device, allowing real-time intraoperative coordinate framing of markers and ROI using off-the-shelf hardware, without preoperative imaging, and providing real-time feedback through AR glasses for precise tumor edge determination.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If discrete single marker localization systems are used, then marker localization is possible, but intermarker connectivity is lost and tumor margin determination becomes ambiguous
Solution Approach 1:
The patent combines multiple discrete marker localization events into a unified 3D tumor volume representation by integrating individual marker positions into a connected spatial model. This merging process restores intermarker connectivity information that was lost in discrete localization, allowing the surgeon to visualize the complete tumor extent and margins in three-dimensional space rather than as separate points.
2Measurement precision
If preoperative 3D imaging is used for AR guidance, then accurate tumor visualization is achieved, but imaging time and complexity increase
Solution Approach 1:
The patent performs preliminary actions by placing markers on the tumor during preoperative preparation, which captures the tumor's spatial information before surgery. This eliminates the need for time-consuming preoperative 3D imaging (MRI/CT) while maintaining accurate tumor visualization, as the markers directly define the tumor volume in the surgical coordinate system.
Solution Approach 2:
The patent creates a digital copy of the tumor volume by using markers to define its spatial boundaries. Instead of relying on reconstructed 3D images from MRI/CT scans, the marker positions serve as direct physical references that are digitally modeled into a 3D representation, providing accurate tumor visualization without the time cost of preoperative imaging.
3Measurement precision
If markers are placed in soft tissue, then tumor localization is enabled, but MRI artifacts are created
Solution Approach 1:
The patent extracts the essential localization function from the marker while eliminating the harmful MRI artifact component. By using markers that are detectable through alternative means (such as optical or electromagnetic detection rather than MRI signal interference), the system maintains accurate tumor localization capability without generating the harmful MRI artifacts that traditional metallic or ferromagnetic markers would create.
4Measurement precision
If hand-held locator is used for marker detection, then marker positioning is achieved, but real-time feedback and intermarker connectivity are lost
Solution Approach 1:
The patent implements a feedback mechanism that continuously monitors marker positions and provides real-time information about spatial relationships between markers. The system processes signals from multiple markers simultaneously, calculating their relative positions and connectivity in real-time, thereby providing the surgeon with immediate feedback about the complete tumor volume geometry rather than requiring sequential single-marker localization.
Data Source
AI summary
Apparatus and methods are described for use with a region of interest (ROI) within breast tissue of a breast of a subject and one or more reference markers configured to be placed at respective reference points on skin of the breast. A processing unit determines a relationship between positions of the ROI within the breast tissue and the one or more reference markers on the skin of the breast, and, subsequently, determines a location of the ROI within the breast tissue by identifying the one or more reference markers to thereby localize the ROI within the breast tissue. The processing unit outputs augmented-reality data at a location corresponding to the ROI. Other applications are also described.