Surgical Tool Spatial Mapping Using Visual Markers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current medical tracking systems for surgical tools are expensive, restrict their availability, are unnatural for surgeons to use, require bulky external camera systems, and cannot be used for training or virtual environments due to their dependency on a real patient.
Innovation Solution
A method for spatial mapping of a digital surgical tool model onto its spatial position using a processor unit and a viewing device with a camera, allowing for accurate determination of the tool's position and rotation relative to reference points, enabling use in augmented reality for training, education, and precise surgical procedures without the need for external cameras.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If external camera systems are used for tracking surgical tools, then measurement precision is improved, but device complexity and cost increase significantly
Solution Approach 1:
The patent extracts the tracking function from the surgical tool itself and places it on a separate, easily attachable marker. This separates the complex processing requirements from the simple tracking objective, allowing precise tracking without complex integrated systems.
Solution Approach 2:
The patent uses visual markers that can be captured by standard cameras to represent the surgical tool's position and orientation. Instead of using complex sensors on the tool, a simple visual copy (marker) is used that can be detected by inexpensive camera systems.
2Measurement precision
If external camera systems are used for tracking surgical tools, then measurement precision is improved, but cost increases to more than €400,000
Solution Approach 1:
The patent replaces expensive, specialized tracking systems with inexpensive, readily available components like standard cameras and printed markers. This makes the system widely accessible without requiring significant financial investment.
Solution Approach 2:
The patent uses standard cameras that can serve multiple purposes (tracking, documentation, telemedicine) rather than dedicated expensive tracking cameras. This multi-functionality reduces overall system cost while maintaining tracking precision.
3Loss of information
If flat screen displays are used to show 3D scenes, then information is provided to the surgeon, but eye-hand coordination is negatively affected
Solution Approach 1:
The patent transitions from 2D flat screen displays to 3D holographic or augmented reality displays. This dimensional change allows the surgical scene to be viewed in its natural three-dimensional context, improving spatial understanding and eye-hand coordination while maintaining full information delivery.
Solution Approach 2:
The patent introduces a holographic or AR display as an intermediary between the surgical field and the surgeon's vision. This intermediary presents the 3D reconstructed scene directly in the surgeon's field of view, eliminating the need to look away at flat screens and maintaining natural hand-eye coordination.
4Measurement precision
If heavy external camera systems are used, then tracking capability is achieved, but ease of setup in different environments is reduced
Solution Approach 1:
The patent replaces heavy mechanical camera systems with lightweight optical systems using standard cameras and visual markers. This substitution eliminates the need for complex mechanical mounting and calibration infrastructure, allowing setup in diverse environments including resource-limited settings.
Solution Approach 2:
The patent changes the tracking system from requiring controlled environment parameters (stable mounting, fixed positions) to working with portable, movable components. The visual markers can be attached to any surgical tool, and standard cameras can be positioned flexibly, greatly increasing environmental adaptability.
5Measurement precision
If real patient presence is required for tracking, then accurate spatial mapping is achieved, but training and virtual use are prevented
Solution Approach 1:
The patent uses visual markers and 3D reconstruction to create accurate visual copies of the surgical scene and tools. These copies can be displayed holographically or through AR, allowing the surgical procedure to be visualized, trained, and practiced in virtual environments without requiring a real patient or physical surgical setup.
Solution Approach 2:
The patent introduces a 3D reconstruction and holographic/AR display system as an intermediary that can represent the surgical scene in both physical and virtual contexts. This intermediary allows the same tracking technology to serve both real surgical procedures and virtual training scenarios.
Data Source
AI summary
A method for the spatial mapping of a model of a surgical tool onto a spatial position of the surgical tool includes a) providing a surgical tool having a working part and a marker in the form of a visual image on a surface; b) providing a tool model of the surgical tool; c) providing a viewing device configured to be carried by a user and including a camera configured to capture a view and to generate camera data representative of the view; d) creating a spatial model of a space viewed by the camera; e) bringing the surgical tool within the space viewed b y the camera; f) identifying a representation of the marker in the camera data; g) determining a position and rotation of the representation of the marker with respect to the spatial model, and h) creating a spatial mapping of the tool model in the spatial model.