Augmented Reality Medical Overlay Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems in medical settings often clutter the user's field of view with virtual overlays, obstructing important real-world objects and hindering hand-eye coordination during procedures.
Innovation Solution
A computer-implemented method that determines the spatial location and orientation of reconstructed images within the user's field of view based on the position of objects and the augmented reality device, ensuring images are positioned to avoid obstruction and enhance ergonomics by aligning with anatomical directions and user line of sight.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If virtual overlay information is provided in the field of view, then information availability is improved, but field of view obstruction increases
Solution Approach 1:
The virtual overlay dynamically adapts its position, size, and orientation based on the user's head position, gaze direction, and the spatial location of real-world objects. This dynamic adjustment ensures that information remains visible without permanently obstructing the field of view, as overlays can move away from critical regions when not needed and return when relevant.
Solution Approach 2:
Different regions of the field of view receive different treatments - critical real-world objects maintain their natural visibility while less critical areas can accommodate virtual overlays. The system selectively places overlays in regions where they provide information without blocking important anatomical structures or surgical fields.
2Measurement precision
If virtual overlay is aligned with real world objects, then perception accuracy is improved, but hand-eye coordination deteriorates
Solution Approach 1:
The virtual overlay is positioned in a third dimension (depth) away from the real-world objects rather than being superimposed directly on them. This spatial separation allows the user to perceive the relationship between virtual and real objects while maintaining clear visual distinction, thus preserving hand-eye coordination while still providing accurate spatial perception.
3Loss of information
If virtual overlay provides detailed information, then information completeness is improved, but field of view clutter increases
Solution Approach 1:
Complex information is divided into segmented, modular elements that can be independently positioned and sized. Instead of presenting all information as a single dense overlay, the system breaks down data into discrete components (e.g., anatomical markers, measurement data, navigation cues) that are distributed across the field of view, reducing clutter while maintaining completeness.
Solution Approach 2:
The virtual overlay adapts its level of detail and information density based on the surgical context, user attention, and procedural stage. Information is dynamically adjusted to provide completeness only when and where needed, reducing clutter in situations where full information is not required.
Data Source
AI summary
The present invention relates to a computer-implemented medical method, a computer program and a system for determining a reconstructed image augmentation of a field of view provided by an augmented reality device (3), wherein an image location and/or at least one image orientation of at least one two-dimensional reconstructed image (9, 10 10) within the field view depends on the spatial position of at least one object (8, 11, 12).