AR Visualization of 2D Slices and 3D Objects for Surgical Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems in healthcare struggle to effectively integrate two-dimensional image information with three-dimensional virtual objects in a clear and understandable manner, limiting their utility in medical procedures.
Innovation Solution
A method and system that combines two-dimensional slice images with three-dimensional virtual object representations, aligning them with real-world anatomy using spatial tracking and augmentation data, allowing dynamic adjustment of image planes based on movable objects and anatomical directions, and providing interactive control through user gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Shape
If virtual three-dimensional objects are inserted into the user's field of view for augmented reality, then three-dimensional visualization is achieved, but integration with two-dimensional image information becomes difficult and unclear
Solution Approach 1:
The patent combines 2D slice images and 3D virtual objects into a single augmented reality overlay displayed in the user's field of view. The 2D images show anatomical cross-sections while 3D objects represent surgical instruments or anatomical structures, merging both visualization types into one integrated display that maintains spatial relationships and provides comprehensive surgical information simultaneously.
2Shape
If virtual screens are projected into the user's field of view to display two-dimensional image information, then two-dimensional visualization is achieved, but combination with three-dimensional virtual object information becomes difficult and unclear
Solution Approach 1:
The patent merges 2D slice images displayed on virtual screens with 3D virtual objects into a single augmented reality overlay. The 2D images provide anatomical context while 3D objects show instrument positions or anatomical landmarks, creating an integrated visualization that maintains spatial relationships and provides comprehensive surgical information in one view.
Solution Approach 2:
The patent enhances 2D slice images by adding 3D virtual objects that extend into the depth dimension. This allows 2D anatomical cross-sections to be enriched with 3D instrument representations or anatomical structures, providing depth perception and spatial context that transforms the flat 2D display into a multi-dimensional visualization.
3Quantity of substance
If multiple separate displays are used for two-dimensional images and three-dimensional objects, then comprehensive information is provided, but clarity and ease of understanding decrease
Solution Approach 1:
The patent combines multiple information sources (2D slice images, 3D virtual objects, anatomical references) into a single augmented reality overlay displayed in the user's field of view. This integration maintains all necessary surgical information while presenting it in a unified spatial context that is easier to comprehend than multiple separate displays.
Solution Approach 2:
The augmented reality overlay serves multiple functions simultaneously: displaying 2D anatomical cross-sections, showing 3D instrument positions, providing spatial orientation, and maintaining real-time updates. This multi-functional display replaces what would otherwise require multiple separate systems, simplifying the overall visualization architecture while maintaining information completeness.
Data Source
AI summary
The present invention relates to a method and a system for providing an augmentation (12) of a user's visual perception of the real world, that includes a display (13, 14, 15) of two-dimensional images in conjunction with three-dimensional virtual objects (17), which are displayed with respect to each other in a clear and easily understandable manner.