AR Conjunction of 2D Slices and 3D Anatomy for Surgical Clarity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems in healthcare struggle to effectively integrate two-dimensional image information with three-dimensional virtual objects, leading to unclear and confusing visual representations during medical procedures.
Innovation Solution
A method and system that combines two-dimensional slice images with three-dimensional virtual object representations, aligning them spatially with patient anatomy, using augmented reality devices to provide clear and understandable overlays, allowing users to interact and manipulate the content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If two-dimensional image information and three-dimensional virtual objects are integrated in existing augmented reality systems, then comprehensive medical information is provided, but the visual representation becomes unclear and confusing
Solution Approach 1:
The patent applies dimensionality change by displaying 2D slice images within a 3D virtual model of the anatomical region. Instead of separately displaying 2D and 3D information, the 2D images are positioned and oriented within the 3D space to correspond with their anatomical locations, creating a integrated four-dimensional visualization (3D space + information dimension) that maintains clarity while providing comprehensive medical information.
Solution Approach 2:
The patent implements nesting by placing 2D slice images inside the 3D virtual model structure. The 2D images are nested within the 3D anatomical model at positions that correspond to their anatomical locations, allowing users to see both the overall 3D structure and detailed 2D cross-sections simultaneously without visual confusion.
2Shape
If virtual three-dimensional objects are inserted into the user's field of view for surgery planning, then spatial understanding is improved, but integration with two-dimensional image information becomes difficult
Solution Approach 1:
The patent merges 2D and 3D visualizations by integrating slice images directly into the 3D virtual model. The 2D images are positioned and oriented within the 3D space to correspond with their anatomical locations, creating a unified visualization that simultaneously provides spatial understanding and access to detailed 2D image information without requiring separate display systems.
Solution Approach 2:
The patent uses the 3D virtual model as an intermediary that bridges 2D image data and 3D spatial representation. The 2D slice images are mapped onto or within the 3D model structure, allowing seamless integration of planar imaging data with volumetric visualization while maintaining anatomical accuracy and spatial relationships.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
The present invention relates to a method and a system for providing an augmentation (12) of a user's visual perception of the real world, that includes a display (13, 14, 15) of two-dimensional images in conjunction with three-dimensional virtual objects (17), which are displayed with respect to each other in a clear and easily understandable manner.