3D Overlay Rendering With Colored Shadows for 2D Medical Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of medical imaging systems, such as radiologists and surgeons, often prefer to make decisions based on two-dimensional (2D) images despite the availability of three-dimensional (3D) data, as integrating 2D and 3D information can be difficult to visualize effectively, especially when the view plane is parallel to the image, limiting depth perception.
Innovation Solution
The integration of 2D and 3D information is enhanced through volumetric lighting and translucent materials that cast colored shadows on gray-valued image textures, with 3D objects being colorized based on their distance from the 2D plane, improving depth cues and visualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If 3D objects are overlaid on 2D images using conventional rendering methods, then the integration of 2D and 3D information is achieved, but depth perception is limited especially when the view plane is parallel to the image
Solution Approach 1:
The patent applies color changes by casting colored shadows from 3D objects onto the 2D image plane. Different colors indicate different depths or properties of the 3D objects, providing intuitive depth cues that enhance depth perception without requiring complex visualization techniques. This resolves the contradiction by adding depth information through color while maintaining relatively simple rendering processes.
Solution Approach 2:
The patent introduces volumetric lighting that simulates light interaction with 3D objects in three-dimensional space, even when projected onto a 2D plane. By rendering shadows with volumetric properties and using gradient shading, the system adds a perceived third dimension to the 2D display, improving depth perception without requiring actual 3D display hardware.
2Loss of information
If volumetric lighting and translucent materials are used to cast colored shadows, then depth perception is improved, but the complexity of the rendering process increases
Solution Approach 1:
The patent applies volumetric lighting and translucent materials selectively to specific 3D objects that need depth emphasis, rather than uniformly to all objects. The colored shadows and gradient shading are applied locally to regions where depth information is most needed, improving spatial understanding while limiting the increase in rendering complexity to only the necessary areas.
Solution Approach 2:
The patent uses partial action by applying volumetric lighting effects to only the essential depth-critical portions of the scene. Rather than fully rendering all objects with complete volumetric complexity, the system applies simplified volumetric effects where needed, achieving adequate depth perception without the full computational cost of exhaustive volumetric rendering throughout the entire scene.
3Loss of information
If 3D objects are colorized based on distance from the 2D plane, then depth cues are enhanced, but the processing requirements increase
Solution Approach 1:
The patent colorizes 3D objects based on their distance from the 2D plane by casting colored shadows, where color intensity or hue varies with depth. This provides enhanced depth cues through intuitive color gradients, allowing users to quickly perceive spatial relationships. The approach uses relatively simple color mapping operations rather than complex processing, efficiently translating depth information into visual color variations.
Solution Approach 2:
The patent changes the color parameter of 3D objects as a function of their distance from the 2D plane. By mapping the depth parameter to color properties (hue, saturation, or intensity), the system enhances depth perception through parameter transformation. This approach requires minimal processing power compared to more complex depth encoding methods, as it essentially applies a color lookup table or simple gradient based on calculated distance values.
Data Source
Figure 1
Figure 2A~2B
Figure 3
AI summary
In some examples, one or more three dimensional (3D) objects may be rendered in relation to a two dimensional (2D) imaging slice. The 3D object may be rendered such that the 3D object casts a colored shadow on the 2D imaging slice. In some examples, the 3D object may be rendered in colors where different colors indicate a distance from the portion of the 3D object from the 2D imaging slice.