Dual Lightmap Illumination for Endoscopic Volume Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual endoscopy techniques face challenges in providing photorealistic lighting for medical imaging, as single point light sources create shadows and dark regions, while multiple sources increase computational requirements, and ambient illumination results in unrealistic views, hindering effective analysis and diagnosis.

Innovation Solution

The use of two lightmaps, one positioned inside the object for internal illumination and another outside for external illumination, combined with path tracing-based rendering, to generate photorealistic views of internal and external objects, providing realistic environmental lighting and contextual information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If a single point light source is used for illumination, then the computational requirement is low, but shadows and dark regions are generated that prevent proper analysis

Engineering Contradiction:
Improveillumination qualityVSAvoidinformation loss in dark regions
Core Design Contradiction:
Illumination intensityVSLoss of information

Solution Approach 1:

The illumination system is segmented into multiple light sources positioned at different locations within the virtual endoscope field of view. Each light source illuminates different regions, eliminating shadows and dark areas that would otherwise obscure anatomical details. This segmentation of the lighting system resolves the contradiction by providing comprehensive illumination without requiring a single complex light source.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple light sources are merged into a unified illumination system that works together to provide uniform lighting across the entire field of view. The combined effect of multiple light sources eliminates the shadows created by individual sources while maintaining computational efficiency through coordinated rendering of the light map.

Inventive Principle:
Principle #5Merging (Combining)

2Illumination intensity

If multiple point light sources are used to eliminate shadows, then illumination quality improves, but computational requirements dramatically increase preventing real time imaging

Engineering Contradiction:
Improveillumination qualityVSAvoidreal time imaging capability
Core Design Contradiction:
Illumination intensityVSProductivity

Solution Approach 1:

The lighting information is pre-calculated and stored in a light map before the actual rendering process. During real-time imaging, the system simply retrieves and applies the pre-computed lighting data from the light map, rather than performing complex real-time calculations for multiple light sources. This preliminary action enables high-quality illumination without compromising real-time performance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of performing computationally intensive real-time calculations for multiple light sources, the system creates a simplified copy or representation of the lighting information in the form of a light map. This light map contains the essential illumination data that can be efficiently applied during rendering, preserving visual quality while enabling real-time processing.

Inventive Principle:
Principle #26Copying

3Productivity

If ambient illumination is used for the entire volume, then computational requirements are low, but the view becomes unrealistic

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidrealism of visual representation
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The lighting system applies different illumination characteristics to different local regions of the volume. Each region receives lighting appropriate to its specific anatomical context and depth, creating a realistic visual representation. This local differentiation of lighting quality maintains computational efficiency while achieving photorealistic results.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The lighting parameters are dynamically adjusted based on the local properties of different regions within the volume. By changing parameters such as light intensity, direction, and color based on position and tissue type, the system achieves realistic illumination without requiring computationally expensive global illumination calculations.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11127197B2Internal lighting for endoscopic organ visualization
Publication Date: 2021.09.21 SIEMENS HEALTHINEERS AG
  • US11127197B2 patent drawing
  • US11127197B2 patent drawing
  • US11127197B2 patent drawing

AI summary

Systems and methods are provided rendering a three-dimensional volume. Scan data representing an anatomical object of a patient is acquired. A boundary of the object is identified in the scan data. A first lightmap is positioned inside the boundary of the object. A second lightmap is positioned outside the boundary of the object. The three-dimensional volume of the object is rendered from the scan data with lighting based on the first lightmap and second lightmap.