Real-time Tissue Deformation Visualization via Game Engine Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current medical procedures using intrabody probes lack effective visualization of dynamic changes in body tissue during catheter procedures, limiting the operator's ability to accurately navigate and perform treatments in real-time.

Innovation Solution

A method and system utilizing a graphical game engine to dynamically render and display geometrical effects on a simulated tissue scene, based on interaction data from intrabody probes, including adjustments for changes in tissue shape, orientation, and energy exchange, providing a real-time, motion frame-rate visualization of probe-tissue interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional fluoroscopy and electromagnetic field-guided position sensing systems are used for navigation and monitoring, then the procedure can be performed with established techniques, but the visualization of dynamic tissue changes during the procedure is insufficient

Engineering Contradiction:
Improvevisualization of tissue changesVSAvoidimaging and sensing system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent creates a virtual copy of the tissue geometry that mirrors the physical tissue structure. This virtual model is continuously updated based on probe interaction data, allowing visualization of tissue deformation without requiring complex real-time imaging of the actual tissue. The virtual copy serves as a dynamic representation that can be rendered and manipulated computationally.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces traditional mechanical imaging systems (fluoroscopy) with a computational approach. Instead of using physical X-ray imaging to visualize tissue, the system uses computer-generated rendering based on interaction data from the probe. This substitution of mechanical/optical imaging with computational modeling reduces the complexity of the imaging hardware while providing enhanced visualization capabilities.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If real-time visualization of tissue deformation is implemented, then the operator's ability to navigate and perform treatments accurately is improved, but the computational processing requirements increase

Engineering Contradiction:
Improvetissue deformation detectionVSAvoidcomputational processing power
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent focuses computational resources on rendering only the specific regions of tissue that are currently being interacted with or are relevant to the procedure. Rather than computing and rendering the entire tissue volume at full resolution, the system applies detailed geometric adjustments only to affected areas, reducing overall computational load while maintaining measurement precision where needed.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent implements a dynamic rendering approach where the level of geometric adjustment and rendering detail adapts based on the current procedural state. As the probe interacts with tissue, the system dynamically updates the virtual geometry in real-time, adjusting the computational effort to match the immediate needs of the procedure rather than maintaining constant high-level processing.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If geometric rendering data are adjusted at high frame rates (10 fps or more), then the realism and intuitiveness of tissue visualization is enhanced, but the processing speed requirements increase

Engineering Contradiction:
Improveintuitiveness of tissue visualizationVSAvoidprocessing speed
Core Design Contradiction:
Ease of operationVSSpeed

Solution Approach 1:

The patent implements periodic updating of the geometric rendering data at specified frame rates (10 fps or more). This periodic action ensures that the visualization remains realistic and intuitive by providing smooth, continuous updates that match human perception thresholds. The system rhythmically refreshes the rendered images based on probe interaction data, balancing visual quality with processing demands.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11284813B2Real-time display of tissue deformation by interactions with an intra-body probe
Publication Date: 2022.03.29 NAVIX INT
  • US11284813B2 patent drawing
  • US11284813B2 patent drawing
  • US11284813B2 patent drawing

AI summary

In some embodiments, data sensed and/or operational parameters used during a catheterization procedure are used in the motion frame-rate updating and visual rendering of a simulated organ geometry. In some embodiments, measurements of and/or effects on tissue by sensed and/or commanded probe-tissue interactions are converted into adjustments to the simulated organ geometry, allowing dynamic visual simulation of intra-body states and/or events based on optionally partial and/or non-visual input data. Adjustments to geometry are optionally to 3-D positions of simulated data and/or to simulated surface properties affecting geometrical appearances (e.g., normal mapping). Optionally, the organ geometry is rendered as a virtual material using a software environment (preferably a graphical game engine) which applies simulated optical laws to material appearance parameters affecting the virtual material's visual appearance. Optionally, physiology, motion physics, and/or other physical processes are simulated based on live inputs, as part of assigning geometrical adjustments to the simulated tissue.