Four-Dimensional Surgical Training Model with Haptic Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current surgical training methods are limited by the need for hands-on experience, which can be risky for novice surgeons, and are hindered by the infrequent performance of certain procedures, especially in remote or underserved areas, with existing technologies providing only two-dimensional video editing and crude virtual reality simulations.

Innovation Solution

A system that captures three-dimensional data and haptic feedback from actual surgical procedures to create a four-dimensional model, allowing for interactive and realistic virtual surgical training, enabling novice surgeons to practice with simulated instruments and receive feedback on their inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional surgical training methods (studying static book material, dissecting cadavers, observing surgical procedures) are used, then surgeons can learn surgical procedures, but the learning curve is steep and normally fraught with failure requiring considerable hands-on experience and actual patient exposure

Engineering Contradiction:
Improvetraining effectivenessVSAvoidrisk of errors by novice surgeons
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent creates virtual copies of surgical procedures by capturing real surgical footage and reconstructing them as interactive 3D models. These virtual replicas allow novice surgeons to practice procedures repeatedly in a risk-free environment, maintaining training effectiveness while eliminating the harm of actual patient exposure to novice errors

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system introduces an intermediary virtual reality layer between novice surgeons and actual patients. This intermediary allows trainees to gain hands-on experience through simulated procedures, reducing the steep learning curve and failure rates associated with direct patient exposure while still providing realistic surgical training

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If remote teleconferencing and two-dimensional video editing techniques are used for surgical training, then geographic limitations can be overcome and training materials can be created, but the training lacks interactivity and realism

Engineering Contradiction:
Improveaccess to remote surgical trainingVSAvoidinteractivity of training
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent transitions from two-dimensional video editing to four-dimensional interactive modeling by capturing three-dimensional surgical data and creating time-based 3D models. This dimensional enhancement provides both remote accessibility and full interactivity, allowing trainees to navigate and manipulate surgical procedures from any location while maintaining realistic spatial relationships and tactile feedback

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system replaces passive two-dimensional video viewing with active four-dimensional interactive exploration. Trainees can manipulate virtual surgical instruments, pause and rewind procedures, and examine anatomical structures from multiple angles, transforming static video content into dynamic, interactive training experiences that combine remote accessibility with hands-on engagement

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If three-dimensional models with simulated surgical instruments and haptic feedback are used, then virtual reality surgical training experience can be created, but the models use static or crudely dynamic representations with false or non-photorealistic color rendering

Engineering Contradiction:
Improveinteractivity of virtual trainingVSAvoidrealism of visual representation
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent transforms crude virtual reality models into photorealistic representations by capturing actual surgical footage and using it to texture and illuminate 3D anatomical models. This parameter change in visual fidelity maintains full interactivity and haptic feedback while replacing false color rendering with authentic surgical imagery, creating training materials that are both highly interactive and visually accurate

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9396669B2Surgical procedure capture, modelling, and editing interactive playback
Publication Date: 2016.07.19 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9396669B2 patent drawing
  • US9396669B2 patent drawing
  • US9396669B2 patent drawing

AI summary

A system for generating surgical procedure training media draws upon the realistic data of an actual surgical procedure for realistic training without the risks. A 3D capturing component records three-dimensional model plus imaging data over time of a portion of a patient's body undergoing a surgical procedure. A spatial detection system detects an orientation of a surgical instrument relative to the patient's body during the surgical procedure. A modeling component creates a four-dimensional model (3D model+time) of the portion of the patient's body. Animation such as contingent events, trainee prompts, a virtual surgical instrument, etc., can be added to the model to expand upon the training potential. A user interface processes and edits training media for playback of the four-dimensional model including defining triggers responsive to a trainee simulated surgical inputs to pace sequencing of playback. An interactive player responds to pacing the playback of the editing training media or to a spatially detected simulated surgical instrument held by the student for direct tissue interaction.