Intraoperative Brain Shift Compensation Using Stereo Optical Depth Camera

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Brain shift during neurosurgical procedures, caused by changes in intracranial pressure and deformation, leads to inaccuracies in preoperative imaging-guided electrode placement, resulting in significant errors and risks of vascular injury due to misalignment of target structures.

Innovation Solution

A system utilizing a stereo optical three-dimensional depth camera with a surface-mapping system and neural network interpretation to generate an intraoperative 3D brain model, combining preoperative imaging data with real-time intraoperative data to account for brain shift and optimize surgical planning, minimizing vascular conflicts by identifying and characterizing brain shift in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If preoperative CT/MRI scans are used to localize targets for electrode placement, then the initial planning accuracy is improved, but brain shift during surgery causes the guidance to become inaccurate

Engineering Contradiction:
Improvetarget localization accuracyVSAvoidguidance accuracy during surgery
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system continuously captures intraoperative 3D images of the brain surface and compares them with preoperative MRI data to detect brain shift. This feedback loop updates the target localization in real-time, maintaining accuracy despite brain movement during surgery.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary 3D mapping of the brain surface before surgery and creates a deformable model in advance. This preliminary action enables real-time tracking and compensation of brain shift without requiring additional intraoperative imaging resources.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If fixed fiducials on the skull surface are used as reference points, then the electrode insertion process is simplified, but they cannot account for shifting of intracranial contents

Engineering Contradiction:
Improveelectrode insertion processVSAvoidtarget localization accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system transitions from static fiducial-based registration to a dynamic 3D surface mapping approach. The deformable brain model continuously adapts to brain shift by comparing intraoperative 3D images with the preoperative model, maintaining precision while preserving operational simplicity.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If linear advancement towards the target is used for electrode delivery, then the procedure is straightforward, but it may result in vascular damage

Engineering Contradiction:
Improveelectrode delivery simplicityVSAvoidvascular injury risk
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system integrates preoperative MRA, PC-MRA, and SWI imaging data to create a detailed vascular map with different quality characteristics for different regions. This allows the navigation system to identify and avoid blood vessels locally, modifying the electrode path only where vascular structures are present while maintaining straightforward delivery elsewhere.

Inventive Principle:
Principle #3Local quality

4Measurement precision

If intraoperative MRI or ultrasound is used to update the brain model, then brain shift compensation is improved, but the complexity and cost of the system increases

Engineering Contradiction:
Improvebrain shift detection accuracyVSAvoidimaging system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system creates a 3D optical copy of the brain surface using depth cameras and structured light projection. This optical model serves as a lightweight alternative to heavy intraoperative MRI or ultrasound systems, achieving comparable brain shift detection accuracy without the associated complexity and cost.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system replaces mechanical/invasive imaging methods (MRI, ultrasound probes) with optical 3D mapping technology. This substitution maintains the ability to track brain deformation while eliminating the complexity of intraoperative imaging equipment and reducing surgical time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the accuracy and safety of neurosurgical procedures by continuously updating the brain model to reflect actual brain position and deformation, reducing the risk of vascular damage and improving the precision of electrode placement.

Implementation Method 1

stereo optical three-dimensional depth camera with a surface-mapping system

Methodology Applied
Scientific EffectStereo optical three-dimensional depth sensing: Parallax

Implementation Method 2

Time-of-flight magnetic resonance angiography for arteries

Methodology Applied
Scientific EffectTime-of-flight magnetic resonance angiography: Time of Flight

Implementation Method 3

Phase Contrast magnetic resonance angiography for both veins and arteries

Methodology Applied
Scientific EffectPhase Contrast magnetic resonance angiography: Doppler Effect

Implementation Method 4

susceptibility weighted imaging for veins

Methodology Applied
Scientific EffectSusceptibility weighted imaging: Magnetic Field

Data Source

PatentUS12156702B2Method and apparatus for registering a neurosurgical patient and determining brain shift during surgery using machine learning and stereooptical three-dimensional depth camera with a surface-mapping system
Publication Date: 2024.12.03 INTENEURAL NETWORKS INC
  • US12156702B2 patent drawing
  • US12156702B2 patent drawing
  • US12156702B2 patent drawing

AI summary

A method for generating an intraoperative 3D brain model while a patient is operated. Before an opening in a patient's skull is made, the method includes: providing a preoperative 3D brain model of a patient's brain and converting it to a preoperative 3D brain point cloud; providing a preoperative 3D face model of a patient's face and converting it to a preoperative 3D face point cloud. After the opening in the patient's skull is made, the method includes: matching the intraoperative 3D face point cloud with the preoperative 3D face point cloud to find a face point transformation; transforming the intraoperative 3D brain point cloud based on said face point cloud transformation; comparing the intraoperative 3D brain point cloud with the preoperative 3D brain point cloud to determine a brain shift; and converting the preoperative 3D brain model to generate an intraoperative 3D brain model based on said brain shift.