Intraoperative Tissue Scanning with Depth Sensor and Camera Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current surgical scanning technologies face inaccuracies due to deviations between preoperative 3D modeled anatomical features and actual tissue during surgery, especially in procedures like knee and hip replacement, where precise tool positioning is critical and some anatomical features are difficult to accurately model preoperatively.

Innovation Solution

A tissue scanning system comprising a depth sensor, a camera-based tracking system, and a processing device that generates a surface point cloud by determining distances and relative orientations between anatomical features and a pointer device, using markers to calculate positions and orientations, and updates patient profiles with real-time data for improved accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If preoperative 3D modeling is used to plan surgery, then surgical planning can be performed in advance, but the accuracy of anatomical features deviates from actual tissue during surgery

Engineering Contradiction:
Improvesurgical planning timeVSAvoidanatomical feature accuracy
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The system performs preliminary 3D modeling and surgical planning using preoperative imaging data, creating an initial surgical plan before the actual surgery. This allows surgeons to prepare and visualize the procedure in advance, while the system later updates the model intraoperatively to maintain accuracy throughout the surgery.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system captures real-time intraoperative images and compares them with the preoperative 3D model, automatically detecting deviations and updating the model accordingly. This feedback loop ensures the surgical plan remains accurate by continuously reconciling the virtual model with actual anatomical conditions discovered during surgery.

Inventive Principle:
Principle #23Feedback

2Loss of information

If comprehensive preoperative imaging is performed to capture all anatomical features, then more complete 3D models can be created, but some anatomical features remain difficult to accurately model

Engineering Contradiction:
Improveanatomical feature completenessVSAvoidanatomical feature accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The system performs preliminary 3D modeling and surgical planning using preoperative imaging data, creating an initial surgical plan before the actual surgery. This allows surgeons to prepare and visualize the procedure in advance, while the system later updates the model intraoperatively to maintain accuracy throughout the surgery.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system captures real-time intraoperative images and compares them with the preoperative 3D model, automatically detecting deviations and updating the model accordingly. This feedback loop ensures the surgical plan remains accurate by continuously reconciling the virtual model with actual anatomical conditions discovered during surgery.

Inventive Principle:
Principle #23Feedback

3Productivity

If surgical tools are positioned based on preoperative models, then surgical efficiency is improved, but positioning accuracy decreases due to tissue deviation

Engineering Contradiction:
Improvesurgical efficiencyVSAvoidtool positioning accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system continuously updates the 3D model by comparing preoperative data with real-time intraoperative images, detecting tissue deviations and automatically adjusting the surgical plan. This feedback mechanism maintains positioning accuracy while preserving surgical efficiency by keeping the plan up-to-date without requiring manual re-planning.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The surgical plan transitions from a static preoperative model to a dynamic, adaptive plan that automatically adjusts based on intraoperative conditions. The system实时更新 the 3D model and surgical plan during the procedure, allowing the plan to adapt to actual anatomical variations while maintaining surgical workflow efficiency.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides accurate, real-time surface point clouds of anatomical features, enhancing surgical precision by aligning surgical tools with actual tissue conditions, even where preoperative imaging is limited, thus improving surgical outcomes.

Implementation Method 1

a depth sensor configured to determine distance to a surface

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

a camera-based tracking system configured to determine relative orientation and position between an anatomical feature and the pointer device; identify the pointer markers and tissue markers in one or more fields of view of the camera-based tracking system

Methodology Applied
Scientific EffectOptical detection: Photography

Data Source

PatentUS20240016550A1Scanner for intraoperative application
Publication Date: 2024.01.18 KICO KNEE INNOVATION CO PTY LTD
  • US20240016550A1 patent drawing
  • US20240016550A1 patent drawing
  • US20240016550A1 patent drawing

AI summary

A tissue scanning system (1) comprising: a depth sensor (13) configured to determine distance to a surface; a pointer device (11), wherein the depth sensor (13) is mounted to the pointer device (11); a camera-based tracking system (3) configured to determine (114) relative orientation and position between an anatomical feature (9) and the pointer device (11); and at least one processing device (6). The processing device (6) is configured to: generate (116) a surface point cloud (16) of a surface (17) associated with the anatomical feature (9) based on a plurality of determined distances from the depth sensor (13) and corresponding relative orientation and position of the pointer device (11) relative to the anatomical feature (9).