Endoscope Guidance via 3D Image Registration and Coordinate Alignment

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In minimally invasive coronary artery bypass grafting procedures, the lack of clear endoscope orientation and intuitive control leads to inefficiencies and prolonged operating room times due to the mismatch between the endoscope's coordinate system and the surgeon's or assistant's coordinate system, resulting in counter-intuitive instructions and a trial-and-error approach.

Innovation Solution

The system registers preoperative and intraoperative images with endoscope images, overlays visual cues for navigation, and pre-orientates the endoscope camera to align with the user's preferred coordinate system, using an actuated platform to adjust the camera's orientation based on real-time motion tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If the endoscope is inserted from the right side or posterior-anterior direction, then the surgical procedure can be performed minimally invasively, but the coordinate system mismatch causes counter-intuitive control and prolonged operating room time

Engineering Contradiction:

Improveminimally invasive capabilityVSAvoidendoscope control intuitiveness

Core Design Contradiction:

Ease of manufactureVSEase of operation

Solution Approach 1:

The patent introduces a coordinate transformation system as an intermediary that converts between the endoscope's coordinate system and the surgeon's intuitive coordinate system. This mediator layer translates counter-intuitive movement commands into natural directional controls, allowing the surgeon to operate as if looking directly through the endoscope without manually adjusting for coordinate mismatches.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical/manual coordination method with an automated computational system. Instead of relying on the assistant to manually interpret and execute counter-intuitive directional commands, the system uses real-time image processing and coordinate transformation algorithms to automatically align the visual feedback with the surgeon's intended movements.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If the camera is rotated 180°, then the endoscope can capture anatomy from different perspectives, but the image appears inverted on the screen with no way of knowing the camera's orientation

Engineering Contradiction:

Improvecamera orientation flexibilityVSAvoidcamera orientation information

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent implements a feedback mechanism that continuously monitors and displays the camera's actual orientation relative to the patient's anatomy. By overlaying reference markers and anatomical landmarks on the endoscope images, the system provides real-time feedback about camera positioning, allowing the surgeon to understand and correct orientation without physical reference points.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent uses visual indicators such as colored overlays and directional markers on the endoscope images to encode orientation information. Different colors or marker orientations indicate the camera's rotational state, providing immediate visual feedback about whether the image is inverted or correctly oriented without requiring the surgeon to mentally track camera position.

Inventive Principle:

Principle #32Color changes

3Ease of operation

If the assistant responds to surgeon instructions manually, then the endoscope can be repositioned, but the counter-intuitive control requires trial and error approach

Engineering Contradiction:

Improveendoscope repositioning capabilityVSAvoidtrial and error adjustment time

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces manual trial-and-error adjustment with an automated guidance system that provides real-time visual feedback. The system processes endoscope images, compares them with pre-operative or intraoperative reference images, and generates directional guidance cues that tell the assistant exactly which way to move the endoscope to reach the target area, eliminating guesswork and iterative adjustments.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an automated image processing and guidance generation system as an intermediary between the surgeon's intent and the assistant's physical manipulation of the endoscope. This mediator analyzes the visual field, determines the direction to the area of interest, and translates it into intuitive movement instructions, reducing the communication overhead and trial-and-error cycles.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS11452464B2Guidance tools to manually steer endoscope using pre-operative and intra-operative 3D images

Publication Date: 2022.09.27 KONINKLIJKE PHILIPS NV

AI summary

Systems and methods for guided endoscope navigation include a registration module (118) configured to, using a processor, register a first set of images (112) with a second set of images (114) of an endoscope (102). A selection module (120) is configured to receive selected areas of interest on the first set of images and transform the selected areas of interest to an endoscope coordinate frame. A guidance module (122) is configured to overlay guidance tools onto the second set of images to permit a user of the endoscope to navigate to the selected areas of interest.