Laparoscopic Image Overlay for Depth Perception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Laparoscopic surgery lacks depth perception, forcing surgeons to divert attention from the primary surgical site to access additional depth information, leading to potential disruptions and extended procedure times.
Innovation Solution
A laparoscopic image manipulation method that captures video streams, overlays 3D models of target organs or structures onto the images in real-time, and displays the composite images on a primary surgical monitor, allowing surgeons to maintain focus without interrupting the procedure.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If additional information (3D models, CT scans) is displayed on separate monitors or physical models, then depth perception is improved, but the surgeon must break eye contact with the primary surgical site, leading to procedure disruptions and extended procedure time
Solution Approach 1:
The patent merges the 3D model representation with the laparoscopic video stream by overlaying the rendered 3D model onto the live surgical images on the primary monitor. This integration allows the surgeon to view both the actual surgical field and the depth-enhanced 3D model simultaneously without switching attention between separate displays, thus maintaining continuous focus on the surgical site while gaining improved depth perception.
Solution Approach 2:
The system introduces a video processor and renderer as intermediary components that process the laparoscopic video stream and 3D model data, then combine them into a composite enhanced image. This intermediary processing allows depth information to be embedded within the primary video feed without requiring the surgeon to physically move to or visually shift to separate displays, eliminating procedure interruptions.
2Loss of information
If additional information is displayed on an additional screen or 3D printed model, then spatial relationship understanding is improved, but the surgeon is forced to stop the procedure with a time-out, disrupting the procedure
Solution Approach 1:
The system combines the 3D model overlay with the laparoscopic video feed on the primary surgical monitor, allowing the surgeon to maintain uninterrupted visual contact with the surgical field while simultaneously accessing enhanced spatial relationship information. The merged display eliminates the need for procedural stoppages to consult separate models or screens.
Solution Approach 2:
The patent adds a third dimensional representation (3D model) to the traditional two-dimensional laparoscopic video feed by rendering and overlaying the 3D model onto the video stream. This dimensional enhancement provides improved spatial relationship understanding while maintaining the continuous visual flow on the primary monitor, avoiding procedure disruptions.
3Loss of information
If 3D models are displayed on separate displays, then depth perception is compensated, but eye contact with the primary surgical situation is lost, creating a dangerous situation
Solution Approach 1:
The system merges the 3D model representation with the live laparoscopic video stream on the primary surgical monitor, ensuring that depth-enhanced information is integrated directly into the surgeon's primary visual field. This integration eliminates the safety risk of losing eye contact with the surgical site while still providing compensated depth perception through the overlaid 3D model.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
The present disclosure relates to a laparoscopic image manipulation method and system (10) and to a computer program implementing said laparoscopic image manipulation method. The method comprises capturing a video stream of laparoscopic images (24) of a patient (2) using a laparoscope (12) inserted into the patient (2) during a laparoscopic procedure, feeding the captured laparoscopic images (24) to a video processor (14) configured to adding additional information (28) as overlay over the captured laparoscopic images (24), producing a composite image (20) by rendering a representation (26) of a 3D model (18) of a target organ or structure (30) using a renderer (16) and merging the rendered representation of the 3D model (18) with the captured laparoscopic image (24) and displaying the composite image (20) on a monitor.