Naked Eye 3D Surgical Video Depth Perception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional surgical operation videos, despite organ or tissue labeling, fail to effectively display depth information, leading to increased surgical errors for inexperienced assistants.
Innovation Solution
A real-time system and method that synchronously captures 2D surgical operation videos from different angles, generates a naked eye 3D video, and projects these videos to the viewer's left and right eyes, using a 3D display to accurately display depth information and prompts for labeled target parts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If 2D surgical operation videos with organ labels are used, then the learning effect is improved, but the depth perception ability is lost
Solution Approach 1:
The patent transforms 2D surgical videos into 3D visual experience by capturing images from multiple cameras at different positions and synthesizing them into stereoscopic views. This dimensional transformation restores depth information that is inherently lost in 2D representations, allowing viewers to perceive spatial relationships and depths of surgical objects accurately.
Solution Approach 2:
The patent introduces an image synthesis module as an intermediary that processes images from multiple cameras and generates depth maps. This intermediary component bridges the gap between 2D camera captures and 3D perception, creating virtual depth information that enhances the visual representation without requiring complex hardware changes to the surgical setup.
2Reliability
If multiple cameras are used to capture 3D videos, then the depth perception is improved, but the device complexity is increased
Solution Approach 1:
The patent extracts depth information from multiple camera images through image synthesis and depth map generation, rather than requiring complex multi-camera 3D video capture systems. By separating the depth extraction function from the camera system, the patent reduces device complexity while maintaining depth perception accuracy.
Solution Approach 2:
The patent creates virtual depth copies by synthesizing depth maps from 2D images captured by multiple cameras. Instead of requiring expensive and complex stereoscopic cameras, the system creates computational copies of depth information through image processing, significantly reducing hardware complexity while achieving 3D visualization.
3Productivity
If real-time image processing is implemented, then the prompt display speed is improved, but the processing time is increased
Solution Approach 1:
The patent performs preliminary processing by pre-computing depth maps and synthesizing 3D images from multiple camera views before they are needed for display. This advance preparation allows real-time prompt generation and display without introducing significant processing delays during critical surgical moments.
Solution Approach 2:
The patent implements continuous image synthesis and depth map generation pipelines that process video frames in real-time without interruption. By maintaining continuous processing flow and optimizing the synthesis algorithm, the system achieves both real-time performance and acceptable processing speeds for surgical assistance.
Data Source
AI summary
A system of real-time displaying prompt in synchronous displayed surgical operation video and a method thereof are disclosed. In the system, 2D surgical operation videos are synchronously captured from different viewing angles, and a target part is generated based on an obtained instruction message, a prompt corresponding to the target part in the two 2D surgical operation videos is generated, and the two 2D surgical operation videos are projected to left and right eyes of a viewer, respectively, to make the viewer watch a 3D surgical operation video, to effectively present depths of objects in a surgical operation video. Therefore, the effect of reducing surgical errors caused by doctors misjudging depths of objects in surgical operation videos can be achieved.